diff --git a/README.md b/README.md index 399675e..ec3ace1 100644 --- a/README.md +++ b/README.md @@ -14,9 +14,8 @@ Stabilná baseline retrieval vetva používa klasický hybridný RAG: FTS5/BM25 + embeddingy + RRF. Nad týmto baseline sa vo vetve GraphRAG dopĺňa knowledge graph uložený v Neo4j. Aktuálne je implementovaná grafová infraštruktúra, deterministický builder, vizualizácia grafu a -samostatné grafové vyhľadávanie. Ďalším krokom je rozšírenie dátového -modelu podľa požiadaviek projektu a spojenie grafového vyhľadávania s -RAG vrstvou. +samostatné grafové vyhľadávanie. Grafová vrstva má zmrazenú evaluáciu v1; ďalším krokom je zapojenie +do OpenWebUI a nová zdrojovo overená verzia benchmarku. ## Implementované @@ -66,8 +65,8 @@ RAG vrstvou. - Neo4j databáza spúšťaná ako samostatná Docker služba, - deterministická tvorba knowledge graphu z `documents.json` a `chunks.json`, -- grafové entity `Person`, `Document`, `Work`, `Topic`, `Category` a - `Author`, +- grafové entity `Person`, `Document`, `DocumentAuthor`, `Thesis`, + `Work`, `Keyword`, `Topic` a `Category`, - grafové vzťahy pre dokumenty, práce, témy, kategórie a autorstvo, - uniqueness constraints a opakovateľný rebuild GraphRAG grafu, - Neo4j Browser na vizualizáciu a kontrolu vytvoreného grafu, @@ -137,10 +136,12 @@ build_graphrag.py Neo4j ├── Person ├── Document +├── Thesis ├── Work +├── Keyword ├── Topic ├── Category -└── Author +└── DocumentAuthor ↓ grafové vzťahy + vizualizácia ↓ @@ -805,22 +806,25 @@ Aktuálne používané hlavné typy uzlov: ```text Person Document +DocumentAuthor +Thesis Work +Keyword Topic Category -Author ``` Hlavné vzťahy zahŕňajú napríklad: ```text -Person -[:HAS_DOCUMENT]-> Document -Person -[:HAS_WORK]-> Work -Work -[:EVIDENCED_BY]-> Document -Document -[:HAS_TOPIC]-> Topic -Document -[:IN_CATEGORY]-> Category -Author -[:AUTHORED]-> Document -Document -[:DESCRIBES]-> Topic +Person -[:HAS_DOCUMENT]-> Document +Person -[:AUTHORED]-> Thesis +Person -[:HAS_WORK]-> Work +Thesis/Work -[:EVIDENCED_BY]-> Document +Document -[:HAS_KEYWORD]-> Keyword +Document -[:IN_CATEGORY]-> Category +DocumentAuthor -[:AUTHORED_DOCUMENT]-> Document +Document -[:DESCRIBES]-> Topic ``` Knowledge graph sa vytvorí príkazom: @@ -839,6 +843,12 @@ grafové vyhľadávanie je implementované v `tools/graphrag/graph_search.py`. GraphRAG zatiaľ nezasahuje do stabilného klasického `/rag` toku; ďalšia etapa spojí grafové výsledky s klasickým RAG a OpenWebUI nástrojom. +Zmrazená evaluácia GraphRAG v1: DEV **209/286 (73,08 %)**, TEST +**152/214 (71,03 %)**, bez runtime chýb. Audit pred TESTom odhalil +137 zdrojových nesúladov v benchmarku; všetky zostávajú zahrnuté +v primárnom skóre. Podrobné výsledky, doplnkové metriky a postup +reprodukcie sú v [GraphRAG evaluácii](tools/graphrag/evaluation/README.md). + ## OpenWebUI ZP Agent je pripojený do OpenWebUI ako OpenAPI Tool Server. @@ -1052,21 +1062,18 @@ Klasický RAG a GraphRAG sú oddelené do samostatných komponentov v `tools/rag/` a `tools/graphrag/`. Stabilný klasický RAG zostáva referenčným bodom. -### 1. Doplnenie GraphRAG dátového modelu +### 1. GraphRAG dátový model -Podľa zadania doplniť alebo jasne oddeliť záverečnú prácu, autora práce, -tému, kľúčové slová a študijný program tam, kde sú tieto údaje v zdroji -reálne dostupné. Nevytvárať údaje, ktoré ZP Wiki neobsahuje. +Model je implementovaný. Rozlišuje autora dokumentu, študenta, záverečnú +prácu, projekt, tému a kľúčové slovo. Študijný program sa nedopĺňa bez +spoľahlivého zdroja. ### 2. GraphRAG evaluácia -Spustiť samostatnú evaluáciu `graph_search.py` nad: - -```text -tools/graphrag/evaluation/graphrag_questions.json -``` - -a vyhodnotiť entity, vzťahy, cesty a nájdené dokumenty. +V1 je zmrazená a vyhodnotená. [Finálna správa](tools/graphrag/evaluation/results/final_2026-10-24/REPORT.md) +uvádza všetky výsledky aj zostávajúce limity. Pred formálnym porovnaním +s klasickým RAG treba pripraviť novú zdrojovo overenú verziu benchmarku. +Zistenia z finálneho TESTu patria do ďalšej verzie s novým holdoutom. ### 3. OpenWebUI nástroje diff --git a/tools/graphrag/evaluation/README.md b/tools/graphrag/evaluation/README.md new file mode 100644 index 0000000..398df5e --- /dev/null +++ b/tools/graphrag/evaluation/README.md @@ -0,0 +1,62 @@ +# GraphRAG evaluácia + +Aktuálny výsledok v1 a obmedzenia: [finálna správa](results/final_2026-10-24/REPORT.md). +Primárne skóre: DEV **209/286 (73,08 %)**, TEST **152/214 (71,03 %)**, bez runtime chýb. + +Benchmark má 500 otázok (286 DEV, 214 TEST), schema v2. Statický audit pred finálnym TESTom odhalil 137 nesúladov očakávaní so zdrojmi. Všetky zostávajú zahrnuté v primárnom skóre. Doplnková podmnožina bez zistených nesúladov má DEV 209/209 a TEST 152/154; podrobnosti a dve zostávajúce zlyhania sú v správe. + +## Reprodukcia zmrazenej evaluácie + +Použi rovnaké `data/documents.json`, `data/chunks.json` a rovnaký obsah Neo4j. Odtlačky sú v `frozen_v1.json`; Git revízia wiki je vo výsledkovom JSON. Načítaj vlastné lokálne tajomstvá bez ich výpisu: + +```bash +set -a +source .env +set +a + +python -m tools.graphrag.evaluation.evaluate_graphrag \ + --split test \ + --audit tools/graphrag/evaluation/results/final_2026-10-24/source_audit.json \ + --freeze-manifest tools/graphrag/evaluation/frozen_v1.json \ + --output-dir /tmp/graphrag-v1-reproduction +``` + +TEST/all bez manifestu sa odmietne. Overuje sa kód, benchmark, vstupné JSON súbory, obsah grafu, audit aj parametre. Zmenený obsah, neúplný holdout alebo iné parametre beh zablokujú. Výsledky neregeneruj do adresára archivovaného finálneho behu. + +## Nová vývojová verzia + +Ďalší vývoj musí mať vlastné výsledky a nový manifest. Už vyhodnotený TEST nepoužívaj na dolaďovanie deklarované ako nový nezávislý experiment. + +```bash +python -m tools.graphrag.evaluation.audit_benchmark \ + --output /tmp/graphrag-next/source_audit.json + +python -m tools.graphrag.evaluation.evaluate_graphrag \ + --split dev \ + --audit /tmp/graphrag-next/source_audit.json \ + --output-dir /tmp/graphrag-next + +python -m tools.graphrag.evaluation.freeze_graphrag \ + --dev-results /tmp/graphrag-next/graphrag_dev.json \ + --audit /tmp/graphrag-next/source_audit.json \ + --output /tmp/graphrag-next/frozen.json +``` + +Zmrazenie vyžaduje kompletný DEV bez runtime chýb a súlad s aktuálnymi odtlačkami. Nevyžaduje predstieraných 100 % na chybne anotovanom datasete. Obsahový manifest platí aj pre zmeny, ktoré ešte nemajú commit; Git tag označuje publikovaný checkpoint. + +## Metriky a dôkazy + +Strict kontroluje očakávané hodnoty, typované entity, relácie, vlastnosti, zdrojové dokumenty a URL, presnú množinu pri definovaných prípadoch, správny počet pri agregácii a neorezaný výsledok. Samotné entity rozpoznané z otázky nie sú odpoveďou. `expected_paths` sú opisné anotácie a nehodnotia sa doslovným porovnaním reťazcov. + +Výstup obsahuje JSON aj CSV, metriky podľa kategórie a obtiažnosti, priemer/medián/p95 latencie, čas behu, verziu Pythonu, Git revízie a obsahové odtlačky. Latencia je iba čas vyhľadávania v grafe. + +## Testy + +```bash +pytest -q + +# Po načítaní Neo4j konfigurácie z .env: +RUN_NEO4J_TESTS=1 pytest -q tools/graphrag/tests/test_graph_search_neo4j.py +``` + +Neo4j testy používajú unikátny oddelený scope a rollback transakcie. Existujúce wiki dáta nemenia. diff --git a/tools/graphrag/evaluation/__init__.py b/tools/graphrag/evaluation/__init__.py new file mode 100644 index 0000000..e69de29 diff --git a/tools/graphrag/evaluation/audit_benchmark.py b/tools/graphrag/evaluation/audit_benchmark.py new file mode 100644 index 0000000..daa5155 --- /dev/null +++ b/tools/graphrag/evaluation/audit_benchmark.py @@ -0,0 +1,123 @@ +"""Check source consistency without changing questions or consulting search output.""" +from __future__ import annotations + +import argparse +import hashlib +import json +import re +from collections import Counter, defaultdict +from pathlib import Path +from typing import Any + +from ..graphrag import build_graph_payload +from .graphrag_evaluator import normalize_text +from .reproducibility import content_fingerprints + +ROOT = Path(__file__).resolve().parents[3] + + +def audit_questions(questions: list[dict], payload: dict) -> dict[str, Any]: + people = {normalize_text(row['name']): row for row in payload['people']} + documents = {row['path']: row for row in payload['documents']} + person_docs: dict[str, set[str]] = defaultdict(set) + for row in payload['person_documents']: + person_docs[row['person_id']].add(row['document_path']) + doc_keywords: dict[str, set[str]] = defaultdict(set) + for row in payload['document_keywords']: + doc_keywords[row['document_path']].add(row['keyword_id']) + keywords = {normalize_text(row['name']): row['id'] for row in payload['keywords']} + keywords.update({normalize_text(row['id']): row['id'] for row in payload['keywords']}) + academic: dict[str, list[dict]] = defaultdict(list) + for row in payload['theses'] + payload['works']: + academic[row['source_document']].append(row) + rows = [] + for question in questions: + graph = question['graph'] + issues = [] + starts = [people.get(normalize_text(item['value'])) + for item in graph.get('start_entities', []) if item['type'] == 'person'] + if any(person is None for person in starts): + issues.append('unknown_start_person') + starts = [person for person in starts if person] + expected = graph.get('expected_entities', []) + targets = [people.get(normalize_text(item['value'])) for item in expected if item['type'] == 'person'] + targets = [person for person in targets if person] or starts + required_people = starts if question['category'] == 'shared_keyword_pair' else targets + for entity in expected: + if entity['type'] == 'keyword': + key = keywords.get(normalize_text(entity['value'])) + if key is None: + issues.append('keyword_not_in_frontmatter_catalog') + elif any(not any(key in doc_keywords[path] for path in person_docs[person['id']]) + for person in required_people): + issues.append('keyword_not_linked_to_expected_person') + elif entity['type'] in {'thesis_title', 'work_title'}: + records = payload['theses'] if entity['type'] == 'thesis_title' else payload['works'] + paths = {person['source_document'] for person in starts} + if not any(row['source_document'] in paths + and normalize_text(row.get('title')) == normalize_text(entity['value']) + for row in records): + issues.append('title_not_supported_by_source') + category = question['category'] + if category == 'person_multiple_categories' and starts: + actual = {normalize_text(cat) for path in person_docs[starts[0]['id']] + for cat in documents[path]['categories']} + expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])} + if graph.get('entity_set_mode') == 'exact' and actual != expected_set: + issues.append('exact_categories_omit_or_add_source_categories') + years = {int(value) for value in re.findall(r'\b20\d{2}\b', question['question'])} + if category == 'same_academic_year_pair': + expected_years = {int(item['value']) for item in expected if item['type'] == 'year'} + if any(not expected_years <= {r['year'] for r in academic[p['source_document']]} + for p in starts): + issues.append('shared_year_not_supported_by_source') + if category == 'person_title_year': + expected_years = {int(item['value']) for item in expected if item['type'] == 'year'} + titles = {normalize_text(item['value']) for item in expected + if item['type'] in {'thesis_title', 'work_title'}} + if starts and not any(normalize_text(r.get('title')) in titles and r['year'] in expected_years + for p in starts for r in academic[p['source_document']]): + issues.append('title_year_pair_not_supported_by_source') + if category == 'candidate_set_aggregation': + actual = {normalize_text(p['name']) for p in starts + if any(r['year'] in years for r in academic[p['source_document']])} + expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])} + if actual != expected_set or len(actual) != graph.get('expected_count'): + issues.append('candidate_set_or_count_not_supported_by_source') + for path in question.get('expected_documents', []): + if path not in documents: + issues.append('unknown_expected_document') + rows.append({'id': question['id'], 'split': question['split'], + 'category': category, 'source_consistent': not issues, + 'issues': sorted(set(issues))}) + return { + 'method': 'Static source checks; no retrieval output, question rewriting or alias invention.', + 'questions': rows, + 'by_split': { + split: {'questions': len(selected), + 'source_consistent': sum(row['source_consistent'] for row in selected), + 'issues': dict(Counter(issue for row in selected for issue in row['issues']))} + for split in ['dev', 'test'] + for selected in [[row for row in rows if row['split'] == split]] + }, + } + + +def main() -> None: + parser = argparse.ArgumentParser(description=__doc__) + parser.add_argument('--questions', type=Path, default=Path(__file__).parent / 'graphrag_questions.json') + parser.add_argument('--output', type=Path, required=True) + args = parser.parse_args() + questions = json.loads(args.questions.read_text()) + payload = build_graph_payload(json.loads((ROOT / 'data/documents.json').read_text()), + json.loads((ROOT / 'data/chunks.json').read_text())) + audit = audit_questions(questions, payload) + audit['dataset_sha256'] = hashlib.sha256(args.questions.read_bytes()).hexdigest() + audit['inputs'] = content_fingerprints(args.questions)['inputs'] + args.output.parent.mkdir(parents=True, exist_ok=True) + args.output.write_text(json.dumps(audit, ensure_ascii=False, indent=2) + '\n') + print(json.dumps(audit['by_split'], ensure_ascii=False, indent=2)) + + +if __name__ == '__main__': + main() diff --git a/tools/graphrag/evaluation/evaluate_graphrag.py b/tools/graphrag/evaluation/evaluate_graphrag.py new file mode 100644 index 0000000..8226a23 --- /dev/null +++ b/tools/graphrag/evaluation/evaluate_graphrag.py @@ -0,0 +1,642 @@ +from __future__ import annotations + +import argparse +import csv +import json +import time +from datetime import datetime, timezone +from pathlib import Path +from typing import Any + +from ..graph_db import ( + create_neo4j_driver, + get_neo4j_settings, +) +from ..graph_search import ( + DEFAULT_LIMIT, + DEFAULT_MAX_ENTITIES, + search_graph_with_session, +) +from .graphrag_evaluator import ( + aggregate_by_field, + aggregate_rows, + evaluate_result, + filter_questions, + load_questions, +) +from .reproducibility import graph_fingerprint, run_metadata, sha256_file, verify_freeze + + +EVALUATION_DIR = Path( + __file__ +).resolve().parent + +QUESTIONS_PATH = ( + EVALUATION_DIR + / "graphrag_questions.json" +) + +RESULTS_DIR = ( + EVALUATION_DIR + / "results" +) + + +def parse_args() -> argparse.Namespace: + parser = argparse.ArgumentParser( + description=( + "Vyhodnotenie GraphRAG vyhľadávania " + "proti graphrag_questions.json." + ) + ) + + parser.add_argument( + "--questions", + type=Path, + default=QUESTIONS_PATH, + ) + + parser.add_argument( + "--output-dir", + type=Path, + default=RESULTS_DIR, + ) + + parser.add_argument( + "--split", + choices=( + "dev", + "test", + "all", + ), + default="dev", + help=( + "Predvolene sa vyhodnocuje iba DEV. " + "TEST používaj až po zmrazení GraphRAG." + ), + ) + + parser.add_argument( + "--limit", + type=int, + default=DEFAULT_LIMIT, + ) + + parser.add_argument( + "--max-entities", + type=int, + default=DEFAULT_MAX_ENTITIES, + ) + + parser.add_argument( + "--ids", + type=str, + default="", + help=( + "Voliteľný zoznam ID oddelených čiarkou." + ), + ) + + parser.add_argument( + "--max-questions", + type=int, + default=None, + help=( + "Voliteľne vyhodnotí iba prvých N " + "otázok z vybraného splitu." + ), + ) + + parser.add_argument('--audit', type=Path, help='Predeclared source-consistency audit.') + parser.add_argument('--freeze-manifest', type=Path, + help='Required for TEST/all; verifies code, data, graph and parameters.') + args = parser.parse_args() + if args.split in {'test', 'all'} and args.freeze_manifest is None: + parser.error('TEST/all requires --freeze-manifest after complete DEV evaluation.') + if args.split in {'test', 'all'} and (args.ids or args.max_questions): + parser.error('Frozen holdout evaluation must cover the complete selected split.') + + if args.limit < 1: + parser.error( + "--limit musí byť aspoň 1." + ) + + if args.max_entities < 1: + parser.error( + "--max-entities musí byť aspoň 1." + ) + + if ( + args.max_questions + is not None + and args.max_questions < 1 + ): + parser.error( + "--max-questions musí byť aspoň 1." + ) + + return args + + +def save_json( + path: Path, + payload: dict[str, Any], +) -> None: + path.parent.mkdir( + parents=True, + exist_ok=True, + ) + + path.write_text( + json.dumps( + payload, + ensure_ascii=False, + indent=2, + ) + + "\n", + encoding="utf-8", + ) + + +def save_csv( + path: Path, + rows: list[ + dict[str, Any] + ], +) -> None: + path.parent.mkdir( + parents=True, + exist_ok=True, + ) + + fieldnames = [ + "complete", + "count_ok", + "expected_count", + "actual_count", + "id", + "split", + "category", + "difficulty", + "strict", + "value_score", + "entity_score", + "relation_score", + "property_score", + "relation_choice_score", + "document_recall", + "source_recall", + "entity_set_ok", + "latency_seconds", + "error", + "question", + "expected_values", + "matched_values", + "expected_relations", + "actual_relations", + "expected_documents", + "actual_documents", + "expected_source_urls", + "actual_source_urls", + "fact_types", + "strategies", + ] + + with path.open( + "w", + encoding="utf-8", + newline="", + ) as file: + writer = csv.DictWriter( + file, + fieldnames=fieldnames, + ) + + writer.writeheader() + + for row in rows: + output = {} + + for field in fieldnames: + value = row.get( + field + ) + + if isinstance( + value, + ( + list, + dict, + ), + ): + value = json.dumps( + value, + ensure_ascii=False, + ) + + output[ + field + ] = value + + writer.writerow( + output + ) + + +def print_summary( + summary: dict[str, Any], + *, + split: str, +) -> None: + print() + print( + "=" * 78 + ) + + print( + "GRAPHRAG EVALUATION" + ) + + print( + "=" * 78 + ) + + print( + f"Split: {split}" + ) + + print( + f"Questions: " + f"{summary['questions']}" + ) + + print( + f"Strict: " + f"{summary['strict_count']}/" + f"{summary['questions']} " + f"({summary['strict_accuracy']:.3%})" + ) + + print( + f"Errors: " + f"{summary['error_count']}" + ) + + print( + f"Value score: " + f"{summary['value_score']:.3f}" + ) + + print( + f"Entity score: " + f"{summary['entity_score']:.3f}" + ) + + print( + f"Relation score: " + f"{summary['relation_score']:.3f}" + ) + + print( + f"Property score: " + f"{summary['property_score']:.3f}" + ) + + print( + f"Relation choices: " + f"{summary['relation_choice_score']:.3f}" + ) + + print( + f"Document recall: " + f"{summary['document_recall']:.3f}" + ) + + print( + f"Source recall: " + f"{summary['source_recall']:.3f}" + ) + + print( + f"Latency mean: " + f"{summary['latency_mean_seconds']:.4f} s" + ) + + print( + f"Latency median: " + f"{summary['latency_median_seconds']:.4f} s" + ) + + print( + f"Latency p95: " + f"{summary['latency_p95_seconds']:.4f} s" + ) + + print( + "=" * 78 + ) + + +def main() -> None: + args = parse_args() + metadata = run_metadata(args.questions) + audit = json.loads(args.audit.read_text()) if args.audit else None + if audit and (audit['dataset_sha256'] != metadata['fingerprints']['dataset_sha256'] + or audit['inputs'] != metadata['fingerprints']['inputs']): + raise RuntimeError('Source audit does not match current benchmark and inputs.') + + all_questions = load_questions( + args.questions + ) + + ids = { + value.strip() + for value in args.ids.split( + "," + ) + if value.strip() + } + + questions = filter_questions( + all_questions, + split=args.split, + ids=( + ids + if ids + else None + ), + max_questions=( + args.max_questions + ), + ) + + if not questions: + raise RuntimeError( + "Pre zadaný výber sa nenašli otázky." + ) + + print() + print( + "GraphRAG dataset" + ) + + print( + "=" * 60 + ) + + print( + f"File: {args.questions}" + ) + + print( + f"Total: {len(all_questions)}" + ) + + print( + f"Split: {args.split}" + ) + + print( + f"Selected: {len(questions)}" + ) + + print( + f"Limit: {args.limit}" + ) + + print( + f"Entities: {args.max_entities}" + ) + + print( + "=" * 60 + ) + + settings = ( + get_neo4j_settings() + ) + + rows: list[ + dict[str, Any] + ] = [] + + with create_neo4j_driver( + settings + ) as driver: + driver.verify_connectivity() + + with driver.session( + database=settings.database + ) as session: + metadata['graph'] = graph_fingerprint(session) + if args.freeze_manifest: + verify_freeze(json.loads(args.freeze_manifest.read_text()), metadata, metadata['graph'], + limit=args.limit, max_entities=args.max_entities, audit=args.audit) + total = len( + questions + ) + + for index, question in enumerate( + questions, + start=1, + ): + question_id = str( + question[ + "id" + ] + ) + + print( + f"[{index:04d}/{total:04d}] " + f"{question_id}: " + f"{question['question']}" + ) + + started = ( + time.perf_counter() + ) + + error = None + + try: + result = ( + search_graph_with_session( + session, + str( + question[ + "question" + ] + ), + limit=args.limit, + max_entities=( + args.max_entities + ), + ) + ) + + except Exception as exc: + result = { + "strategies": [], + "resolved_entities": [], + "paths": [], + "facts": [], + "documents": [], + } + + error = ( + f"{type(exc).__name__}: " + f"{exc}" + ) + + latency = ( + time.perf_counter() + - started + ) + + row = evaluate_result( + question, + result, + latency_seconds=( + latency + ), + error=error, + ) + + rows.append( + row + ) + + state = ( + "OK" + if row["strict"] + else "FAIL" + ) + + print( + f" {state} | " + f"value={row['value_score']:.2f} " + f"entity={row['entity_score']:.2f} " + f"rel={row['relation_score']:.2f} " + f"doc={row['document_recall']:.2f} " + f"{row['latency_seconds']:.4f}s" + ) + + if graph_fingerprint(session) != metadata['graph']: + raise RuntimeError('Graph changed during evaluation; results discarded.') + + if run_metadata(args.questions)['fingerprints'] != metadata['fingerprints']: + raise RuntimeError('Code or input data changed during evaluation; results discarded.') + metadata['completed_at_utc'] = datetime.now(timezone.utc).isoformat() + if args.freeze_manifest: + metadata['freeze_sha256'] = sha256_file(args.freeze_manifest) + if args.audit: + metadata['audit_sha256'] = sha256_file(args.audit) + + summary = aggregate_rows( + rows + ) + + by_category = aggregate_by_field( + rows, + "category", + ) + + by_difficulty = ( + aggregate_by_field( + rows, + "difficulty", + ) + ) + + payload = { + 'evaluation_schema_version': 3, + 'run_metadata': metadata, + "configuration": { + "questions_file": str( + args.questions + ), + "split": args.split, + "dataset_question_count": len( + all_questions + ), + "selected_question_count": len( + questions + ), + "limit": args.limit, + "max_entities": ( + args.max_entities + ), + "ids": sorted( + ids + ), + "max_questions": ( + args.max_questions + ), + }, + "summary": summary, + "by_category": by_category, + "by_difficulty": ( + by_difficulty + ), + "questions": rows, + } + if audit: + consistent_ids = {row['id'] for row in audit['questions'] if row['source_consistent']} + consistent = [row for row in rows if row['id'] in consistent_ids] + payload['source_consistent_summary'] = aggregate_rows(consistent) + payload['source_consistent_by_category'] = aggregate_by_field(consistent, 'category') + payload['source_inconsistent_ids'] = [row['id'] for row in rows if row['id'] not in consistent_ids] + + suffix = args.split + + if ids: + suffix += "_selected" + + elif args.max_questions: + suffix += ( + f"_first" + f"{args.max_questions}" + ) + + json_path = ( + args.output_dir + / f"graphrag_{suffix}.json" + ) + + csv_path = ( + args.output_dir + / f"graphrag_{suffix}.csv" + ) + + save_json( + json_path, + payload, + ) + + save_csv( + csv_path, + rows, + ) + + print_summary( + summary, + split=args.split, + ) + if audit: + print_summary(payload['source_consistent_summary'], + split=f'{args.split} — source-consistent subset (supplementary)') + print(f"Source-inconsistent annotations: {len(payload['source_inconsistent_ids'])}; " + 'included in the primary score above.') + + print() + print( + f"JSON: {json_path}" + ) + + print( + f"CSV: {csv_path}" + ) + + +if __name__ == "__main__": + main() diff --git a/tools/graphrag/evaluation/freeze_graphrag.py b/tools/graphrag/evaluation/freeze_graphrag.py new file mode 100644 index 0000000..2e9155a --- /dev/null +++ b/tools/graphrag/evaluation/freeze_graphrag.py @@ -0,0 +1,49 @@ +"""Freeze the exact code, data, graph and parameters after complete DEV evaluation.""" +from __future__ import annotations + +import argparse +import json +from datetime import datetime, timezone +from pathlib import Path + +from .reproducibility import content_fingerprints, sha256_file + + +def make_freeze(dev: dict, questions: list[dict], fingerprints: dict, audit: dict) -> dict: + expected_ids = {q['id'] for q in questions if q['split'] == 'dev'} + actual_ids = [row['id'] for row in dev['questions']] + if dev['configuration']['split'] != 'dev' or set(actual_ids) != expected_ids or len(actual_ids) != len(expected_ids): + raise RuntimeError('Freeze requires the complete DEV split, without duplicates.') + if dev['summary']['error_count'] or any(row.get('error') for row in dev['questions']): + raise RuntimeError('Freeze requires DEV without runtime errors.') + if dev['run_metadata']['fingerprints'] != fingerprints: + raise RuntimeError('Code or data changed after DEV; rerun DEV before freezing.') + if audit['dataset_sha256'] != fingerprints['dataset_sha256'] or audit['inputs'] != fingerprints['inputs']: + raise RuntimeError('Source audit does not match the benchmark and inputs.') + if len(audit['questions']) != len(questions) or {r['id'] for r in audit['questions']} != {q['id'] for q in questions}: + raise RuntimeError('Source audit must cover every question exactly once.') + return {'schema_version': 1, 'frozen_at_utc': datetime.now(timezone.utc).isoformat(), + 'fingerprints': fingerprints, 'graph': dev['run_metadata']['graph'], + 'parameters': {key: dev['configuration'][key] for key in ['limit', 'max_entities']}, + 'dev_summary': dev['summary'], 'source_audit_summary': audit['by_split'], + 'policy': 'Report all questions. Source-consistent subset is supplementary. No holdout tuning.'} + + +def main() -> None: + parser = argparse.ArgumentParser(description=__doc__) + parser.add_argument('--dev-results', type=Path, required=True) + parser.add_argument('--questions', type=Path, default=Path(__file__).parent / 'graphrag_questions.json') + parser.add_argument('--audit', type=Path, required=True) + parser.add_argument('--output', type=Path, required=True) + args = parser.parse_args() + manifest = make_freeze(json.loads(args.dev_results.read_text()), json.loads(args.questions.read_text()), + content_fingerprints(args.questions), json.loads(args.audit.read_text())) + manifest.update({'dev_results_sha256': sha256_file(args.dev_results), + 'audit_sha256': sha256_file(args.audit)}) + args.output.parent.mkdir(parents=True, exist_ok=True) + args.output.write_text(json.dumps(manifest, ensure_ascii=False, indent=2) + '\n') + print(f'Frozen GraphRAG: {args.output}') + + +if __name__ == '__main__': + main() diff --git a/tools/graphrag/evaluation/frozen_v1.json b/tools/graphrag/evaluation/frozen_v1.json new file mode 100644 index 0000000..bc21910 --- /dev/null +++ b/tools/graphrag/evaluation/frozen_v1.json @@ -0,0 +1,82 @@ +{ + "schema_version": 1, + "frozen_at_utc": "2026-10-24T19:03:18.603604+00:00", + "fingerprints": { + "implementation": { + "tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5", + "tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80", + "tools/graphrag/evaluation/evaluate_graphrag.py": "6bdf68307b6bb90731fe09a89955e96eee76fec13bdf82281a96715dd168680e", + "tools/graphrag/evaluation/freeze_graphrag.py": "32198eca7642f39a8ad33deefe0eea396d38fcc0f5bc5814cbb64ab6d3443b9e", + "tools/graphrag/evaluation/graphrag_evaluator.py": "267d4e9942b7767a78a3689e8f7c9d6ed49f025389b043b69449b2d225651160", + "tools/graphrag/evaluation/reproducibility.py": "5c28d8aa37ec6a973fa494f7e528c19af2f1326422ea7fd05912e01aa1af6725", + "tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2", + "tools/graphrag/graph_search.py": "20f466e8d9eef6a38e41860e9be9ebc719c93f38bcfa6f60aca0e1b56c7d6bca", + "tools/graphrag/graphrag.py": "bee2eb1f86d8df8e978495a61107edf723df2dc2e0468e3ecf844719ec635e1d", + "tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb", + "tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748", + "tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b", + "tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48", + "tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e", + "tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298", + "tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f", + "tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c", + "requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a" + }, + "dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e", + "inputs": { + "data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52", + "data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9" + } + }, + "graph": { + "sha256": "0637d9ebb106c65d9aaa73d0634b28db81135e6a6c7503ea6b06c4a922e7e1e3", + "nodes": 422, + "relationships": 829 + }, + "parameters": { + "limit": 40, + "max_entities": 8 + }, + "dev_summary": { + "questions": 286, + "strict_count": 209, + "strict_accuracy": 0.730769, + "error_count": 0, + "value_score": 0.751748, + "entity_score": 0.751748, + "relation_score": 0.751748, + "property_score": 0.835664, + "relation_choice_score": 0.968531, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032786, + "latency_median_seconds": 0.03221, + "latency_p95_seconds": 0.041831 + }, + "source_audit_summary": { + "dev": { + "questions": 286, + "source_consistent": 209, + "issues": { + "keyword_not_in_frontmatter_catalog": 66, + "keyword_not_linked_to_expected_person": 5, + "exact_categories_omit_or_add_source_categories": 6 + } + }, + "test": { + "questions": 214, + "source_consistent": 154, + "issues": { + "keyword_not_in_frontmatter_catalog": 46, + "keyword_not_linked_to_expected_person": 11, + "exact_categories_omit_or_add_source_categories": 3 + } + } + }, + "policy": "Report all questions. Source-consistent subset is supplementary. No holdout tuning.", + "dev_results_sha256": "768d6795cf49b59a59a405276950afd4c48b22357cb682b9820f747d2a9e2be9", + "audit_sha256": "4fbc8ea8090caaf275cac384e3c3c8ed7c3743b49523086bee3f0970e11d9276" +} diff --git a/tools/graphrag/evaluation/graphrag_evaluator.py b/tools/graphrag/evaluation/graphrag_evaluator.py new file mode 100644 index 0000000..145b568 --- /dev/null +++ b/tools/graphrag/evaluation/graphrag_evaluator.py @@ -0,0 +1,1399 @@ +from __future__ import annotations + +import json +import math +import re +import statistics +import unicodedata +from collections import defaultdict +from pathlib import Path +from typing import Any + + +VALID_SPLITS = ( + "dev", + "test", +) + +FACT_RELATIONS = { + "person_thesis": { + "AUTHORED", + "EVIDENCED_BY", + }, + "person_work": { + "HAS_WORK", + "EVIDENCED_BY", + }, + "person_keyword": { + "HAS_DOCUMENT", + "HAS_KEYWORD", + }, + "shared_keyword": { + "HAS_DOCUMENT", + "HAS_KEYWORD", + }, + "person_category": { + "HAS_DOCUMENT", + "IN_CATEGORY", + }, + "shared_category": { + "HAS_DOCUMENT", + "IN_CATEGORY", + }, + "person_document_author": { + "HAS_DOCUMENT", + "AUTHORED_DOCUMENT", + }, + "shared_document_author": { + "HAS_DOCUMENT", + "AUTHORED_DOCUMENT", + }, +} + + +def normalize_text( + value: Any, +) -> str: + decomposed = unicodedata.normalize( + "NFKD", + str(value or ""), + ) + + without_marks = "".join( + character + for character in decomposed + if not unicodedata.combining( + character + ) + ) + + normalized = re.sub( + r"[^a-zA-Z0-9]+", + " ", + without_marks.casefold(), + ) + + return re.sub( + r"\s+", + " ", + normalized, + ).strip() + + +def load_questions( + path: Path, +) -> list[dict[str, Any]]: + if not path.exists(): + raise FileNotFoundError( + f"Benchmark neexistuje: {path}" + ) + + data = json.loads( + path.read_text( + encoding="utf-8" + ) + ) + + if not isinstance( + data, + list, + ): + raise ValueError( + "GraphRAG benchmark musí byť JSON pole." + ) + + questions: list[ + dict[str, Any] + ] = [] + + seen_ids: set[str] = set() + + for index, item in enumerate( + data, + start=1, + ): + if not isinstance( + item, + dict, + ): + raise ValueError( + f"Položka {index} nie je JSON objekt." + ) + + question_id = item.get( + "id" + ) + + question = item.get( + "question" + ) + + split = item.get( + "split" + ) + + graph = item.get( + "graph" + ) + + if ( + not isinstance( + question_id, + str, + ) + or not question_id.strip() + ): + raise ValueError( + f"Položka {index} nemá platné id." + ) + + if question_id in seen_ids: + raise ValueError( + f"Duplicitné id: {question_id}" + ) + + seen_ids.add( + question_id + ) + + if ( + not isinstance( + question, + str, + ) + or not question.strip() + ): + raise ValueError( + f"{question_id}: chýba question." + ) + + if split not in VALID_SPLITS: + raise ValueError( + f"{question_id}: neplatný split " + f"{split!r}." + ) + + if not isinstance( + graph, + dict, + ): + raise ValueError( + f"{question_id}: chýba graph." + ) + + if graph.get( + "schema_version" + ) != 2: + raise ValueError( + f"{question_id}: benchmark nie je " + "schema_version=2." + ) + + questions.append( + item + ) + + return questions + + +def filter_questions( + questions: list[ + dict[str, Any] + ], + *, + split: str, + ids: set[str] | None = None, + max_questions: int | None = None, +) -> list[dict[str, Any]]: + selected = [ + item + for item in questions + if ( + split == "all" + or item.get("split") + == split + ) + ] + + if ids: + selected = [ + item + for item in selected + if str( + item.get("id") + ) + in ids + ] + + if max_questions is not None: + selected = selected[ + :max_questions + ] + + return selected + + +def evidence_payload( + result: dict[str, Any], +) -> dict[str, Any]: + return { + "paths": result.get( + "paths", + [], + ), + "facts": result.get( + "facts", + [], + ), + "aggregation": result.get("aggregation"), + } + + +def evidence_text( + result: dict[str, Any], +) -> str: + payload = evidence_payload( + result + ) + + rendered = json.dumps( + payload, + ensure_ascii=False, + sort_keys=True, + default=str, + ) + + return normalize_text( + rendered + ) + + +def value_is_present( + value: Any, + result: dict[str, Any], +) -> bool: + expected = normalize_text( + value + ) + + if not expected: + return False + + actual = evidence_text( + result + ) + + return f" {expected} " in f" {actual} " + + +def ratio( + matched: int, + expected: int, +) -> float: + if expected <= 0: + return 1.0 + + return matched / expected + + +def entity_value_is_present(entity_type: str, value: str, result: dict[str, Any]) -> bool: + """Score typed answer evidence, never aliases copied from the question.""" + rows = list(result.get("facts", [])) + rows.extend(node for path in result.get("paths", []) for node in path.get("nodes", [])) + fields = { + "person": ("person", "left_person", "right_person", "people"), + "keyword": ("keyword",), + "category": ("category",), + "document_author": ("document_author",), + "year": ("year", "start_year", "shared_start_year", "shared_years"), + "start_year": ("start_year", "shared_start_year"), + "thesis_title": ("title",), + "work_title": ("title",), + }.get(entity_type, ()) + node_kinds = {"person": "Person", "keyword": "Keyword", "category": "Category", + "document_author": "DocumentAuthor"} + expected = normalize_text(value) + for row in rows: + if entity_type == "thesis_title" and not (row.get("kind") == "Thesis" or row.get("thesis_type")): + continue + if entity_type == "work_title" and not (row.get("kind") == "Work" or row.get("work_type")): + continue + candidates = [row.get(field) for field in fields] + if row.get("kind") == node_kinds.get(entity_type) and row.get("kind") is not None: + candidates.append(row.get("name")) + for candidate in candidates: + values = candidate if isinstance(candidate, list) else [candidate] + if any(normalize_text(item) == expected for item in values if item is not None): + return True + return False + + +def expected_entity_values( + question: dict[str, Any], +) -> list[ + tuple[str, str] +]: + graph = question.get( + "graph", + {} + ) + + result: list[ + tuple[str, str] + ] = [] + + for entity in graph.get( + "expected_entities", + [], + ): + if not isinstance( + entity, + dict, + ): + continue + + entity_type = str( + entity.get( + "type" + ) + or "" + ) + + value = entity.get( + "value" + ) + + if ( + entity_type + and value is not None + ): + result.append( + ( + entity_type, + str(value), + ) + ) + + return result + + +def collect_actual_relationships( + result: dict[str, Any], +) -> set[str]: + relationships: set[str] = set() + + for path in result.get( + "paths", + [], + ): + if not isinstance( + path, + dict, + ): + continue + + for relationship in path.get( + "relationships", + [], + ): + if relationship: + relationships.add( + str(relationship) + ) + + for fact in result.get( + "facts", + [], + ): + if not isinstance( + fact, + dict, + ): + continue + + fact_type = str( + fact.get( + "fact_type" + ) + or "" + ) + + relationships.update( + FACT_RELATIONS.get( + fact_type, + set(), + ) + ) + + return relationships + + +def property_present( + property_name: str, + result: dict[str, Any], +) -> bool: + if "|" in property_name: + return any( + property_present( + part, + result, + ) + for part in property_name.split( + "|" + ) + ) + + property_name = property_name.strip() + + facts = result.get( + "facts", + [], + ) + + path_nodes = [] + + for path in result.get( + "paths", + [], + ): + if isinstance( + path, + dict, + ): + path_nodes.extend( + path.get( + "nodes", + [], + ) + ) + + rows = [ + row + for row in ( + list(facts) + + list(path_nodes) + ) + if isinstance( + row, + dict, + ) + ] + + if property_name == "Person.start_year": + return any( + row.get( + "start_year" + ) + is not None + for row in rows + ) + + if property_name == "Thesis.title": + return any( + ( + row.get("kind") + == "Thesis" + or row.get("thesis_type") + is not None + or row.get("fact_type") + == "person_thesis" + ) + and bool( + row.get( + "title" + ) + ) + for row in rows + ) + + if property_name == "Thesis.year": + return any( + ( + row.get("kind") + == "Thesis" + or row.get("thesis_type") + is not None + or row.get("fact_type") + == "person_thesis" + ) + and row.get( + "year" + ) + is not None + for row in rows + ) + + if property_name == "Work.title": + return any( + ( + row.get("kind") + == "Work" + or row.get("work_type") + is not None + or row.get("fact_type") + == "person_work" + ) + and bool( + row.get( + "title" + ) + ) + for row in rows + ) + + if property_name == "Work.year": + return any( + ( + row.get("kind") + == "Work" + or row.get("work_type") + is not None + or row.get("fact_type") + == "person_work" + ) + and row.get( + "year" + ) + is not None + for row in rows + ) + + return False + + +def collect_document_paths( + result: dict[str, Any], +) -> set[str]: + paths: set[str] = set() + + for document in result.get( + "documents", + [], + ): + if not isinstance( + document, + dict, + ): + continue + + path = document.get( + "document_path" + ) + + if path: + paths.add( + str(path) + ) + + return paths + + +def collect_source_urls( + result: dict[str, Any], +) -> set[str]: + urls: set[str] = set() + + def add( + value: Any, + ) -> None: + if value: + urls.add( + str(value) + ) + + for document in result.get( + "documents", + [], + ): + if isinstance( + document, + dict, + ): + add( + document.get( + "source_url" + ) + ) + + for fact in result.get( + "facts", + [], + ): + if not isinstance( + fact, + dict, + ): + continue + + for key, value in fact.items(): + if key.endswith( + "source_url" + ): + add( + value + ) + + for path in result.get( + "paths", + [], + ): + if not isinstance( + path, + dict, + ): + continue + + for node in path.get( + "nodes", + [], + ): + if isinstance( + node, + dict, + ): + add( + node.get( + "source_url" + ) + ) + + return urls + + +def normalized_set( + values: list[Any] | set[Any], +) -> set[str]: + return { + normalize_text( + value + ) + for value in values + if normalize_text( + value + ) + } + + +def actual_entity_set( + question: dict[str, Any], + result: dict[str, Any], +) -> set[str]: + category = str( + question.get( + "category" + ) + or "" + ) + + values: set[str] = set() + + if category == "person_multiple_categories": + for fact in result.get( + "facts", + [], + ): + if ( + isinstance( + fact, + dict, + ) + and fact.get( + "fact_type" + ) + == "person_category" + and fact.get( + "category" + ) + ): + values.add( + str( + fact[ + "category" + ] + ) + ) + + return values + + if category == "candidate_set_aggregation": + for fact in result.get( + "facts", + [], + ): + if not isinstance( + fact, + dict, + ): + continue + + if fact.get( + "fact_type" + ) in { + "person_thesis", + "person_work", + "person_academic_year", + }: + person = fact.get( + "person" + ) + + if person: + values.add( + str(person) + ) + + return values + + return values + + +def entity_set_metrics( + question: dict[str, Any], + result: dict[str, Any], +) -> dict[str, Any]: + graph = question.get( + "graph", + {} + ) + + expected = graph.get( + "expected_entity_set" + ) + + if not isinstance( + expected, + list, + ): + return { + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": None, + "entity_set_ok": True, + } + + actual = actual_entity_set( + question, + result, + ) + + expected_normalized = ( + normalized_set( + expected + ) + ) + + actual_normalized = ( + normalized_set( + actual + ) + ) + + mode = str( + graph.get( + "entity_set_mode" + ) + or "contains" + ) + + if mode == "exact": + ok = ( + actual_normalized + == expected_normalized + ) + else: + ok = ( + expected_normalized + <= actual_normalized + ) + + return { + "entity_set_expected": ( + sorted( + expected_normalized + ) + ), + "entity_set_actual": ( + sorted( + actual_normalized + ) + ), + "entity_set_mode": mode, + "entity_set_ok": ok, + } + + +def evaluate_result( + question: dict[str, Any], + result: dict[str, Any], + *, + latency_seconds: float, + error: str | None = None, +) -> dict[str, Any]: + graph = question.get( + "graph", + {} + ) + + expected_values = [ + str(value) + for value in question.get( + "expected_answer_contains", + [], + ) + ] + + matched_values = [ + value + for value in expected_values + if value_is_present( + value, + result, + ) + ] + + entities = expected_entity_values( + question + ) + + matched_entities = [ + { + "type": entity_type, + "value": value, + } + for entity_type, value + in entities + if entity_value_is_present( + entity_type, + value, + result, + ) + ] + + expected_relations = [ + str(value) + for value in graph.get( + "expected_relations", + [], + ) + ] + + actual_relations = ( + collect_actual_relationships( + result + ) + ) + + matched_relations = [ + relationship + for relationship + in expected_relations + if relationship + in actual_relations + ] + + expected_properties = [ + str(value) + for value in graph.get( + "expected_properties", + [], + ) + ] + + matched_properties = [ + value + for value + in expected_properties + if property_present( + value, + result, + ) + ] + + relation_choices = graph.get( + "expected_relation_choices", + [], + ) + + relation_choice_results = [] + + if isinstance( + relation_choices, + list, + ): + for choice in relation_choices: + values = ( + choice + if isinstance( + choice, + list, + ) + else [choice] + ) + + clean = [ + str(value) + for value in values + if value + ] + + relation_choice_results.append( + { + "choices": clean, + "matched": any( + value + in actual_relations + for value in clean + ), + } + ) + + expected_documents = { + str(value) + for value in question.get( + "expected_documents", + [], + ) + } + + actual_documents = ( + collect_document_paths( + result + ) + ) + + matched_documents = ( + expected_documents + & actual_documents + ) + + expected_sources = { + str(value) + for value in question.get( + "expected_source_urls", + [], + ) + } + + actual_sources = ( + collect_source_urls( + result + ) + ) + + matched_sources = ( + expected_sources + & actual_sources + ) + + set_metrics = entity_set_metrics( + question, + result, + ) + + value_score = ratio( + len(matched_values), + len(expected_values), + ) + + entity_score = ratio( + len(matched_entities), + len(entities), + ) + + relation_score = ratio( + len(matched_relations), + len(expected_relations), + ) + + property_score = ratio( + len(matched_properties), + len(expected_properties), + ) + + relation_choice_score = ratio( + sum( + 1 + for item + in relation_choice_results + if item["matched"] + ), + len( + relation_choice_results + ), + ) + + document_recall = ratio( + len(matched_documents), + len(expected_documents), + ) + + source_recall = ratio( + len(matched_sources), + len(expected_sources), + ) + + expected_count = graph.get("expected_count") + aggregation = result.get("aggregation") or {} + count_ok = expected_count is None or ( + aggregation.get("complete") is True + and aggregation.get("count") == expected_count + ) + complete = not result.get("truncated", False) + strict = all( + ( + error is None, + complete, + count_ok, + value_score == 1.0, + entity_score == 1.0, + relation_score == 1.0, + property_score == 1.0, + relation_choice_score + == 1.0, + document_recall == 1.0, + source_recall == 1.0, + bool( + set_metrics[ + "entity_set_ok" + ] + ), + ) + ) + + return { + "count_ok": count_ok, + "expected_count": expected_count, + "actual_count": aggregation.get("count"), + "complete": complete, + "id": question.get( + "id" + ), + "split": question.get( + "split" + ), + "category": question.get( + "category" + ), + "difficulty": question.get( + "difficulty" + ), + "question": question.get( + "question" + ), + "latency_seconds": round( + latency_seconds, + 6, + ), + "error": error, + "strict": strict, + "value_score": round( + value_score, + 6, + ), + "entity_score": round( + entity_score, + 6, + ), + "relation_score": round( + relation_score, + 6, + ), + "property_score": round( + property_score, + 6, + ), + "relation_choice_score": round( + relation_choice_score, + 6, + ), + "document_recall": round( + document_recall, + 6, + ), + "source_recall": round( + source_recall, + 6, + ), + "expected_values": ( + expected_values + ), + "matched_values": ( + matched_values + ), + "expected_entities": [ + { + "type": entity_type, + "value": value, + } + for entity_type, value + in entities + ], + "matched_entities": ( + matched_entities + ), + "expected_relations": ( + expected_relations + ), + "actual_relations": sorted( + actual_relations + ), + "matched_relations": ( + matched_relations + ), + "expected_properties": ( + expected_properties + ), + "matched_properties": ( + matched_properties + ), + "relation_choices": ( + relation_choice_results + ), + "expected_documents": sorted( + expected_documents + ), + "actual_documents": sorted( + actual_documents + ), + "matched_documents": sorted( + matched_documents + ), + "expected_source_urls": sorted( + expected_sources + ), + "actual_source_urls": sorted( + actual_sources + ), + "matched_source_urls": sorted( + matched_sources + ), + **set_metrics, + "strategies": list( + result.get( + "strategies", + [], + ) + ), + "fact_types": sorted( + { + str( + fact.get( + "fact_type" + ) + ) + for fact in result.get( + "facts", + [], + ) + if ( + isinstance( + fact, + dict, + ) + and fact.get( + "fact_type" + ) + ) + } + ), + } + + +def percentile( + values: list[float], + fraction: float, +) -> float: + if not values: + return 0.0 + + ordered = sorted( + values + ) + + if len(ordered) == 1: + return ordered[0] + + position = ( + (len(ordered) - 1) + * fraction + ) + + lower = math.floor( + position + ) + + upper = math.ceil( + position + ) + + if lower == upper: + return ordered[ + lower + ] + + weight = ( + position - lower + ) + + return ( + ordered[lower] + * (1.0 - weight) + + ordered[upper] + * weight + ) + + +def aggregate_rows( + rows: list[ + dict[str, Any] + ], +) -> dict[str, Any]: + if not rows: + return { + "questions": 0, + "strict_count": 0, + "strict_accuracy": 0.0, + "error_count": 0, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 0.0, + "source_recall": 0.0, + "latency_mean_seconds": 0.0, + "latency_median_seconds": 0.0, + "latency_p95_seconds": 0.0, + } + + latencies = [ + float( + row[ + "latency_seconds" + ] + ) + for row in rows + ] + + def mean( + key: str, + ) -> float: + return round( + statistics.fmean( + float( + row[key] + ) + for row in rows + ), + 6, + ) + + strict_count = sum( + bool( + row["strict"] + ) + for row in rows + ) + + return { + "questions": len( + rows + ), + "strict_count": ( + strict_count + ), + "strict_accuracy": round( + strict_count + / len(rows), + 6, + ), + "error_count": sum( + bool( + row.get( + "error" + ) + ) + for row in rows + ), + "value_score": mean( + "value_score" + ), + "entity_score": mean( + "entity_score" + ), + "relation_score": mean( + "relation_score" + ), + "property_score": mean( + "property_score" + ), + "relation_choice_score": ( + mean( + "relation_choice_score" + ) + ), + "document_recall": mean( + "document_recall" + ), + "source_recall": mean( + "source_recall" + ), + "latency_mean_seconds": round( + statistics.fmean( + latencies + ), + 6, + ), + "latency_median_seconds": round( + statistics.median( + latencies + ), + 6, + ), + "latency_p95_seconds": round( + percentile( + latencies, + 0.95, + ), + 6, + ), + } + + +def aggregate_by_field( + rows: list[ + dict[str, Any] + ], + field: str, +) -> dict[ + str, + dict[str, Any], +]: + grouped: dict[ + str, + list[dict[str, Any]], + ] = defaultdict(list) + + for row in rows: + key = str( + row.get( + field + ) + or "" + ) + + grouped[ + key + ].append( + row + ) + + return { + key: aggregate_rows( + group_rows + ) + for key, group_rows + in sorted( + grouped.items() + ) + } diff --git a/tools/graphrag/evaluation/graphrag_questions.json b/tools/graphrag/evaluation/graphrag_questions.json index d5e10d3..641634c 100644 --- a/tools/graphrag/evaluation/graphrag_questions.json +++ b/tools/graphrag/evaluation/graphrag_questions.json @@ -2,9 +2,9 @@ { "id": "g0001", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Maroš Harahus a Jakub Maruniak v ZP Wiki prepojené cez tému Spacy? Uveď spoločnú tému.", + "question": "Sú osoby Maroš Harahus a Jakub Maruniak v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/maros_harahus/README.md", "pages/students/2016/jakub_maruniak/README.md" @@ -35,17 +35,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Jakub Maruniak" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Jakub Maruniak" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -55,9 +59,9 @@ { "id": "g0002", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Maroš Harahus a Jakub Maruniak cez tému Spacy a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Maroš Harahus a Jakub Maruniak cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/maros_harahus/README.md", "pages/students/2016/jakub_maruniak/README.md" @@ -88,17 +92,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Jakub Maruniak" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Jakub Maruniak" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -108,9 +116,9 @@ { "id": "g0003", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Maroš Harahus a Kristián Sopkovič v ZP Wiki prepojené cez tému Spacy? Uveď spoločnú tému.", + "question": "Sú osoby Maroš Harahus a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/maros_harahus/README.md", "pages/students/2019/kristian_sopkovic/README.md" @@ -141,17 +149,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Kristián Sopkovič" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -161,9 +173,9 @@ { "id": "g0004", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Maroš Harahus a Kristián Sopkovič cez tému Spacy a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Maroš Harahus a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/maros_harahus/README.md", "pages/students/2019/kristian_sopkovic/README.md" @@ -194,17 +206,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Kristián Sopkovič" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -214,9 +230,9 @@ { "id": "g0005", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Maroš Harahus a Artem Yatsenko v ZP Wiki prepojené cez tému Spacy? Uveď spoločnú tému.", + "question": "Sú osoby Maroš Harahus a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/maros_harahus/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -247,17 +263,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -267,9 +287,9 @@ { "id": "g0006", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Maroš Harahus a Artem Yatsenko cez tému Spacy a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Maroš Harahus a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/maros_harahus/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -300,17 +320,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -320,9 +344,9 @@ { "id": "g0007", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Jakub Maruniak a Kristián Sopkovič v ZP Wiki prepojené cez tému Spacy? Uveď spoločnú tému.", + "question": "Sú osoby Jakub Maruniak a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md", "pages/students/2019/kristian_sopkovic/README.md" @@ -353,17 +377,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Jakub Maruniak -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Kristián Sopkovič" - ] + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -373,9 +401,9 @@ { "id": "g0008", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Jakub Maruniak a Kristián Sopkovič cez tému Spacy a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Jakub Maruniak a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md", "pages/students/2019/kristian_sopkovic/README.md" @@ -406,17 +434,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Jakub Maruniak -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Kristián Sopkovič" - ] + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -426,9 +458,9 @@ { "id": "g0009", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez tému Spacy? Uveď spoločnú tému.", + "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -459,17 +491,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Jakub Maruniak -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -479,9 +515,9 @@ { "id": "g0010", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez tému Spacy a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -512,17 +548,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Jakub Maruniak -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -532,9 +572,9 @@ { "id": "g0011", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Kristián Sopkovič a Artem Yatsenko v ZP Wiki prepojené cez tému Spacy? Uveď spoločnú tému.", + "question": "Sú osoby Kristián Sopkovič a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -565,17 +605,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Kristián Sopkovič -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -585,9 +629,9 @@ { "id": "g0012", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Kristián Sopkovič a Artem Yatsenko cez tému Spacy a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Kristián Sopkovič a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -618,17 +662,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Kristián Sopkovič -> MENTIONS_TOPIC -> Spacy <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -638,9 +686,9 @@ { "id": "g0013", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Tomáš Kuchárik a Dávid Omasta v ZP Wiki prepojené cez tému Question Answering? Uveď spoločnú tému.", + "question": "Sú osoby Tomáš Kuchárik a Dávid Omasta v ZP Wiki prepojené cez kľúčové slovo Question Answering? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md", "pages/students/2018/david_omasta/README.md" @@ -671,17 +719,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Question Answering" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tomáš Kuchárik -> MENTIONS_TOPIC -> Question Answering <- MENTIONS_TOPIC <- Dávid Omasta" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Question Answering <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Dávid Omasta" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -691,9 +743,9 @@ { "id": "g0014", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Tomáš Kuchárik a Dávid Omasta cez tému Question Answering a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Tomáš Kuchárik a Dávid Omasta cez kľúčové slovo Question Answering a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md", "pages/students/2018/david_omasta/README.md" @@ -724,17 +776,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Question Answering" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tomáš Kuchárik -> MENTIONS_TOPIC -> Question Answering <- MENTIONS_TOPIC <- Dávid Omasta" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Question Answering <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Dávid Omasta" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -744,9 +800,9 @@ { "id": "g0015", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Tomáš Kuchárik a Dominik Nagy v ZP Wiki prepojené cez tému strojový preklad? Uveď spoločnú tému.", + "question": "Sú osoby Tomáš Kuchárik a Dominik Nagy v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md", "pages/students/2016/dominik_nagy/README.md" @@ -777,17 +833,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tomáš Kuchárik -> MENTIONS_TOPIC -> strojový preklad <- MENTIONS_TOPIC <- Dominik Nagy" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Dominik Nagy" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -797,9 +857,9 @@ { "id": "g0016", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Tomáš Kuchárik a Dominik Nagy cez tému strojový preklad a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Tomáš Kuchárik a Dominik Nagy cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md", "pages/students/2016/dominik_nagy/README.md" @@ -830,17 +890,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tomáš Kuchárik -> MENTIONS_TOPIC -> strojový preklad <- MENTIONS_TOPIC <- Dominik Nagy" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Dominik Nagy" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -850,9 +914,9 @@ { "id": "g0017", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Tomáš Kuchárik a Patrik Pavlišin v ZP Wiki prepojené cez tému strojový preklad? Uveď spoločnú tému.", + "question": "Sú osoby Tomáš Kuchárik a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md", "pages/students/2016/patrik_pavlisin/README.md" @@ -883,17 +947,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tomáš Kuchárik -> MENTIONS_TOPIC -> strojový preklad <- MENTIONS_TOPIC <- Patrik Pavlišin" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Patrik Pavlišin" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -903,9 +971,9 @@ { "id": "g0018", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Tomáš Kuchárik a Patrik Pavlišin cez tému strojový preklad a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Tomáš Kuchárik a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md", "pages/students/2016/patrik_pavlisin/README.md" @@ -936,17 +1004,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tomáš Kuchárik -> MENTIONS_TOPIC -> strojový preklad <- MENTIONS_TOPIC <- Patrik Pavlišin" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Patrik Pavlišin" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -956,9 +1028,9 @@ { "id": "g0019", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Dominik Nagy a Patrik Pavlišin v ZP Wiki prepojené cez tému strojový preklad? Uveď spoločnú tému.", + "question": "Sú osoby Dominik Nagy a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/dominik_nagy/README.md", "pages/students/2016/patrik_pavlisin/README.md" @@ -989,17 +1061,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Dominik Nagy -> MENTIONS_TOPIC -> strojový preklad <- MENTIONS_TOPIC <- Patrik Pavlišin" - ] + "Dominik Nagy -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Patrik Pavlišin" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1009,9 +1085,9 @@ { "id": "g0020", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Dominik Nagy a Patrik Pavlišin cez tému strojový preklad a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Dominik Nagy a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/dominik_nagy/README.md", "pages/students/2016/patrik_pavlisin/README.md" @@ -1042,17 +1118,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Dominik Nagy -> MENTIONS_TOPIC -> strojový preklad <- MENTIONS_TOPIC <- Patrik Pavlišin" - ] + "Dominik Nagy -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Patrik Pavlišin" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1062,9 +1142,9 @@ { "id": "g0021", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez tému pomenované entity? Uveď spoločnú tému.", + "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo pomenované entity? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -1095,17 +1175,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "pomenované entity" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Jakub Maruniak -> MENTIONS_TOPIC -> pomenované entity <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> pomenované entity <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1115,9 +1199,9 @@ { "id": "g0022", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez tému pomenované entity a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo pomenované entity a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -1148,17 +1232,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "pomenované entity" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Jakub Maruniak -> MENTIONS_TOPIC -> pomenované entity <- MENTIONS_TOPIC <- Artem Yatsenko" - ] + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> pomenované entity <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1168,9 +1256,9 @@ { "id": "g0023", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Ondrej Megela a Matej Novotný v ZP Wiki prepojené cez tému jazykové modelovanie? Uveď spoločnú tému.", + "question": "Sú osoby Ondrej Megela a Matej Novotný v ZP Wiki prepojené cez kľúčové slovo jazykové modelovanie? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md", "pages/students/2021/matej_novotny/README.md" @@ -1201,17 +1289,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "jazykové modelovanie" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ondrej Megela -> MENTIONS_TOPIC -> jazykové modelovanie <- MENTIONS_TOPIC <- Matej Novotný" - ] + "Ondrej Megela -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> jazykové modelovanie <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Matej Novotný" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1221,9 +1313,9 @@ { "id": "g0024", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Ondrej Megela a Matej Novotný cez tému jazykové modelovanie a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Ondrej Megela a Matej Novotný cez kľúčové slovo jazykové modelovanie a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md", "pages/students/2021/matej_novotny/README.md" @@ -1254,17 +1346,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "jazykové modelovanie" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ondrej Megela -> MENTIONS_TOPIC -> jazykové modelovanie <- MENTIONS_TOPIC <- Matej Novotný" - ] + "Ondrej Megela -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> jazykové modelovanie <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Matej Novotný" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1274,9 +1370,9 @@ { "id": "g0025", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Dávid Omasta a Kristián Sopkovič v ZP Wiki prepojené cez tému slovenčina? Uveď spoločnú tému.", + "question": "Sú osoby Dávid Omasta a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo slovenčina? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2018/david_omasta/README.md", "pages/students/2019/kristian_sopkovic/README.md" @@ -1307,17 +1403,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "slovenčina" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Dávid Omasta -> MENTIONS_TOPIC -> slovenčina <- MENTIONS_TOPIC <- Kristián Sopkovič" - ] + "Dávid Omasta -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenčina <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1327,9 +1427,9 @@ { "id": "g0026", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Dávid Omasta a Kristián Sopkovič cez tému slovenčina a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Dávid Omasta a Kristián Sopkovič cez kľúčové slovo slovenčina a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2018/david_omasta/README.md", "pages/students/2019/kristian_sopkovic/README.md" @@ -1360,17 +1460,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "slovenčina" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Dávid Omasta -> MENTIONS_TOPIC -> slovenčina <- MENTIONS_TOPIC <- Kristián Sopkovič" - ] + "Dávid Omasta -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenčina <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1380,9 +1484,9 @@ { "id": "g0027", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Michal Stromko a Matej Ščišľak v ZP Wiki prepojené cez tému FAISS? Uveď spoločnú tému.", + "question": "Sú osoby Michal Stromko a Matej Ščišľak v ZP Wiki prepojené cez kľúčové slovo FAISS? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/michal_stromko/README.md", "pages/students/2021/matej_scislak/README.md" @@ -1413,17 +1517,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "FAISS" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Michal Stromko -> MENTIONS_TOPIC -> FAISS <- MENTIONS_TOPIC <- Matej Ščišľak" - ] + "Michal Stromko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> FAISS <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Matej Ščišľak" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1433,9 +1541,9 @@ { "id": "g0028", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Michal Stromko a Matej Ščišľak cez tému FAISS a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Michal Stromko a Matej Ščišľak cez kľúčové slovo FAISS a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/michal_stromko/README.md", "pages/students/2021/matej_scislak/README.md" @@ -1466,17 +1574,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "FAISS" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Michal Stromko -> MENTIONS_TOPIC -> FAISS <- MENTIONS_TOPIC <- Matej Ščišľak" - ] + "Michal Stromko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> FAISS <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Matej Ščišľak" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1486,9 +1598,9 @@ { "id": "g0029", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Alina Vitko a Ronald Zalacko v ZP Wiki prepojené cez tému Docker? Uveď spoločnú tému.", + "question": "Sú osoby Alina Vitko a Ronald Zalacko v ZP Wiki prepojené cez kľúčové slovo Docker? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/alina_vitko/README.md", "pages/students/2023/ronald_zalacko/README.md" @@ -1519,17 +1631,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Docker" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Alina Vitko -> MENTIONS_TOPIC -> Docker <- MENTIONS_TOPIC <- Ronald Zalacko" - ] + "Alina Vitko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Docker <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Ronald Zalacko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1539,9 +1655,9 @@ { "id": "g0030", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Alina Vitko a Ronald Zalacko cez tému Docker a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Alina Vitko a Ronald Zalacko cez kľúčové slovo Docker a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/alina_vitko/README.md", "pages/students/2023/ronald_zalacko/README.md" @@ -1572,17 +1688,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Docker" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Alina Vitko -> MENTIONS_TOPIC -> Docker <- MENTIONS_TOPIC <- Ronald Zalacko" - ] + "Alina Vitko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Docker <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Ronald Zalacko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1592,9 +1712,9 @@ { "id": "g0031", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Artem Yatsenko a Vladimír Ferko v ZP Wiki prepojené cez tému anotácia? Uveď spoločnú tému.", + "question": "Sú osoby Artem Yatsenko a Vladimír Ferko v ZP Wiki prepojené cez kľúčové slovo anotácia? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/artem_yatsenko/README.md", "pages/students/2021/vladimir_ferko/README.md" @@ -1625,17 +1745,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "anotácia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Artem Yatsenko -> MENTIONS_TOPIC -> anotácia <- MENTIONS_TOPIC <- Vladimír Ferko" - ] + "Artem Yatsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> anotácia <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Vladimír Ferko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1645,9 +1769,9 @@ { "id": "g0032", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Artem Yatsenko a Vladimír Ferko cez tému anotácia a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Artem Yatsenko a Vladimír Ferko cez kľúčové slovo anotácia a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2019/artem_yatsenko/README.md", "pages/students/2021/vladimir_ferko/README.md" @@ -1678,17 +1802,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "anotácia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Artem Yatsenko -> MENTIONS_TOPIC -> anotácia <- MENTIONS_TOPIC <- Vladimír Ferko" - ] + "Artem Yatsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> anotácia <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Vladimír Ferko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1698,9 +1826,9 @@ { "id": "g0033", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Martin Šarišský a Oleksandr Dorybohov v ZP Wiki prepojené cez tému agent? Uveď spoločnú tému.", + "question": "Sú osoby Martin Šarišský a Oleksandr Dorybohov v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md", "pages/students/2023/oleksandr_dorybohov/README.md" @@ -1731,17 +1859,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "agent" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Martin Šarišský -> MENTIONS_TOPIC -> agent <- MENTIONS_TOPIC <- Oleksandr Dorybohov" - ] + "Martin Šarišský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> agent <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Oleksandr Dorybohov" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1751,9 +1883,9 @@ { "id": "g0034", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Martin Šarišský a Oleksandr Dorybohov cez tému agent a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Martin Šarišský a Oleksandr Dorybohov cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md", "pages/students/2023/oleksandr_dorybohov/README.md" @@ -1784,17 +1916,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "agent" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Martin Šarišský -> MENTIONS_TOPIC -> agent <- MENTIONS_TOPIC <- Oleksandr Dorybohov" - ] + "Martin Šarišský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> agent <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Oleksandr Dorybohov" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1804,9 +1940,9 @@ { "id": "g0035", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Matej Ščišľak a Valerii Kutsenko v ZP Wiki prepojené cez tému GraphRAG? Uveď spoločnú tému.", + "question": "Sú osoby Matej Ščišľak a Valerii Kutsenko v ZP Wiki prepojené cez kľúčové slovo GraphRAG? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2021/matej_scislak/README.md", "pages/students/2022/valerii_kutsenko/README.md" @@ -1837,17 +1973,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "GraphRAG" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Matej Ščišľak -> MENTIONS_TOPIC -> GraphRAG <- MENTIONS_TOPIC <- Valerii Kutsenko" - ] + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> GraphRAG <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Valerii Kutsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1857,9 +1997,9 @@ { "id": "g0036", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Matej Ščišľak a Valerii Kutsenko cez tému GraphRAG a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Matej Ščišľak a Valerii Kutsenko cez kľúčové slovo GraphRAG a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2021/matej_scislak/README.md", "pages/students/2022/valerii_kutsenko/README.md" @@ -1890,17 +2030,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "GraphRAG" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Matej Ščišľak -> MENTIONS_TOPIC -> GraphRAG <- MENTIONS_TOPIC <- Valerii Kutsenko" - ] + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> GraphRAG <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Valerii Kutsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1910,9 +2054,9 @@ { "id": "g0037", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Vladimír Ferko a Tetiana Mohorian v ZP Wiki prepojené cez tému hate speech? Uveď spoločnú tému.", + "question": "Sú osoby Vladimír Ferko a Tetiana Mohorian v ZP Wiki prepojené cez kľúčové slovo hate speech? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2021/vladimir_ferko/README.md", "pages/students/2022/tetiana_mohorian/README.md" @@ -1943,17 +2087,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "hate speech" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Vladimír Ferko -> MENTIONS_TOPIC -> hate speech <- MENTIONS_TOPIC <- Tetiana Mohorian" - ] + "Vladimír Ferko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> hate speech <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Tetiana Mohorian" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -1963,9 +2111,9 @@ { "id": "g0038", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Vladimír Ferko a Tetiana Mohorian cez tému hate speech a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Vladimír Ferko a Tetiana Mohorian cez kľúčové slovo hate speech a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2021/vladimir_ferko/README.md", "pages/students/2022/tetiana_mohorian/README.md" @@ -1996,17 +2144,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "hate speech" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Vladimír Ferko -> MENTIONS_TOPIC -> hate speech <- MENTIONS_TOPIC <- Tetiana Mohorian" - ] + "Vladimír Ferko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> hate speech <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Tetiana Mohorian" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2016,9 +2168,9 @@ { "id": "g0039", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Andrii Pervashov a Samuel Vasiľ v ZP Wiki prepojené cez tému OpenWebUI? Uveď spoločnú tému.", + "question": "Sú osoby Andrii Pervashov a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo OpenWebUI? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/andrii_pervashov/README.md", "pages/students/2022/samuel_vasil/README.md" @@ -2049,17 +2201,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "OpenWebUI" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Andrii Pervashov -> MENTIONS_TOPIC -> OpenWebUI <- MENTIONS_TOPIC <- Samuel Vasiľ" - ] + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> OpenWebUI <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Samuel Vasiľ" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2069,9 +2225,9 @@ { "id": "g0040", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Andrii Pervashov a Samuel Vasiľ cez tému OpenWebUI a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Andrii Pervashov a Samuel Vasiľ cez kľúčové slovo OpenWebUI a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/andrii_pervashov/README.md", "pages/students/2022/samuel_vasil/README.md" @@ -2102,17 +2258,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "OpenWebUI" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Andrii Pervashov -> MENTIONS_TOPIC -> OpenWebUI <- MENTIONS_TOPIC <- Samuel Vasiľ" - ] + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> OpenWebUI <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Samuel Vasiľ" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2122,9 +2282,9 @@ { "id": "g0041", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Valerii Kutsenko a Ján Pták v ZP Wiki prepojené cez tému RAG? Uveď spoločnú tému.", + "question": "Sú osoby Valerii Kutsenko a Ján Pták v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md", "pages/students/2022/jan_ptak/README.md" @@ -2155,17 +2315,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "RAG" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Valerii Kutsenko -> MENTIONS_TOPIC -> RAG <- MENTIONS_TOPIC <- Ján Pták" - ] + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> RAG <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Ján Pták" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2175,9 +2339,9 @@ { "id": "g0042", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Valerii Kutsenko a Ján Pták cez tému RAG a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Valerii Kutsenko a Ján Pták cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md", "pages/students/2022/jan_ptak/README.md" @@ -2208,17 +2372,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "RAG" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Valerii Kutsenko -> MENTIONS_TOPIC -> RAG <- MENTIONS_TOPIC <- Ján Pták" - ] + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> RAG <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Ján Pták" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2228,9 +2396,9 @@ { "id": "g0043", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Oleh Poiasnik a Ján Malinovský v ZP Wiki prepojené cez tému znalostný graf? Uveď spoločnú tému.", + "question": "Sú osoby Oleh Poiasnik a Ján Malinovský v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md", "pages/students/2022/jan_malinovsky/README.md" @@ -2261,17 +2429,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "znalostný graf" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Oleh Poiasnik -> MENTIONS_TOPIC -> znalostný graf <- MENTIONS_TOPIC <- Ján Malinovský" - ] + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Ján Malinovský" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2281,9 +2453,9 @@ { "id": "g0044", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Oleh Poiasnik a Ján Malinovský cez tému znalostný graf a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Oleh Poiasnik a Ján Malinovský cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md", "pages/students/2022/jan_malinovsky/README.md" @@ -2314,17 +2486,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "znalostný graf" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Oleh Poiasnik -> MENTIONS_TOPIC -> znalostný graf <- MENTIONS_TOPIC <- Ján Malinovský" - ] + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Ján Malinovský" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2334,9 +2510,9 @@ { "id": "g0045", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Oleh Poiasnik a Maksym Zatirka v ZP Wiki prepojené cez tému znalostný graf? Uveď spoločnú tému.", + "question": "Sú osoby Oleh Poiasnik a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md", "pages/students/2023/maksym_zatirka/README.md" @@ -2367,17 +2543,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "znalostný graf" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Oleh Poiasnik -> MENTIONS_TOPIC -> znalostný graf <- MENTIONS_TOPIC <- Maksym Zatirka" - ] + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Maksym Zatirka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2387,9 +2567,9 @@ { "id": "g0046", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Oleh Poiasnik a Maksym Zatirka cez tému znalostný graf a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Oleh Poiasnik a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md", "pages/students/2023/maksym_zatirka/README.md" @@ -2420,17 +2600,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "znalostný graf" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Oleh Poiasnik -> MENTIONS_TOPIC -> znalostný graf <- MENTIONS_TOPIC <- Maksym Zatirka" - ] + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Maksym Zatirka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2440,9 +2624,9 @@ { "id": "g0047", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Ján Malinovský a Maksym Zatirka v ZP Wiki prepojené cez tému znalostný graf? Uveď spoločnú tému.", + "question": "Sú osoby Ján Malinovský a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/jan_malinovsky/README.md", "pages/students/2023/maksym_zatirka/README.md" @@ -2473,17 +2657,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "znalostný graf" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ján Malinovský -> MENTIONS_TOPIC -> znalostný graf <- MENTIONS_TOPIC <- Maksym Zatirka" - ] + "Ján Malinovský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Maksym Zatirka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2493,9 +2681,9 @@ { "id": "g0048", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Ján Malinovský a Maksym Zatirka cez tému znalostný graf a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Ján Malinovský a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/jan_malinovsky/README.md", "pages/students/2023/maksym_zatirka/README.md" @@ -2526,17 +2714,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "znalostný graf" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ján Malinovský -> MENTIONS_TOPIC -> znalostný graf <- MENTIONS_TOPIC <- Maksym Zatirka" - ] + "Ján Malinovský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Maksym Zatirka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2546,9 +2738,9 @@ { "id": "g0049", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Tetiana Mohorian a Rostyslav Rodzhuk v ZP Wiki prepojené cez tému LLM? Uveď spoločnú tému.", + "question": "Sú osoby Tetiana Mohorian a Rostyslav Rodzhuk v ZP Wiki prepojené cez kľúčové slovo LLM? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/tetiana_mohorian/README.md", "pages/students/2023/rostyslav_rodzhuk/README.md" @@ -2579,17 +2771,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "LLM" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tetiana Mohorian -> MENTIONS_TOPIC -> LLM <- MENTIONS_TOPIC <- Rostyslav Rodzhuk" - ] + "Tetiana Mohorian -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> LLM <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Rostyslav Rodzhuk" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2599,9 +2795,9 @@ { "id": "g0050", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Tetiana Mohorian a Rostyslav Rodzhuk cez tému LLM a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Tetiana Mohorian a Rostyslav Rodzhuk cez kľúčové slovo LLM a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/tetiana_mohorian/README.md", "pages/students/2023/rostyslav_rodzhuk/README.md" @@ -2632,17 +2828,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "LLM" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tetiana Mohorian -> MENTIONS_TOPIC -> LLM <- MENTIONS_TOPIC <- Rostyslav Rodzhuk" - ] + "Tetiana Mohorian -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> LLM <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Rostyslav Rodzhuk" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2652,9 +2852,9 @@ { "id": "g0051", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Ján Malinovský a Samuel Vasiľ v ZP Wiki prepojené cez tému RAG? Uveď spoločnú tému.", + "question": "Sú osoby Ján Malinovský a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/jan_malinovsky/README.md", "pages/students/2022/samuel_vasil/README.md" @@ -2685,17 +2885,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "RAG" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ján Malinovský -> MENTIONS_TOPIC -> RAG <- MENTIONS_TOPIC <- Samuel Vasiľ" - ] + "Ján Malinovský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> RAG <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Samuel Vasiľ" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2705,9 +2909,9 @@ { "id": "g0052", "split": "test", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Ján Malinovský a Samuel Vasiľ cez tému RAG a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Ján Malinovský a Samuel Vasiľ cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2022/jan_malinovsky/README.md", "pages/students/2022/samuel_vasil/README.md" @@ -2738,17 +2942,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "RAG" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ján Malinovský -> MENTIONS_TOPIC -> RAG <- MENTIONS_TOPIC <- Samuel Vasiľ" - ] + "Ján Malinovský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> RAG <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Samuel Vasiľ" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2758,9 +2966,9 @@ { "id": "g0053", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Sú osoby Rostyslav Rodzhuk a Samuel Džurina v ZP Wiki prepojené cez tému agent? Uveď spoločnú tému.", + "question": "Sú osoby Rostyslav Rodzhuk a Samuel Džurina v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2023/rostyslav_rodzhuk/README.md", "pages/students/2023/samuel_dzurina/README.md" @@ -2791,17 +2999,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "agent" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Rostyslav Rodzhuk -> MENTIONS_TOPIC -> agent <- MENTIONS_TOPIC <- Samuel Džurina" - ] + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> agent <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Samuel Džurina" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2811,9 +3023,9 @@ { "id": "g0054", "split": "dev", - "category": "shared_topic_pair", + "category": "shared_keyword_pair", "difficulty": "hard", - "question": "Over prepojenie osôb Rostyslav Rodzhuk a Samuel Džurina cez tému agent a pomenuj spoločný tematický uzol.", + "question": "Over prepojenie osôb Rostyslav Rodzhuk a Samuel Džurina cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.", "expected_documents": [ "pages/students/2023/rostyslav_rodzhuk/README.md", "pages/students/2023/samuel_dzurina/README.md" @@ -2844,17 +3056,21 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "agent" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "MENTIONS_TOPIC" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Rostyslav Rodzhuk -> MENTIONS_TOPIC -> agent <- MENTIONS_TOPIC <- Samuel Džurina" - ] + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> agent <- HAS_KEYWORD <- Document <- HAS_DOCUMENT <- Samuel Džurina" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000" @@ -2864,7 +3080,7 @@ { "id": "g0055", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Ronald Zalacko?", "expected_documents": [ @@ -2901,12 +3117,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -2916,7 +3145,7 @@ { "id": "g0056", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Samuel Vasiľ?", "expected_documents": [ @@ -2953,12 +3182,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -2968,7 +3210,7 @@ { "id": "g0057", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Filip Tomáš a Márk Fehér?", "expected_documents": [ @@ -3005,12 +3247,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Filip Tomáš -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Márk Fehér" + "Filip Tomáš -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Márk Fehér -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3020,7 +3275,7 @@ { "id": "g0058", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Samuel Džurina?", "expected_documents": [ @@ -3057,12 +3312,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3072,7 +3340,7 @@ { "id": "g0059", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Ronald Zalacko?", "expected_documents": [ @@ -3109,12 +3377,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3124,7 +3405,7 @@ { "id": "g0060", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Novotný?", "expected_documents": [ @@ -3161,12 +3442,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Matej Novotný" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3176,7 +3470,7 @@ { "id": "g0061", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dárius Lindvai a Lukáš Pokrývka?", "expected_documents": [ @@ -3213,12 +3507,25 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dárius Lindvai -> HAS_WORK_YEAR -> 2021 <- HAS_WORK_YEAR <- Lukáš Pokrývka" + "Dárius Lindvai -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]", + "Lukáš Pokrývka -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3228,7 +3535,7 @@ { "id": "g0062", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Samuel Vasiľ?", "expected_documents": [ @@ -3265,12 +3572,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3280,7 +3600,7 @@ { "id": "g0063", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Samuel Džurina?", "expected_documents": [ @@ -3317,12 +3637,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3332,7 +3665,7 @@ { "id": "g0064", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Samuel Džurina?", "expected_documents": [ @@ -3369,12 +3702,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3384,7 +3730,7 @@ { "id": "g0065", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Martin Šarišský?", "expected_documents": [ @@ -3421,12 +3767,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Martin Šarišský" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3436,7 +3795,7 @@ { "id": "g0066", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Samuel Džurina?", "expected_documents": [ @@ -3473,12 +3832,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3488,7 +3860,7 @@ { "id": "g0067", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ronald Zalacko a Samuel Vasiľ?", "expected_documents": [ @@ -3525,12 +3897,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ronald Zalacko -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3540,7 +3925,7 @@ { "id": "g0068", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Kristián Sopkovič?", "expected_documents": [ @@ -3577,12 +3962,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Kristián Sopkovič" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3592,7 +3990,7 @@ { "id": "g0069", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Márk Fehér?", "expected_documents": [ @@ -3629,12 +4027,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Alina Vitko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Márk Fehér" + "Alina Vitko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Márk Fehér -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3644,7 +4055,7 @@ { "id": "g0070", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Oleksandr Dorybohov?", "expected_documents": [ @@ -3681,12 +4092,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Oleksandr Dorybohov" + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3696,7 +4120,7 @@ { "id": "g0071", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Simona Bobrovčanová?", "expected_documents": [ @@ -3733,12 +4157,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Džurina -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Simona Bobrovčanová" + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3748,7 +4185,7 @@ { "id": "g0072", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Rostyslav Rodzhuk?", "expected_documents": [ @@ -3785,12 +4222,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Rostyslav Rodzhuk" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3800,7 +4250,7 @@ { "id": "g0073", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Samuel Vasiľ?", "expected_documents": [ @@ -3837,12 +4287,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3852,7 +4315,7 @@ { "id": "g0074", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Holp a Maroš Harahus?", "expected_documents": [ @@ -3889,12 +4352,25 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Holp -> HAS_WORK_YEAR -> 2021 <- HAS_WORK_YEAR <- Maroš Harahus" + "Ján Holp -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]", + "Maroš Harahus -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3904,7 +4380,7 @@ { "id": "g0075", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Tomáš Kuchárik?", "expected_documents": [ @@ -3941,12 +4417,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Tomáš Kuchárik" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Tomáš Kuchárik -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -3956,7 +4445,7 @@ { "id": "g0076", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dávid Omasta a Vladimír Ferko?", "expected_documents": [ @@ -3993,12 +4482,25 @@ "value": "2024" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dávid Omasta -> HAS_WORK_YEAR -> 2024 <- HAS_WORK_YEAR <- Vladimír Ferko" + "Dávid Omasta -> (AUTHORED Thesis | HAS_WORK Work) [year=2024]", + "Vladimír Ferko -> (AUTHORED Thesis | HAS_WORK Work) [year=2024]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4008,7 +4510,7 @@ { "id": "g0077", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Oleksandr Dorybohov?", "expected_documents": [ @@ -4045,12 +4547,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Oleksandr Dorybohov" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4060,7 +4575,7 @@ { "id": "g0078", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Michal Stromko?", "expected_documents": [ @@ -4097,12 +4612,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Michal Stromko" + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4112,7 +4640,7 @@ { "id": "g0079", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Michal Stromko?", "expected_documents": [ @@ -4149,12 +4677,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Michal Stromko" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4164,7 +4705,7 @@ { "id": "g0080", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Maksym Zatirka?", "expected_documents": [ @@ -4201,12 +4742,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Maksym Zatirka" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4216,7 +4770,7 @@ { "id": "g0081", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Yevhenii Medushivskyi?", "expected_documents": [ @@ -4253,12 +4807,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4268,7 +4835,7 @@ { "id": "g0082", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Samuel Vasiľ?", "expected_documents": [ @@ -4305,12 +4872,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4320,7 +4900,7 @@ { "id": "g0083", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Oleksandr Dorybohov?", "expected_documents": [ @@ -4357,12 +4937,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Oleksandr Dorybohov" + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4372,7 +4965,7 @@ { "id": "g0084", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Yevhenii Medushivskyi?", "expected_documents": [ @@ -4409,12 +5002,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4424,7 +5030,7 @@ { "id": "g0085", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Ronald Zalacko?", "expected_documents": [ @@ -4461,12 +5067,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4476,7 +5095,7 @@ { "id": "g0086", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ondrej Megela a Patrik Pavlišin?", "expected_documents": [ @@ -4513,12 +5132,25 @@ "value": "2020" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ondrej Megela -> HAS_WORK_YEAR -> 2020 <- HAS_WORK_YEAR <- Patrik Pavlišin" + "Ondrej Megela -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]", + "Patrik Pavlišin -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4528,7 +5160,7 @@ { "id": "g0087", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Maroš Harahus?", "expected_documents": [ @@ -4565,12 +5197,25 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Jakub Maruniak -> HAS_WORK_YEAR -> 2021 <- HAS_WORK_YEAR <- Maroš Harahus" + "Jakub Maruniak -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]", + "Maroš Harahus -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4580,7 +5225,7 @@ { "id": "g0088", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Simona Bobrovčanová?", "expected_documents": [ @@ -4617,12 +5262,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Simona Bobrovčanová" + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4632,7 +5290,7 @@ { "id": "g0089", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Kristián Sopkovič?", "expected_documents": [ @@ -4669,12 +5327,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dominik Nagy -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Kristián Sopkovič" + "Dominik Nagy -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4684,7 +5355,7 @@ { "id": "g0090", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Maksym Zatirka?", "expected_documents": [ @@ -4721,12 +5392,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Maksym Zatirka" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4736,7 +5420,7 @@ { "id": "g0091", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Simona Bobrovčanová?", "expected_documents": [ @@ -4773,12 +5457,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Simona Bobrovčanová" + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4788,7 +5485,7 @@ { "id": "g0092", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Simona Bobrovčanová a Yevhenii Medushivskyi?", "expected_documents": [ @@ -4825,12 +5522,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Simona Bobrovčanová -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4840,7 +5550,7 @@ { "id": "g0093", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Tomáš Kuchárik?", "expected_documents": [ @@ -4877,12 +5587,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Tomáš Kuchárik" + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Tomáš Kuchárik -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4892,7 +5615,7 @@ { "id": "g0094", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ronald Zalacko?", "expected_documents": [ @@ -4929,12 +5652,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4944,7 +5680,7 @@ { "id": "g0095", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Michal Stromko?", "expected_documents": [ @@ -4981,12 +5717,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dominik Nagy -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Michal Stromko" + "Dominik Nagy -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -4996,7 +5745,7 @@ { "id": "g0096", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Filip Tomáš?", "expected_documents": [ @@ -5033,12 +5782,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Alina Vitko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Filip Tomáš" + "Alina Vitko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Filip Tomáš -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5048,7 +5810,7 @@ { "id": "g0097", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Dominik Nagy?", "expected_documents": [ @@ -5085,12 +5847,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Dominik Nagy" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Dominik Nagy -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5100,7 +5875,7 @@ { "id": "g0098", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Michal Stromko a Tomáš Kuchárik?", "expected_documents": [ @@ -5137,12 +5912,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Michal Stromko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Tomáš Kuchárik" + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Tomáš Kuchárik -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5152,7 +5940,7 @@ { "id": "g0099", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Rostyslav Rodzhuk?", "expected_documents": [ @@ -5189,12 +5977,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Rostyslav Rodzhuk" + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5204,7 +6005,7 @@ { "id": "g0100", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Yevhenii Medushivskyi?", "expected_documents": [ @@ -5241,12 +6042,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5256,7 +6070,7 @@ { "id": "g0101", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ján Malinovský?", "expected_documents": [ @@ -5293,12 +6107,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ján Malinovský" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5308,7 +6135,7 @@ { "id": "g0102", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Martin Šarišský?", "expected_documents": [ @@ -5345,12 +6172,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Martin Šarišský" + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5360,7 +6200,7 @@ { "id": "g0103", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Andrii Pervashov a Oleh Poiasnik?", "expected_documents": [ @@ -5397,12 +6237,25 @@ "value": "2027" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_WORK_YEAR -> 2027 <- HAS_WORK_YEAR <- Oleh Poiasnik" + "Andrii Pervashov -> (AUTHORED Thesis | HAS_WORK Work) [year=2027]", + "Oleh Poiasnik -> (AUTHORED Thesis | HAS_WORK Work) [year=2027]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5412,7 +6265,7 @@ { "id": "g0104", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Ščišľak?", "expected_documents": [ @@ -5449,12 +6302,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Matej Ščišľak" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5464,7 +6330,7 @@ { "id": "g0105", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Tomáš Kuchárik?", "expected_documents": [ @@ -5501,12 +6367,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dominik Nagy -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Tomáš Kuchárik" + "Dominik Nagy -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Tomáš Kuchárik -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5516,7 +6395,7 @@ { "id": "g0106", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Samuel Vasiľ?", "expected_documents": [ @@ -5553,12 +6432,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5568,7 +6460,7 @@ { "id": "g0107", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Yevhenii Medushivskyi?", "expected_documents": [ @@ -5605,12 +6497,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5620,7 +6525,7 @@ { "id": "g0108", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Simona Bobrovčanová?", "expected_documents": [ @@ -5657,12 +6562,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Simona Bobrovčanová" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5672,7 +6590,7 @@ { "id": "g0109", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Oleksandr Dorybohov?", "expected_documents": [ @@ -5709,12 +6627,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Oleksandr Dorybohov" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5724,7 +6655,7 @@ { "id": "g0110", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Matej Ščišľak?", "expected_documents": [ @@ -5761,12 +6692,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Matej Ščišľak" + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5776,7 +6720,7 @@ { "id": "g0111", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Ján Holp?", "expected_documents": [ @@ -5813,12 +6757,25 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Jakub Maruniak -> HAS_WORK_YEAR -> 2021 <- HAS_WORK_YEAR <- Ján Holp" + "Jakub Maruniak -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]", + "Ján Holp -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5828,7 +6785,7 @@ { "id": "g0112", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dmytro Ushatenko a Martin Wencel?", "expected_documents": [ @@ -5865,12 +6822,25 @@ "value": "2020" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dmytro Ushatenko -> HAS_WORK_YEAR -> 2020 <- HAS_WORK_YEAR <- Martin Wencel" + "Dmytro Ushatenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]", + "Martin Wencel -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5880,7 +6850,7 @@ { "id": "g0113", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Ronald Zalacko?", "expected_documents": [ @@ -5917,12 +6887,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5932,7 +6915,7 @@ { "id": "g0114", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Simona Bobrovčanová?", "expected_documents": [ @@ -5969,12 +6952,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Simona Bobrovčanová" + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -5984,7 +6980,7 @@ { "id": "g0115", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Rostyslav Rodzhuk?", "expected_documents": [ @@ -6021,12 +7017,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Rostyslav Rodzhuk" + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6036,7 +7045,7 @@ { "id": "g0116", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Daniil Huzenko a Tetiana Mohorian?", "expected_documents": [ @@ -6073,12 +7082,25 @@ "value": "2025" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Daniil Huzenko -> HAS_WORK_YEAR -> 2025 <- HAS_WORK_YEAR <- Tetiana Mohorian" + "Daniil Huzenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2025]", + "Tetiana Mohorian -> (AUTHORED Thesis | HAS_WORK Work) [year=2025]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6088,7 +7110,7 @@ { "id": "g0117", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Martin Šarišský?", "expected_documents": [ @@ -6125,12 +7147,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Martin Šarišský" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6140,7 +7175,7 @@ { "id": "g0118", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Yevhenii Medushivskyi?", "expected_documents": [ @@ -6177,12 +7212,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Džurina -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6192,7 +7240,7 @@ { "id": "g0119", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Martin Šarišský a Ronald Zalacko?", "expected_documents": [ @@ -6229,12 +7277,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6244,7 +7305,7 @@ { "id": "g0120", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Maksym Zatirka a Samuel Vasiľ?", "expected_documents": [ @@ -6281,12 +7342,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6296,7 +7370,7 @@ { "id": "g0121", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Filip Tomáš a Márk Fehér?", "expected_documents": [ @@ -6333,12 +7407,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Filip Tomáš -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Márk Fehér" + "Filip Tomáš -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Márk Fehér -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6348,7 +7435,7 @@ { "id": "g0122", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Pták a Samuel Džurina?", "expected_documents": [ @@ -6385,12 +7472,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6400,7 +7500,7 @@ { "id": "g0123", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Oleksandr Dorybohov a Ronald Zalacko?", "expected_documents": [ @@ -6437,12 +7537,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6452,7 +7565,7 @@ { "id": "g0124", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Pták a Matej Novotný?", "expected_documents": [ @@ -6489,12 +7602,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Matej Novotný" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6504,7 +7630,7 @@ { "id": "g0125", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Dárius Lindvai a Lukáš Pokrývka?", "expected_documents": [ @@ -6541,12 +7667,25 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dárius Lindvai -> HAS_WORK_YEAR -> 2021 <- HAS_WORK_YEAR <- Lukáš Pokrývka" + "Dárius Lindvai -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]", + "Lukáš Pokrývka -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6556,7 +7695,7 @@ { "id": "g0126", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Malinovský a Samuel Vasiľ?", "expected_documents": [ @@ -6593,12 +7732,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6608,7 +7760,7 @@ { "id": "g0127", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Rostyslav Rodzhuk a Samuel Džurina?", "expected_documents": [ @@ -6645,12 +7797,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6660,7 +7825,7 @@ { "id": "g0128", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Matej Novotný a Samuel Džurina?", "expected_documents": [ @@ -6697,12 +7862,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6712,7 +7890,7 @@ { "id": "g0129", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Malinovský a Martin Šarišský?", "expected_documents": [ @@ -6749,12 +7927,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Martin Šarišský" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6764,7 +7955,7 @@ { "id": "g0130", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Matej Ščišľak a Samuel Džurina?", "expected_documents": [ @@ -6801,12 +7992,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Džurina" + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6816,7 +8020,7 @@ { "id": "g0131", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ronald Zalacko a Samuel Vasiľ?", "expected_documents": [ @@ -6853,12 +8057,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ronald Zalacko -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6868,7 +8085,7 @@ { "id": "g0132", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Artem Yatsenko a Kristián Sopkovič?", "expected_documents": [ @@ -6905,12 +8122,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Kristián Sopkovič" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6920,7 +8150,7 @@ { "id": "g0133", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Alina Vitko a Márk Fehér?", "expected_documents": [ @@ -6957,12 +8187,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Alina Vitko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Márk Fehér" + "Alina Vitko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Márk Fehér -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -6972,7 +8215,7 @@ { "id": "g0134", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Martin Šarišský a Oleksandr Dorybohov?", "expected_documents": [ @@ -7009,12 +8252,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Oleksandr Dorybohov" + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7024,7 +8280,7 @@ { "id": "g0135", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Samuel Džurina a Simona Bobrovčanová?", "expected_documents": [ @@ -7061,12 +8317,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Džurina -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Simona Bobrovčanová" + "Samuel Džurina -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7076,7 +8345,7 @@ { "id": "g0136", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Pták a Rostyslav Rodzhuk?", "expected_documents": [ @@ -7113,12 +8382,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Rostyslav Rodzhuk" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Rostyslav Rodzhuk -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7128,7 +8410,7 @@ { "id": "g0137", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Martin Šarišský a Samuel Vasiľ?", "expected_documents": [ @@ -7165,12 +8447,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Martin Šarišský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7180,7 +8475,7 @@ { "id": "g0138", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Holp a Maroš Harahus?", "expected_documents": [ @@ -7217,12 +8512,25 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Holp -> HAS_WORK_YEAR -> 2021 <- HAS_WORK_YEAR <- Maroš Harahus" + "Ján Holp -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]", + "Maroš Harahus -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7232,7 +8540,7 @@ { "id": "g0139", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Artem Yatsenko a Tomáš Kuchárik?", "expected_documents": [ @@ -7269,12 +8577,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Tomáš Kuchárik" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Tomáš Kuchárik -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7284,7 +8605,7 @@ { "id": "g0140", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Dávid Omasta a Vladimír Ferko?", "expected_documents": [ @@ -7321,12 +8642,25 @@ "value": "2024" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dávid Omasta -> HAS_WORK_YEAR -> 2024 <- HAS_WORK_YEAR <- Vladimír Ferko" + "Dávid Omasta -> (AUTHORED Thesis | HAS_WORK Work) [year=2024]", + "Vladimír Ferko -> (AUTHORED Thesis | HAS_WORK Work) [year=2024]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7336,7 +8670,7 @@ { "id": "g0141", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Malinovský a Oleksandr Dorybohov?", "expected_documents": [ @@ -7373,12 +8707,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Oleksandr Dorybohov" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7388,7 +8735,7 @@ { "id": "g0142", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Kristián Sopkovič a Michal Stromko?", "expected_documents": [ @@ -7425,12 +8772,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Michal Stromko" + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7440,7 +8800,7 @@ { "id": "g0143", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Artem Yatsenko a Michal Stromko?", "expected_documents": [ @@ -7477,12 +8837,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Michal Stromko" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7492,7 +8865,7 @@ { "id": "g0144", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Denis Le Thanh a Maksym Zatirka?", "expected_documents": [ @@ -7529,12 +8902,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Maksym Zatirka" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7544,7 +8930,7 @@ { "id": "g0145", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Pták a Yevhenii Medushivskyi?", "expected_documents": [ @@ -7581,12 +8967,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7596,7 +8995,7 @@ { "id": "g0146", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Oleksandr Dorybohov a Samuel Vasiľ?", "expected_documents": [ @@ -7633,12 +9032,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Samuel Vasiľ" + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Samuel Vasiľ -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7648,7 +9060,7 @@ { "id": "g0147", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Maksym Zatirka a Oleksandr Dorybohov?", "expected_documents": [ @@ -7685,12 +9097,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Oleksandr Dorybohov" + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Oleksandr Dorybohov -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7700,7 +9125,7 @@ { "id": "g0148", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Matej Ščišľak a Yevhenii Medushivskyi?", "expected_documents": [ @@ -7737,12 +9162,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Yevhenii Medushivskyi" + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7752,7 +9190,7 @@ { "id": "g0149", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Maksym Zatirka a Ronald Zalacko?", "expected_documents": [ @@ -7789,12 +9227,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Ronald Zalacko" + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Ronald Zalacko -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7804,7 +9255,7 @@ { "id": "g0150", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ondrej Megela a Patrik Pavlišin?", "expected_documents": [ @@ -7841,12 +9292,25 @@ "value": "2020" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ondrej Megela -> HAS_WORK_YEAR -> 2020 <- HAS_WORK_YEAR <- Patrik Pavlišin" + "Ondrej Megela -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]", + "Patrik Pavlišin -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7856,7 +9320,7 @@ { "id": "g0151", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Jakub Maruniak a Maroš Harahus?", "expected_documents": [ @@ -7893,12 +9357,25 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Jakub Maruniak -> HAS_WORK_YEAR -> 2021 <- HAS_WORK_YEAR <- Maroš Harahus" + "Jakub Maruniak -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]", + "Maroš Harahus -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7908,7 +9385,7 @@ { "id": "g0152", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Matej Novotný a Simona Bobrovčanová?", "expected_documents": [ @@ -7945,12 +9422,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Simona Bobrovčanová" + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -7960,7 +9450,7 @@ { "id": "g0153", "split": "dev", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Dominik Nagy a Kristián Sopkovič?", "expected_documents": [ @@ -7997,12 +9487,25 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dominik Nagy -> HAS_WORK_YEAR -> 2022 <- HAS_WORK_YEAR <- Kristián Sopkovič" + "Dominik Nagy -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -8012,7 +9515,7 @@ { "id": "g0154", "split": "test", - "category": "same_work_year_pair", + "category": "same_academic_year_pair", "difficulty": "hard", "question": "Aký rok práce spája osoby Ján Malinovský a Maksym Zatirka?", "expected_documents": [ @@ -8049,12 +9552,25 @@ "value": "2026" } ], - "expected_relations": [ - "HAS_WORK_YEAR", - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_YEAR -> 2026 <- HAS_WORK_YEAR <- Maksym Zatirka" + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]", + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ], + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -8101,12 +9617,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Tetiana Mohorian -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Valerii Kutsenko" + "Tetiana Mohorian [start_year=2022]", + "Valerii Kutsenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8153,12 +9672,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Tetiana Mohorian" + "Ján Pták [start_year=2022]", + "Tetiana Mohorian [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8205,12 +9727,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Ronald Zalacko" + "Denis Le Thanh [start_year=2023]", + "Ronald Zalacko [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8257,12 +9782,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Oleh Poiasnik" + "Ján Malinovský [start_year=2022]", + "Oleh Poiasnik [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8309,12 +9837,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleh Poiasnik -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Samuel Vasiľ" + "Oleh Poiasnik [start_year=2022]", + "Samuel Vasiľ [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8361,12 +9892,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Džurina -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Yevhenii Medushivskyi" + "Samuel Džurina [start_year=2023]", + "Yevhenii Medushivskyi [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8413,12 +9947,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Ronald Zalacko" + "Oleksandr Dorybohov [start_year=2023]", + "Ronald Zalacko [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8465,12 +10002,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Valerii Kutsenko" + "Ján Pták [start_year=2022]", + "Valerii Kutsenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8517,12 +10057,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Simona Bobrovčanová" + "Rostyslav Rodzhuk [start_year=2023]", + "Simona Bobrovčanová [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8569,12 +10112,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Simona Bobrovčanová -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Yevhenii Medushivskyi" + "Simona Bobrovčanová [start_year=2023]", + "Yevhenii Medushivskyi [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8621,12 +10167,15 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_START_YEAR -> 2021 <- HAS_START_YEAR <- Matej Ščišľak" + "Matej Novotný [start_year=2021]", + "Matej Ščišľak [start_year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8673,12 +10222,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Andrii Pervashov [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8725,12 +10277,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Yevhenii Medushivskyi" + "Rostyslav Rodzhuk [start_year=2023]", + "Yevhenii Medushivskyi [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8777,12 +10332,15 @@ "value": "2016" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Jakub Maruniak -> HAS_START_YEAR -> 2016 <- HAS_START_YEAR <- Ján Holp" + "Jakub Maruniak [start_year=2016]", + "Ján Holp [start_year=2016]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8829,12 +10387,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleh Poiasnik -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Oleh Poiasnik [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8881,12 +10442,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Oleksandr Dorybohov" + "Maksym Zatirka [start_year=2023]", + "Oleksandr Dorybohov [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8933,12 +10497,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Samuel Vasiľ" + "Ján Malinovský [start_year=2022]", + "Samuel Vasiľ [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -8985,12 +10552,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Samuel Džurina" + "Rostyslav Rodzhuk [start_year=2023]", + "Samuel Džurina [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9037,12 +10607,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Maksym Zatirka" + "Denis Le Thanh [start_year=2023]", + "Maksym Zatirka [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9089,12 +10662,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Daniil Huzenko -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Tetiana Mohorian" + "Daniil Huzenko [start_year=2022]", + "Tetiana Mohorian [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9141,12 +10717,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Ronald Zalacko" + "Maksym Zatirka [start_year=2023]", + "Ronald Zalacko [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9193,12 +10772,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Oleksandr Dorybohov" + "Denis Le Thanh [start_year=2023]", + "Oleksandr Dorybohov [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9245,12 +10827,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Daniil Huzenko -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Ján Pták" + "Daniil Huzenko [start_year=2022]", + "Ján Pták [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9297,12 +10882,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Oleh Poiasnik" + "Andrii Pervashov [start_year=2022]", + "Oleh Poiasnik [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9349,12 +10937,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Ján Malinovský [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9401,12 +10992,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Vasiľ -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Samuel Vasiľ [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9453,12 +11047,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Ján Malinovský" + "Andrii Pervashov [start_year=2022]", + "Ján Malinovský [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9505,12 +11102,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Daniil Huzenko -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Valerii Kutsenko" + "Daniil Huzenko [start_year=2022]", + "Valerii Kutsenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9557,12 +11157,15 @@ "value": "2016" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dárius Lindvai -> HAS_START_YEAR -> 2016 <- HAS_START_YEAR <- Lukáš Pokrývka" + "Dárius Lindvai [start_year=2016]", + "Lukáš Pokrývka [start_year=2016]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9609,12 +11212,15 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Eduard Matovka -> HAS_START_YEAR -> 2021 <- HAS_START_YEAR <- Martin Šarišský" + "Eduard Matovka [start_year=2021]", + "Martin Šarišský [start_year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9661,12 +11267,15 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_START_YEAR -> 2021 <- HAS_START_YEAR <- Vladimír Ferko" + "Matej Novotný [start_year=2021]", + "Vladimír Ferko [start_year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9713,12 +11322,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Džurina -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Simona Bobrovčanová" + "Samuel Džurina [start_year=2023]", + "Simona Bobrovčanová [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9765,12 +11377,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Samuel Vasiľ" + "Andrii Pervashov [start_year=2022]", + "Samuel Vasiľ [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9817,12 +11432,15 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Ščišľak -> HAS_START_YEAR -> 2021 <- HAS_START_YEAR <- Vladimír Ferko" + "Matej Ščišľak [start_year=2021]", + "Vladimír Ferko [start_year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9869,12 +11487,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Tetiana Mohorian -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Valerii Kutsenko" + "Tetiana Mohorian [start_year=2022]", + "Valerii Kutsenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9921,12 +11542,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Tetiana Mohorian" + "Ján Pták [start_year=2022]", + "Tetiana Mohorian [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -9973,12 +11597,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Ronald Zalacko" + "Denis Le Thanh [start_year=2023]", + "Ronald Zalacko [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10025,12 +11652,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Oleh Poiasnik" + "Ján Malinovský [start_year=2022]", + "Oleh Poiasnik [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10077,12 +11707,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleh Poiasnik -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Samuel Vasiľ" + "Oleh Poiasnik [start_year=2022]", + "Samuel Vasiľ [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10129,12 +11762,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Džurina -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Yevhenii Medushivskyi" + "Samuel Džurina [start_year=2023]", + "Yevhenii Medushivskyi [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10181,12 +11817,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Ronald Zalacko" + "Oleksandr Dorybohov [start_year=2023]", + "Ronald Zalacko [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10233,12 +11872,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Valerii Kutsenko" + "Ján Pták [start_year=2022]", + "Valerii Kutsenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10285,12 +11927,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Simona Bobrovčanová" + "Rostyslav Rodzhuk [start_year=2023]", + "Simona Bobrovčanová [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10337,12 +11982,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Simona Bobrovčanová -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Yevhenii Medushivskyi" + "Simona Bobrovčanová [start_year=2023]", + "Yevhenii Medushivskyi [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10389,12 +12037,15 @@ "value": "2021" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Matej Novotný -> HAS_START_YEAR -> 2021 <- HAS_START_YEAR <- Matej Ščišľak" + "Matej Novotný [start_year=2021]", + "Matej Ščišľak [start_year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10441,12 +12092,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Andrii Pervashov [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10493,12 +12147,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Yevhenii Medushivskyi" + "Rostyslav Rodzhuk [start_year=2023]", + "Yevhenii Medushivskyi [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10545,12 +12202,15 @@ "value": "2016" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Jakub Maruniak -> HAS_START_YEAR -> 2016 <- HAS_START_YEAR <- Ján Holp" + "Jakub Maruniak [start_year=2016]", + "Ján Holp [start_year=2016]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10597,12 +12257,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Oleh Poiasnik -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Oleh Poiasnik [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10649,12 +12312,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Oleksandr Dorybohov" + "Maksym Zatirka [start_year=2023]", + "Oleksandr Dorybohov [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10701,12 +12367,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Samuel Vasiľ" + "Ján Malinovský [start_year=2022]", + "Samuel Vasiľ [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10753,12 +12422,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Samuel Džurina" + "Rostyslav Rodzhuk [start_year=2023]", + "Samuel Džurina [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10805,12 +12477,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Maksym Zatirka" + "Denis Le Thanh [start_year=2023]", + "Maksym Zatirka [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10857,12 +12532,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Daniil Huzenko -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Tetiana Mohorian" + "Daniil Huzenko [start_year=2022]", + "Tetiana Mohorian [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10909,12 +12587,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Maksym Zatirka -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Ronald Zalacko" + "Maksym Zatirka [start_year=2023]", + "Ronald Zalacko [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -10961,12 +12642,15 @@ "value": "2023" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_START_YEAR -> 2023 <- HAS_START_YEAR <- Oleksandr Dorybohov" + "Denis Le Thanh [start_year=2023]", + "Oleksandr Dorybohov [start_year=2023]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -11013,12 +12697,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Daniil Huzenko -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Ján Pták" + "Daniil Huzenko [start_year=2022]", + "Ján Pták [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -11065,12 +12752,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Oleh Poiasnik" + "Andrii Pervashov [start_year=2022]", + "Oleh Poiasnik [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -11117,12 +12807,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Malinovský -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Ján Malinovský [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -11169,12 +12862,15 @@ "value": "2022" } ], - "expected_relations": [ - "HAS_START_YEAR", - "HAS_START_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Samuel Vasiľ -> HAS_START_YEAR -> 2022 <- HAS_START_YEAR <- Vladyslav Yanchenko" + "Samuel Vasiľ [start_year=2022]", + "Vladyslav Yanchenko [start_year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Person.start_year", + "Person.start_year" ] }, "evidence_basis": [ @@ -11211,7 +12907,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" }, { @@ -11220,12 +12916,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Alina Vitko -> HAS_WORK_TITLE -> Systémy pre generovanie odpovede na otázku v prirodzenom jazyku", - "Alina Vitko -> HAS_WORK_YEAR -> 2022" + "Alina Vitko -> AUTHORED -> Thesis(title=Systémy pre generovanie odpovede na otázku v prirodzenom jazyku, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11262,7 +12961,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" }, { @@ -11271,12 +12970,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Alina Vitko -> HAS_WORK_TITLE -> Systémy pre generovanie odpovede na otázku v prirodzenom jazyku", - "Alina Vitko -> HAS_WORK_YEAR -> 2022" + "Alina Vitko -> AUTHORED -> Thesis(title=Systémy pre generovanie odpovede na otázku v prirodzenom jazyku, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11313,7 +13015,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" }, { @@ -11322,12 +13024,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Andrii Pervashov -> HAS_WORK_TITLE -> Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu", - "Andrii Pervashov -> HAS_WORK_YEAR -> 2027" + "Andrii Pervashov -> AUTHORED -> Thesis(title=Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu, year=2027)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11364,7 +13069,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" }, { @@ -11373,12 +13078,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Andrii Pervashov -> HAS_WORK_TITLE -> Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu", - "Andrii Pervashov -> HAS_WORK_YEAR -> 2027" + "Andrii Pervashov -> AUTHORED -> Thesis(title=Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu, year=2027)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11415,7 +13123,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" }, { @@ -11424,12 +13132,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_TITLE -> Rozpoznávanie pomenovaných entít v slovenskom jazyku", - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022" + "Artem Yatsenko -> AUTHORED -> Thesis(title=Rozpoznávanie pomenovaných entít v slovenskom jazyku, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11466,7 +13177,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" }, { @@ -11475,12 +13186,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_TITLE -> Rozpoznávanie pomenovaných entít v slovenskom jazyku", - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022" + "Artem Yatsenko -> AUTHORED -> Thesis(title=Rozpoznávanie pomenovaných entít v slovenskom jazyku, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11517,7 +13231,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" }, { @@ -11526,12 +13240,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Daniil Huzenko -> HAS_WORK_TITLE -> Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", - "Daniil Huzenko -> HAS_WORK_YEAR -> 2025" + "Daniil Huzenko -> AUTHORED -> Thesis(title=Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia, year=2025)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11568,7 +13285,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" }, { @@ -11577,12 +13294,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Daniil Huzenko -> HAS_WORK_TITLE -> Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", - "Daniil Huzenko -> HAS_WORK_YEAR -> 2025" + "Daniil Huzenko -> AUTHORED -> Thesis(title=Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia, year=2025)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11619,7 +13339,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" }, { @@ -11628,12 +13348,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_TITLE -> Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku", - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026" + "Denis Le Thanh -> AUTHORED -> Thesis(title=Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11670,7 +13393,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" }, { @@ -11679,12 +13402,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_TITLE -> Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku", - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026" + "Denis Le Thanh -> AUTHORED -> Thesis(title=Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11721,7 +13447,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Jednoduchý chatbot v jazyku Python" }, { @@ -11730,12 +13456,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dmytro Ushatenko -> HAS_WORK_TITLE -> Jednoduchý chatbot v jazyku Python", - "Dmytro Ushatenko -> HAS_WORK_YEAR -> 2020" + "Dmytro Ushatenko -> AUTHORED -> Thesis(title=Jednoduchý chatbot v jazyku Python, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11772,7 +13501,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Jednoduchý chatbot v jazyku Python" }, { @@ -11781,12 +13510,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dmytro Ushatenko -> HAS_WORK_TITLE -> Jednoduchý chatbot v jazyku Python", - "Dmytro Ushatenko -> HAS_WORK_YEAR -> 2020" + "Dmytro Ushatenko -> AUTHORED -> Thesis(title=Jednoduchý chatbot v jazyku Python, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11823,7 +13555,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Neurónový strojový preklad pomocou knižnice Fairseq" }, { @@ -11832,12 +13564,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dominik Nagy -> HAS_WORK_TITLE -> Neurónový strojový preklad pomocou knižnice Fairseq", - "Dominik Nagy -> HAS_WORK_YEAR -> 2022" + "Dominik Nagy -> AUTHORED -> Thesis(title=Neurónový strojový preklad pomocou knižnice Fairseq, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11874,7 +13609,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Neurónový strojový preklad pomocou knižnice Fairseq" }, { @@ -11883,12 +13618,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dominik Nagy -> HAS_WORK_TITLE -> Neurónový strojový preklad pomocou knižnice Fairseq", - "Dominik Nagy -> HAS_WORK_YEAR -> 2022" + "Dominik Nagy -> AUTHORED -> Thesis(title=Neurónový strojový preklad pomocou knižnice Fairseq, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11925,7 +13663,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" }, { @@ -11934,12 +13672,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dárius Lindvai -> HAS_WORK_TITLE -> Obnovenie interpunkcie pomocou hlbokých neurónových sietí", - "Dárius Lindvai -> HAS_WORK_YEAR -> 2021" + "Dárius Lindvai -> AUTHORED -> Thesis(title=Obnovenie interpunkcie pomocou hlbokých neurónových sietí, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -11976,7 +13717,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" }, { @@ -11985,12 +13726,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dárius Lindvai -> HAS_WORK_TITLE -> Obnovenie interpunkcie pomocou hlbokých neurónových sietí", - "Dárius Lindvai -> HAS_WORK_YEAR -> 2021" + "Dárius Lindvai -> AUTHORED -> Thesis(title=Obnovenie interpunkcie pomocou hlbokých neurónových sietí, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12027,7 +13771,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" }, { @@ -12036,12 +13780,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dávid Omasta -> HAS_WORK_TITLE -> Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", - "Dávid Omasta -> HAS_WORK_YEAR -> 2024" + "Dávid Omasta -> AUTHORED -> Thesis(title=Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku, year=2024)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12078,7 +13825,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" }, { @@ -12087,12 +13834,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Dávid Omasta -> HAS_WORK_TITLE -> Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", - "Dávid Omasta -> HAS_WORK_YEAR -> 2024" + "Dávid Omasta -> AUTHORED -> Thesis(title=Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku, year=2024)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12129,7 +13879,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Slovenská konverzačná umelá inteligencia" }, { @@ -12138,12 +13888,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Eduard Matovka -> HAS_WORK_TITLE -> Slovenská konverzačná umelá inteligencia", - "Eduard Matovka -> HAS_WORK_YEAR -> 2024" + "Eduard Matovka -> AUTHORED -> Thesis(title=Slovenská konverzačná umelá inteligencia, year=2024)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12180,7 +13933,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Slovenská konverzačná umelá inteligencia" }, { @@ -12189,12 +13942,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Eduard Matovka -> HAS_WORK_TITLE -> Slovenská konverzačná umelá inteligencia", - "Eduard Matovka -> HAS_WORK_YEAR -> 2024" + "Eduard Matovka -> AUTHORED -> Thesis(title=Slovenská konverzačná umelá inteligencia, year=2024)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12231,7 +13987,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" }, { @@ -12240,12 +13996,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Filip Tomáš -> HAS_WORK_TITLE -> Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia", - "Filip Tomáš -> HAS_WORK_YEAR -> 2022" + "Filip Tomáš -> AUTHORED -> Thesis(title=Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12282,7 +14041,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" }, { @@ -12291,12 +14050,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Filip Tomáš -> HAS_WORK_TITLE -> Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia", - "Filip Tomáš -> HAS_WORK_YEAR -> 2022" + "Filip Tomáš -> AUTHORED -> Thesis(title=Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12333,7 +14095,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" }, { @@ -12342,12 +14104,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Jakub Maruniak -> HAS_WORK_TITLE -> Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", - "Jakub Maruniak -> HAS_WORK_YEAR -> 2021" + "Jakub Maruniak -> AUTHORED -> Thesis(title=Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12384,7 +14149,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" }, { @@ -12393,12 +14158,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Jakub Maruniak -> HAS_WORK_TITLE -> Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", - "Jakub Maruniak -> HAS_WORK_YEAR -> 2021" + "Jakub Maruniak -> AUTHORED -> Thesis(title=Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12435,7 +14203,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Systém získavania informácií v slovenskom jazyku" }, { @@ -12444,12 +14212,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Ján Holp -> HAS_WORK_TITLE -> Systém získavania informácií v slovenskom jazyku", - "Ján Holp -> HAS_WORK_YEAR -> 2021" + "Ján Holp -> AUTHORED -> Thesis(title=Systém získavania informácií v slovenskom jazyku, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12486,7 +14257,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Systém získavania informácií v slovenskom jazyku" }, { @@ -12495,12 +14266,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Ján Holp -> HAS_WORK_TITLE -> Systém získavania informácií v slovenskom jazyku", - "Ján Holp -> HAS_WORK_YEAR -> 2021" + "Ján Holp -> AUTHORED -> Thesis(title=Systém získavania informácií v slovenskom jazyku, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12546,12 +14320,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "HAS_WORK" ], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_TITLE -> Grafové vyhľadávanie pre podporu vzdelávania", - "Ján Malinovský -> HAS_WORK_YEAR -> 2026" + "Ján Malinovský -> HAS_WORK -> Work(title=Grafové vyhľadávanie pre podporu vzdelávania, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Work.title", + "Work.year" ] }, "evidence_basis": [ @@ -12597,12 +14374,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "HAS_WORK" ], "expected_paths": [ - "Ján Malinovský -> HAS_WORK_TITLE -> Grafové vyhľadávanie pre podporu vzdelávania", - "Ján Malinovský -> HAS_WORK_YEAR -> 2026" + "Ján Malinovský -> HAS_WORK -> Work(title=Grafové vyhľadávanie pre podporu vzdelávania, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Work.title", + "Work.year" ] }, "evidence_basis": [ @@ -12648,12 +14428,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "HAS_WORK" ], "expected_paths": [ - "Ján Pták -> HAS_WORK_TITLE -> Agent pre manažment záverečných prác", - "Ján Pták -> HAS_WORK_YEAR -> 2026" + "Ján Pták -> HAS_WORK -> Work(title=Agent pre manažment záverečných prác, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Work.title", + "Work.year" ] }, "evidence_basis": [ @@ -12699,12 +14482,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "HAS_WORK" ], "expected_paths": [ - "Ján Pták -> HAS_WORK_TITLE -> Agent pre manažment záverečných prác", - "Ján Pták -> HAS_WORK_YEAR -> 2026" + "Ján Pták -> HAS_WORK -> Work(title=Agent pre manažment záverečných prác, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Work.title", + "Work.year" ] }, "evidence_basis": [ @@ -12741,7 +14527,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" }, { @@ -12750,12 +14536,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Kristián Sopkovič -> HAS_WORK_TITLE -> Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022" + "Kristián Sopkovič -> AUTHORED -> Thesis(title=Model Spacy pre spracovanie prirodzeného jazyka v slovenčine, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12792,7 +14581,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" }, { @@ -12801,12 +14590,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Kristián Sopkovič -> HAS_WORK_TITLE -> Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022" + "Kristián Sopkovič -> AUTHORED -> Thesis(title=Model Spacy pre spracovanie prirodzeného jazyka v slovenčine, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12843,7 +14635,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Paralelné trénovanie neurónových sietí" }, { @@ -12852,12 +14644,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Lukáš Pokrývka -> HAS_WORK_TITLE -> Paralelné trénovanie neurónových sietí", - "Lukáš Pokrývka -> HAS_WORK_YEAR -> 2021" + "Lukáš Pokrývka -> AUTHORED -> Thesis(title=Paralelné trénovanie neurónových sietí, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12894,7 +14689,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Paralelné trénovanie neurónových sietí" }, { @@ -12903,12 +14698,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Lukáš Pokrývka -> HAS_WORK_TITLE -> Paralelné trénovanie neurónových sietí", - "Lukáš Pokrývka -> HAS_WORK_YEAR -> 2021" + "Lukáš Pokrývka -> AUTHORED -> Thesis(title=Paralelné trénovanie neurónových sietí, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12945,7 +14743,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Grafová databáza pre podporu generovania slovenského jazyka" }, { @@ -12954,12 +14752,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_TITLE -> Grafová databáza pre podporu generovania slovenského jazyka", - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026" + "Maksym Zatirka -> AUTHORED -> Thesis(title=Grafová databáza pre podporu generovania slovenského jazyka, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -12996,7 +14797,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Grafová databáza pre podporu generovania slovenského jazyka" }, { @@ -13005,12 +14806,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Maksym Zatirka -> HAS_WORK_TITLE -> Grafová databáza pre podporu generovania slovenského jazyka", - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026" + "Maksym Zatirka -> AUTHORED -> Thesis(title=Grafová databáza pre podporu generovania slovenského jazyka, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13047,7 +14851,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Neurónová morfologická anotácia slovenského jazyka" }, { @@ -13056,12 +14860,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Maroš Harahus -> HAS_WORK_TITLE -> Neurónová morfologická anotácia slovenského jazyka", - "Maroš Harahus -> HAS_WORK_YEAR -> 2021" + "Maroš Harahus -> AUTHORED -> Thesis(title=Neurónová morfologická anotácia slovenského jazyka, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13098,7 +14905,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Neurónová morfologická anotácia slovenského jazyka" }, { @@ -13107,12 +14914,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Maroš Harahus -> HAS_WORK_TITLE -> Neurónová morfologická anotácia slovenského jazyka", - "Maroš Harahus -> HAS_WORK_YEAR -> 2021" + "Maroš Harahus -> AUTHORED -> Thesis(title=Neurónová morfologická anotácia slovenského jazyka, year=2021)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13149,7 +14959,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" }, { @@ -13158,12 +14968,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Martin Wencel -> HAS_WORK_TITLE -> Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy", - "Martin Wencel -> HAS_WORK_YEAR -> 2020" + "Martin Wencel -> AUTHORED -> Thesis(title=Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13200,7 +15013,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" }, { @@ -13209,12 +15022,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Martin Wencel -> HAS_WORK_TITLE -> Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy", - "Martin Wencel -> HAS_WORK_YEAR -> 2020" + "Martin Wencel -> AUTHORED -> Thesis(title=Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13251,7 +15067,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Agentové systémy pomocou veľkého jazykového modelu" }, { @@ -13260,12 +15076,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_TITLE -> Agentové systémy pomocou veľkého jazykového modelu", - "Martin Šarišský -> HAS_WORK_YEAR -> 2026" + "Martin Šarišský -> AUTHORED -> Thesis(title=Agentové systémy pomocou veľkého jazykového modelu, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13302,7 +15121,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Agentové systémy pomocou veľkého jazykového modelu" }, { @@ -13311,12 +15130,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Martin Šarišský -> HAS_WORK_TITLE -> Agentové systémy pomocou veľkého jazykového modelu", - "Martin Šarišský -> HAS_WORK_YEAR -> 2026" + "Martin Šarišský -> AUTHORED -> Thesis(title=Agentové systémy pomocou veľkého jazykového modelu, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13353,7 +15175,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" }, { @@ -13362,12 +15184,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Matej Novotný -> HAS_WORK_TITLE -> Klasifikácia webových dát pre lepšie jazykové modelovanie", - "Matej Novotný -> HAS_WORK_YEAR -> 2026" + "Matej Novotný -> AUTHORED -> Thesis(title=Klasifikácia webových dát pre lepšie jazykové modelovanie, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13404,7 +15229,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" }, { @@ -13413,12 +15238,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Matej Novotný -> HAS_WORK_TITLE -> Klasifikácia webových dát pre lepšie jazykové modelovanie", - "Matej Novotný -> HAS_WORK_YEAR -> 2026" + "Matej Novotný -> AUTHORED -> Thesis(title=Klasifikácia webových dát pre lepšie jazykové modelovanie, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13455,7 +15283,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" }, { @@ -13464,12 +15292,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_TITLE -> Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026" + "Matej Ščišľak -> AUTHORED -> Thesis(title=Znalostné grafy pre zlepšenie vyhľadávania právnych informácií, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13506,7 +15337,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" }, { @@ -13515,12 +15346,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Matej Ščišľak -> HAS_WORK_TITLE -> Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026" + "Matej Ščišľak -> AUTHORED -> Thesis(title=Znalostné grafy pre zlepšenie vyhľadávania právnych informácií, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13557,7 +15391,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Indexovanie slovenského textu pomocou Elasticsearch" }, { @@ -13566,12 +15400,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Michal Stromko -> HAS_WORK_TITLE -> Indexovanie slovenského textu pomocou Elasticsearch", - "Michal Stromko -> HAS_WORK_YEAR -> 2022" + "Michal Stromko -> AUTHORED -> Thesis(title=Indexovanie slovenského textu pomocou Elasticsearch, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13608,7 +15445,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Indexovanie slovenského textu pomocou Elasticsearch" }, { @@ -13617,12 +15454,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Michal Stromko -> HAS_WORK_TITLE -> Indexovanie slovenského textu pomocou Elasticsearch", - "Michal Stromko -> HAS_WORK_YEAR -> 2022" + "Michal Stromko -> AUTHORED -> Thesis(title=Indexovanie slovenského textu pomocou Elasticsearch, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13659,7 +15499,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Klasifikácia textu metódami strojového učenia" }, { @@ -13668,12 +15508,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Márk Fehér -> HAS_WORK_TITLE -> Klasifikácia textu metódami strojového učenia", - "Márk Fehér -> HAS_WORK_YEAR -> 2022" + "Márk Fehér -> AUTHORED -> Thesis(title=Klasifikácia textu metódami strojového učenia, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13710,7 +15553,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Klasifikácia textu metódami strojového učenia" }, { @@ -13719,12 +15562,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Márk Fehér -> HAS_WORK_TITLE -> Klasifikácia textu metódami strojového učenia", - "Márk Fehér -> HAS_WORK_YEAR -> 2022" + "Márk Fehér -> AUTHORED -> Thesis(title=Klasifikácia textu metódami strojového učenia, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13761,7 +15607,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Expertný agentový systém na podporu rozhodovania v lekárni" }, { @@ -13770,12 +15616,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Oleh Poiasnik -> HAS_WORK_TITLE -> Expertný agentový systém na podporu rozhodovania v lekárni", - "Oleh Poiasnik -> HAS_WORK_YEAR -> 2027" + "Oleh Poiasnik -> AUTHORED -> Thesis(title=Expertný agentový systém na podporu rozhodovania v lekárni, year=2027)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13812,7 +15661,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Expertný agentový systém na podporu rozhodovania v lekárni" }, { @@ -13821,12 +15670,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Oleh Poiasnik -> HAS_WORK_TITLE -> Expertný agentový systém na podporu rozhodovania v lekárni", - "Oleh Poiasnik -> HAS_WORK_YEAR -> 2027" + "Oleh Poiasnik -> AUTHORED -> Thesis(title=Expertný agentový systém na podporu rozhodovania v lekárni, year=2027)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13863,7 +15715,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Automatické odpovede na otázky v právnej oblasti" }, { @@ -13872,12 +15724,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_WORK_TITLE -> Automatické odpovede na otázky v právnej oblasti", - "Oleksandr Dorybohov -> HAS_WORK_YEAR -> 2026" + "Oleksandr Dorybohov -> AUTHORED -> Thesis(title=Automatické odpovede na otázky v právnej oblasti, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13914,7 +15769,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Automatické odpovede na otázky v právnej oblasti" }, { @@ -13923,12 +15778,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Oleksandr Dorybohov -> HAS_WORK_TITLE -> Automatické odpovede na otázky v právnej oblasti", - "Oleksandr Dorybohov -> HAS_WORK_YEAR -> 2026" + "Oleksandr Dorybohov -> AUTHORED -> Thesis(title=Automatické odpovede na otázky v právnej oblasti, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -13965,7 +15823,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Neurónové jazykové modelovanie typu BERT" }, { @@ -13974,12 +15832,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Ondrej Megela -> HAS_WORK_TITLE -> Neurónové jazykové modelovanie typu BERT", - "Ondrej Megela -> HAS_WORK_YEAR -> 2020" + "Ondrej Megela -> AUTHORED -> Thesis(title=Neurónové jazykové modelovanie typu BERT, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14016,7 +15877,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Neurónové jazykové modelovanie typu BERT" }, { @@ -14025,12 +15886,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Ondrej Megela -> HAS_WORK_TITLE -> Neurónové jazykové modelovanie typu BERT", - "Ondrej Megela -> HAS_WORK_YEAR -> 2020" + "Ondrej Megela -> AUTHORED -> Thesis(title=Neurónové jazykové modelovanie typu BERT, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14067,7 +15931,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Metódy automatického prekladu" }, { @@ -14076,12 +15940,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Patrik Pavlišin -> HAS_WORK_TITLE -> Metódy automatického prekladu", - "Patrik Pavlišin -> HAS_WORK_YEAR -> 2020" + "Patrik Pavlišin -> AUTHORED -> Thesis(title=Metódy automatického prekladu, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14118,7 +15985,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Metódy automatického prekladu" }, { @@ -14127,12 +15994,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Patrik Pavlišin -> HAS_WORK_TITLE -> Metódy automatického prekladu", - "Patrik Pavlišin -> HAS_WORK_YEAR -> 2020" + "Patrik Pavlišin -> AUTHORED -> Thesis(title=Metódy automatického prekladu, year=2020)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14169,7 +16039,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Skórovací online systém pre robotické súťaže" }, { @@ -14178,12 +16048,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Ronald Zalacko -> HAS_WORK_TITLE -> Skórovací online systém pre robotické súťaže", - "Ronald Zalacko -> HAS_WORK_YEAR -> 2026" + "Ronald Zalacko -> AUTHORED -> Thesis(title=Skórovací online systém pre robotické súťaže, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14220,7 +16093,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Skórovací online systém pre robotické súťaže" }, { @@ -14229,12 +16102,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Ronald Zalacko -> HAS_WORK_TITLE -> Skórovací online systém pre robotické súťaže", - "Ronald Zalacko -> HAS_WORK_YEAR -> 2026" + "Ronald Zalacko -> AUTHORED -> Thesis(title=Skórovací online systém pre robotické súťaže, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14271,7 +16147,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" }, { @@ -14280,12 +16156,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_WORK_TITLE -> Inteligentný agent pre podporu práce špeciálneho pedagóga", - "Rostyslav Rodzhuk -> HAS_WORK_YEAR -> 2026" + "Rostyslav Rodzhuk -> AUTHORED -> Thesis(title=Inteligentný agent pre podporu práce špeciálneho pedagóga, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14322,7 +16201,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" }, { @@ -14331,12 +16210,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Rostyslav Rodzhuk -> HAS_WORK_TITLE -> Inteligentný agent pre podporu práce špeciálneho pedagóga", - "Rostyslav Rodzhuk -> HAS_WORK_YEAR -> 2026" + "Rostyslav Rodzhuk -> AUTHORED -> Thesis(title=Inteligentný agent pre podporu práce špeciálneho pedagóga, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14373,7 +16255,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Dialógový systém pre podporu firemných procesov" }, { @@ -14382,12 +16264,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Samuel Džurina -> HAS_WORK_TITLE -> Dialógový systém pre podporu firemných procesov", - "Samuel Džurina -> HAS_WORK_YEAR -> 2026" + "Samuel Džurina -> AUTHORED -> Thesis(title=Dialógový systém pre podporu firemných procesov, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14424,7 +16309,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Dialógový systém pre podporu firemných procesov" }, { @@ -14433,12 +16318,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Samuel Džurina -> HAS_WORK_TITLE -> Dialógový systém pre podporu firemných procesov", - "Samuel Džurina -> HAS_WORK_YEAR -> 2026" + "Samuel Džurina -> AUTHORED -> Thesis(title=Dialógový systém pre podporu firemných procesov, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14475,7 +16363,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" }, { @@ -14484,12 +16372,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Samuel Vasiľ -> HAS_WORK_TITLE -> Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI", - "Samuel Vasiľ -> HAS_WORK_YEAR -> 2026" + "Samuel Vasiľ -> AUTHORED -> Thesis(title=Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14526,7 +16417,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" }, { @@ -14535,12 +16426,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Samuel Vasiľ -> HAS_WORK_TITLE -> Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI", - "Samuel Vasiľ -> HAS_WORK_YEAR -> 2026" + "Samuel Vasiľ -> AUTHORED -> Thesis(title=Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14577,7 +16471,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Automatická sumarizácia slovenského textu" }, { @@ -14586,12 +16480,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Simona Bobrovčanová -> HAS_WORK_TITLE -> Automatická sumarizácia slovenského textu", - "Simona Bobrovčanová -> HAS_WORK_YEAR -> 2026" + "Simona Bobrovčanová -> AUTHORED -> Thesis(title=Automatická sumarizácia slovenského textu, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14628,7 +16525,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Automatická sumarizácia slovenského textu" }, { @@ -14637,12 +16534,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Simona Bobrovčanová -> HAS_WORK_TITLE -> Automatická sumarizácia slovenského textu", - "Simona Bobrovčanová -> HAS_WORK_YEAR -> 2026" + "Simona Bobrovčanová -> AUTHORED -> Thesis(title=Automatická sumarizácia slovenského textu, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14679,7 +16579,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" }, { @@ -14688,12 +16588,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Tetiana Mohorian -> HAS_WORK_TITLE -> Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", - "Tetiana Mohorian -> HAS_WORK_YEAR -> 2025" + "Tetiana Mohorian -> AUTHORED -> Thesis(title=Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov, year=2025)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14730,7 +16633,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" }, { @@ -14739,12 +16642,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Tetiana Mohorian -> HAS_WORK_TITLE -> Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", - "Tetiana Mohorian -> HAS_WORK_YEAR -> 2025" + "Tetiana Mohorian -> AUTHORED -> Thesis(title=Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov, year=2025)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14781,7 +16687,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" }, { @@ -14790,12 +16696,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Tomáš Kuchárik -> HAS_WORK_TITLE -> Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", - "Tomáš Kuchárik -> HAS_WORK_YEAR -> 2022" + "Tomáš Kuchárik -> AUTHORED -> Thesis(title=Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14832,7 +16741,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" }, { @@ -14841,12 +16750,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Tomáš Kuchárik -> HAS_WORK_TITLE -> Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", - "Tomáš Kuchárik -> HAS_WORK_YEAR -> 2022" + "Tomáš Kuchárik -> AUTHORED -> Thesis(title=Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu, year=2022)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14883,7 +16795,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" }, { @@ -14892,12 +16804,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Valerii Kutsenko -> HAS_WORK_TITLE -> Zlepšenie vyhľadávania pomocou znalostných grafov", - "Valerii Kutsenko -> HAS_WORK_YEAR -> 2027" + "Valerii Kutsenko -> AUTHORED -> Thesis(title=Zlepšenie vyhľadávania pomocou znalostných grafov, year=2027)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14934,7 +16849,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" }, { @@ -14943,12 +16858,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Valerii Kutsenko -> HAS_WORK_TITLE -> Zlepšenie vyhľadávania pomocou znalostných grafov", - "Valerii Kutsenko -> HAS_WORK_YEAR -> 2027" + "Valerii Kutsenko -> AUTHORED -> Thesis(title=Zlepšenie vyhľadávania pomocou znalostných grafov, year=2027)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -14985,7 +16903,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" }, { @@ -14994,12 +16912,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Vladimír Ferko -> HAS_WORK_TITLE -> Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", - "Vladimír Ferko -> HAS_WORK_YEAR -> 2024" + "Vladimír Ferko -> AUTHORED -> Thesis(title=Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči, year=2024)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -15036,7 +16957,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" }, { @@ -15045,12 +16966,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Vladimír Ferko -> HAS_WORK_TITLE -> Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", - "Vladimír Ferko -> HAS_WORK_YEAR -> 2024" + "Vladimír Ferko -> AUTHORED -> Thesis(title=Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči, year=2024)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -15087,7 +17011,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" }, { @@ -15096,12 +17020,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Vladyslav Yanchenko -> HAS_WORK_TITLE -> Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí", - "Vladyslav Yanchenko -> HAS_WORK_YEAR -> 2025" + "Vladyslav Yanchenko -> AUTHORED -> Thesis(title=Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí, year=2025)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -15138,7 +17065,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" }, { @@ -15147,12 +17074,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Vladyslav Yanchenko -> HAS_WORK_TITLE -> Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí", - "Vladyslav Yanchenko -> HAS_WORK_YEAR -> 2025" + "Vladyslav Yanchenko -> AUTHORED -> Thesis(title=Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí, year=2025)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -15189,7 +17119,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Získavanie textu z webových stránok" }, { @@ -15198,12 +17128,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Yevhenii Medushivskyi -> HAS_WORK_TITLE -> Získavanie textu z webových stránok", - "Yevhenii Medushivskyi -> HAS_WORK_YEAR -> 2026" + "Yevhenii Medushivskyi -> AUTHORED -> Thesis(title=Získavanie textu z webových stránok, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -15240,7 +17173,7 @@ ], "expected_entities": [ { - "type": "work_title", + "type": "thesis_title", "value": "Získavanie textu z webových stránok" }, { @@ -15249,12 +17182,15 @@ } ], "expected_relations": [ - "HAS_WORK_TITLE", - "HAS_WORK_YEAR" + "AUTHORED" ], "expected_paths": [ - "Yevhenii Medushivskyi -> HAS_WORK_TITLE -> Získavanie textu z webových stránok", - "Yevhenii Medushivskyi -> HAS_WORK_YEAR -> 2026" + "Yevhenii Medushivskyi -> AUTHORED -> Thesis(title=Získavanie textu z webových stránok, year=2026)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title", + "Thesis.year" ] }, "evidence_basis": [ @@ -15264,9 +17200,9 @@ { "id": "g0295", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Vladyslav Yanchenko, ak jej dokument zároveň súvisí s témou cloud?", + "question": "Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo cloud?", "expected_documents": [ "pages/students/2022/vladyslav_yanchenko/README.md" ], @@ -15291,21 +17227,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "cloud" }, { - "type": "work_title", + "type": "thesis_title", "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Vladyslav Yanchenko -> MENTIONS_TOPIC -> cloud", - "Vladyslav Yanchenko -> HAS_WORK_TITLE -> Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + "Vladyslav Yanchenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> cloud", + "Vladyslav Yanchenko -> AUTHORED -> Thesis(title=Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15315,9 +17256,9 @@ { "id": "g0296", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Simona Bobrovčanová, ak jej dokument zároveň súvisí s témou slovenský text?", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo slovenský text?", "expected_documents": [ "pages/students/2023/simona_bobrovcanova/README.md" ], @@ -15342,21 +17283,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "slovenský text" }, { - "type": "work_title", + "type": "thesis_title", "value": "Automatická sumarizácia slovenského textu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Simona Bobrovčanová -> MENTIONS_TOPIC -> slovenský text", - "Simona Bobrovčanová -> HAS_WORK_TITLE -> Automatická sumarizácia slovenského textu" + "Simona Bobrovčanová -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenský text", + "Simona Bobrovčanová -> AUTHORED -> Thesis(title=Automatická sumarizácia slovenského textu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15366,9 +17312,9 @@ { "id": "g0297", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Kristián Sopkovič, ak jej dokument zároveň súvisí s témou transformery?", + "question": "Aký je názov práce osoby Kristián Sopkovič, ak jej dokument zároveň obsahuje kľúčové slovo transformery?", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md" ], @@ -15393,21 +17339,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "transformery" }, { - "type": "work_title", + "type": "thesis_title", "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Kristián Sopkovič -> MENTIONS_TOPIC -> transformery", - "Kristián Sopkovič -> HAS_WORK_TITLE -> Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> transformery", + "Kristián Sopkovič -> AUTHORED -> Thesis(title=Model Spacy pre spracovanie prirodzeného jazyka v slovenčine)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15417,9 +17368,9 @@ { "id": "g0298", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Tetiana Mohorian, ak jej dokument zároveň súvisí s témou hate speech?", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?", "expected_documents": [ "pages/students/2022/tetiana_mohorian/README.md" ], @@ -15444,21 +17395,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "hate speech" }, { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Tetiana Mohorian -> MENTIONS_TOPIC -> hate speech", - "Tetiana Mohorian -> HAS_WORK_TITLE -> Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + "Tetiana Mohorian -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> hate speech", + "Tetiana Mohorian -> AUTHORED -> Thesis(title=Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15468,9 +17424,9 @@ { "id": "g0299", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Matej Ščišľak, ak jej dokument zároveň súvisí s témou FAISS?", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?", "expected_documents": [ "pages/students/2021/matej_scislak/README.md" ], @@ -15495,21 +17451,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "FAISS" }, { - "type": "work_title", + "type": "thesis_title", "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Matej Ščišľak -> MENTIONS_TOPIC -> FAISS", - "Matej Ščišľak -> HAS_WORK_TITLE -> Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> FAISS", + "Matej Ščišľak -> AUTHORED -> Thesis(title=Znalostné grafy pre zlepšenie vyhľadávania právnych informácií)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15519,9 +17480,9 @@ { "id": "g0300", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ján Pták, ak jej dokument zároveň súvisí s témou OpenWebUI?", + "question": "Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?", "expected_documents": [ "pages/students/2022/jan_ptak/README.md" ], @@ -15546,7 +17507,7 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "OpenWebUI" }, { @@ -15555,12 +17516,17 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" ], "expected_paths": [ - "Ján Pták -> MENTIONS_TOPIC -> OpenWebUI", - "Ján Pták -> HAS_WORK_TITLE -> Agent pre manažment záverečných prác" + "Ján Pták -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> OpenWebUI", + "Ján Pták -> HAS_WORK -> Work(title=Agent pre manažment záverečných prác)" + ], + "schema_version": 2, + "expected_properties": [ + "Work.title" ] }, "evidence_basis": [ @@ -15570,9 +17536,9 @@ { "id": "g0301", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Matej Ščišľak, ak jej dokument zároveň súvisí s témou Neo4J?", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo Neo4J?", "expected_documents": [ "pages/students/2021/matej_scislak/README.md" ], @@ -15597,21 +17563,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Neo4J" }, { - "type": "work_title", + "type": "thesis_title", "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Matej Ščišľak -> MENTIONS_TOPIC -> Neo4J", - "Matej Ščišľak -> HAS_WORK_TITLE -> Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Neo4J", + "Matej Ščišľak -> AUTHORED -> Thesis(title=Znalostné grafy pre zlepšenie vyhľadávania právnych informácií)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15621,9 +17592,9 @@ { "id": "g0302", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Tetiana Mohorian, ak jej dokument zároveň súvisí s témou prompting?", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo prompting?", "expected_documents": [ "pages/students/2022/tetiana_mohorian/README.md" ], @@ -15648,21 +17619,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "prompting" }, { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Tetiana Mohorian -> MENTIONS_TOPIC -> prompting", - "Tetiana Mohorian -> HAS_WORK_TITLE -> Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + "Tetiana Mohorian -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> prompting", + "Tetiana Mohorian -> AUTHORED -> Thesis(title=Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15672,9 +17648,9 @@ { "id": "g0303", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Maroš Harahus, ak jej dokument zároveň súvisí s témou morfologická anotácia?", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo morfologická anotácia?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md" ], @@ -15699,21 +17675,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "morfologická anotácia" }, { - "type": "work_title", + "type": "thesis_title", "value": "Neurónová morfologická anotácia slovenského jazyka" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> morfologická anotácia", - "Maroš Harahus -> HAS_WORK_TITLE -> Neurónová morfologická anotácia slovenského jazyka" + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> morfologická anotácia", + "Maroš Harahus -> AUTHORED -> Thesis(title=Neurónová morfologická anotácia slovenského jazyka)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15723,9 +17704,9 @@ { "id": "g0304", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Tomáš Kuchárik, ak jej dokument zároveň súvisí s témou SQuAD?", + "question": "Aký je názov práce osoby Tomáš Kuchárik, ak jej dokument zároveň obsahuje kľúčové slovo SQuAD?", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md" ], @@ -15750,21 +17731,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "SQuAD" }, { - "type": "work_title", + "type": "thesis_title", "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Tomáš Kuchárik -> MENTIONS_TOPIC -> SQuAD", - "Tomáš Kuchárik -> HAS_WORK_TITLE -> Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> SQuAD", + "Tomáš Kuchárik -> AUTHORED -> Thesis(title=Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15774,9 +17760,9 @@ { "id": "g0305", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ján Pták, ak jej dokument zároveň súvisí s témou Docker?", + "question": "Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo Docker?", "expected_documents": [ "pages/students/2022/jan_ptak/README.md" ], @@ -15801,7 +17787,7 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Docker" }, { @@ -15810,12 +17796,17 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" ], "expected_paths": [ - "Ján Pták -> MENTIONS_TOPIC -> Docker", - "Ján Pták -> HAS_WORK_TITLE -> Agent pre manažment záverečných prác" + "Ján Pták -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Docker", + "Ján Pták -> HAS_WORK -> Work(title=Agent pre manažment záverečných prác)" + ], + "schema_version": 2, + "expected_properties": [ + "Work.title" ] }, "evidence_basis": [ @@ -15825,9 +17816,9 @@ { "id": "g0306", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Denis Le Thanh, ak jej dokument zároveň súvisí s témou inštrukcie?", + "question": "Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo inštrukcie?", "expected_documents": [ "pages/students/2023/denis_le_thanh/README.md" ], @@ -15852,21 +17843,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "inštrukcie" }, { - "type": "work_title", + "type": "thesis_title", "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Denis Le Thanh -> MENTIONS_TOPIC -> inštrukcie", - "Denis Le Thanh -> HAS_WORK_TITLE -> Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + "Denis Le Thanh -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> inštrukcie", + "Denis Le Thanh -> AUTHORED -> Thesis(title=Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15876,9 +17872,9 @@ { "id": "g0307", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Martin Šarišský, ak jej dokument zároveň súvisí s témou právne informácie?", + "question": "Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo právne informácie?", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md" ], @@ -15903,21 +17899,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "právne informácie" }, { - "type": "work_title", + "type": "thesis_title", "value": "Agentové systémy pomocou veľkého jazykového modelu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Martin Šarišský -> MENTIONS_TOPIC -> právne informácie", - "Martin Šarišský -> HAS_WORK_TITLE -> Agentové systémy pomocou veľkého jazykového modelu" + "Martin Šarišský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> právne informácie", + "Martin Šarišský -> AUTHORED -> Thesis(title=Agentové systémy pomocou veľkého jazykového modelu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -15927,9 +17928,9 @@ { "id": "g0308", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ján Malinovský, ak jej dokument zároveň súvisí s témou RAG?", + "question": "Aký je názov práce osoby Ján Malinovský, ak jej dokument zároveň obsahuje kľúčové slovo RAG?", "expected_documents": [ "pages/students/2022/jan_malinovsky/README.md" ], @@ -15954,7 +17955,7 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "RAG" }, { @@ -15963,12 +17964,17 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" ], "expected_paths": [ - "Ján Malinovský -> MENTIONS_TOPIC -> RAG", - "Ján Malinovský -> HAS_WORK_TITLE -> Grafové vyhľadávanie pre podporu vzdelávania" + "Ján Malinovský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> RAG", + "Ján Malinovský -> HAS_WORK -> Work(title=Grafové vyhľadávanie pre podporu vzdelávania)" + ], + "schema_version": 2, + "expected_properties": [ + "Work.title" ] }, "evidence_basis": [ @@ -15978,9 +17984,9 @@ { "id": "g0309", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Patrik Pavlišin, ak jej dokument zároveň súvisí s témou automatický preklad?", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo automatický preklad?", "expected_documents": [ "pages/students/2016/patrik_pavlisin/README.md" ], @@ -16005,21 +18011,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "automatický preklad" }, { - "type": "work_title", + "type": "thesis_title", "value": "Metódy automatického prekladu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Patrik Pavlišin -> MENTIONS_TOPIC -> automatický preklad", - "Patrik Pavlišin -> HAS_WORK_TITLE -> Metódy automatického prekladu" + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> automatický preklad", + "Patrik Pavlišin -> AUTHORED -> Thesis(title=Metódy automatického prekladu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16029,9 +18040,9 @@ { "id": "g0310", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Eduard Matovka, ak jej dokument zároveň súvisí s témou SlovakAlpaca?", + "question": "Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo SlovakAlpaca?", "expected_documents": [ "pages/students/2021/eduard_matovka/README.md" ], @@ -16056,21 +18067,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "SlovakAlpaca" }, { - "type": "work_title", + "type": "thesis_title", "value": "Slovenská konverzačná umelá inteligencia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Eduard Matovka -> MENTIONS_TOPIC -> SlovakAlpaca", - "Eduard Matovka -> HAS_WORK_TITLE -> Slovenská konverzačná umelá inteligencia" + "Eduard Matovka -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> SlovakAlpaca", + "Eduard Matovka -> AUTHORED -> Thesis(title=Slovenská konverzačná umelá inteligencia)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16080,9 +18096,9 @@ { "id": "g0311", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Dárius Lindvai, ak jej dokument zároveň súvisí s témou BiLSTM?", + "question": "Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo BiLSTM?", "expected_documents": [ "pages/students/2016/darius_lindvai/README.md" ], @@ -16107,21 +18123,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "BiLSTM" }, { - "type": "work_title", + "type": "thesis_title", "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Dárius Lindvai -> MENTIONS_TOPIC -> BiLSTM", - "Dárius Lindvai -> HAS_WORK_TITLE -> Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + "Dárius Lindvai -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> BiLSTM", + "Dárius Lindvai -> AUTHORED -> Thesis(title=Obnovenie interpunkcie pomocou hlbokých neurónových sietí)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16131,9 +18152,9 @@ { "id": "g0312", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Lukáš Pokrývka, ak jej dokument zároveň súvisí s témou NCCL?", + "question": "Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo NCCL?", "expected_documents": [ "pages/students/2016/lukas_pokryvka/README.md" ], @@ -16158,21 +18179,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "NCCL" }, { - "type": "work_title", + "type": "thesis_title", "value": "Paralelné trénovanie neurónových sietí" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Lukáš Pokrývka -> MENTIONS_TOPIC -> NCCL", - "Lukáš Pokrývka -> HAS_WORK_TITLE -> Paralelné trénovanie neurónových sietí" + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> NCCL", + "Lukáš Pokrývka -> AUTHORED -> Thesis(title=Paralelné trénovanie neurónových sietí)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16182,9 +18208,9 @@ { "id": "g0313", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ronald Zalacko, ak jej dokument zároveň súvisí s témou Docker?", + "question": "Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo Docker?", "expected_documents": [ "pages/students/2023/ronald_zalacko/README.md" ], @@ -16209,21 +18235,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Docker" }, { - "type": "work_title", + "type": "thesis_title", "value": "Skórovací online systém pre robotické súťaže" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Ronald Zalacko -> MENTIONS_TOPIC -> Docker", - "Ronald Zalacko -> HAS_WORK_TITLE -> Skórovací online systém pre robotické súťaže" + "Ronald Zalacko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Docker", + "Ronald Zalacko -> AUTHORED -> Thesis(title=Skórovací online systém pre robotické súťaže)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16233,9 +18264,9 @@ { "id": "g0314", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Samuel Džurina, ak jej dokument zároveň súvisí s témou zásielková spoločnosť?", + "question": "Aký je názov práce osoby Samuel Džurina, ak jej dokument zároveň obsahuje kľúčové slovo zásielková spoločnosť?", "expected_documents": [ "pages/students/2023/samuel_dzurina/README.md" ], @@ -16260,21 +18291,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "zásielková spoločnosť" }, { - "type": "work_title", + "type": "thesis_title", "value": "Dialógový systém pre podporu firemných procesov" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Samuel Džurina -> MENTIONS_TOPIC -> zásielková spoločnosť", - "Samuel Džurina -> HAS_WORK_TITLE -> Dialógový systém pre podporu firemných procesov" + "Samuel Džurina -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> zásielková spoločnosť", + "Samuel Džurina -> AUTHORED -> Thesis(title=Dialógový systém pre podporu firemných procesov)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16284,9 +18320,9 @@ { "id": "g0315", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Samuel Vasiľ, ak jej dokument zároveň súvisí s témou RAG?", + "question": "Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo RAG?", "expected_documents": [ "pages/students/2022/samuel_vasil/README.md" ], @@ -16311,21 +18347,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "RAG" }, { - "type": "work_title", + "type": "thesis_title", "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Samuel Vasiľ -> MENTIONS_TOPIC -> RAG", - "Samuel Vasiľ -> HAS_WORK_TITLE -> Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + "Samuel Vasiľ -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> RAG", + "Samuel Vasiľ -> AUTHORED -> Thesis(title=Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16335,9 +18376,9 @@ { "id": "g0316", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Valerii Kutsenko, ak jej dokument zároveň súvisí s témou znalostný graf?", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo znalostný graf?", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md" ], @@ -16362,21 +18403,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "znalostný graf" }, { - "type": "work_title", + "type": "thesis_title", "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Valerii Kutsenko -> MENTIONS_TOPIC -> znalostný graf", - "Valerii Kutsenko -> HAS_WORK_TITLE -> Zlepšenie vyhľadávania pomocou znalostných grafov" + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf", + "Valerii Kutsenko -> AUTHORED -> Thesis(title=Zlepšenie vyhľadávania pomocou znalostných grafov)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16386,9 +18432,9 @@ { "id": "g0317", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Oleh Poiasnik, ak jej dokument zároveň súvisí s témou lekáreň?", + "question": "Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo lekáreň?", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md" ], @@ -16413,21 +18459,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "lekáreň" }, { - "type": "work_title", + "type": "thesis_title", "value": "Expertný agentový systém na podporu rozhodovania v lekárni" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Oleh Poiasnik -> MENTIONS_TOPIC -> lekáreň", - "Oleh Poiasnik -> HAS_WORK_TITLE -> Expertný agentový systém na podporu rozhodovania v lekárni" + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> lekáreň", + "Oleh Poiasnik -> AUTHORED -> Thesis(title=Expertný agentový systém na podporu rozhodovania v lekárni)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16437,9 +18488,9 @@ { "id": "g0318", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Dmytro Ushatenko, ak jej dokument zároveň súvisí s témou chatbot?", + "question": "Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo chatbot?", "expected_documents": [ "pages/students/2017/dmytro_ushatenko/README.md" ], @@ -16464,21 +18515,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "chatbot" }, { - "type": "work_title", + "type": "thesis_title", "value": "Jednoduchý chatbot v jazyku Python" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Dmytro Ushatenko -> MENTIONS_TOPIC -> chatbot", - "Dmytro Ushatenko -> HAS_WORK_TITLE -> Jednoduchý chatbot v jazyku Python" + "Dmytro Ushatenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> chatbot", + "Dmytro Ushatenko -> AUTHORED -> Thesis(title=Jednoduchý chatbot v jazyku Python)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16488,9 +18544,9 @@ { "id": "g0319", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Maroš Harahus, ak jej dokument zároveň súvisí s témou grafové neurónové siete?", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo grafové neurónové siete?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md" ], @@ -16515,21 +18571,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "grafové neurónové siete" }, { - "type": "work_title", + "type": "thesis_title", "value": "Neurónová morfologická anotácia slovenského jazyka" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> grafové neurónové siete", - "Maroš Harahus -> HAS_WORK_TITLE -> Neurónová morfologická anotácia slovenského jazyka" + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> grafové neurónové siete", + "Maroš Harahus -> AUTHORED -> Thesis(title=Neurónová morfologická anotácia slovenského jazyka)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16539,9 +18600,9 @@ { "id": "g0320", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Dmytro Ushatenko, ak jej dokument zároveň súvisí s témou Python?", + "question": "Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo Python?", "expected_documents": [ "pages/students/2017/dmytro_ushatenko/README.md" ], @@ -16566,21 +18627,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Python" }, { - "type": "work_title", + "type": "thesis_title", "value": "Jednoduchý chatbot v jazyku Python" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Dmytro Ushatenko -> MENTIONS_TOPIC -> Python", - "Dmytro Ushatenko -> HAS_WORK_TITLE -> Jednoduchý chatbot v jazyku Python" + "Dmytro Ushatenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Python", + "Dmytro Ushatenko -> AUTHORED -> Thesis(title=Jednoduchý chatbot v jazyku Python)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16590,9 +18656,9 @@ { "id": "g0321", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Martin Wencel, ak jej dokument zároveň súvisí s témou morfologická analýza?", + "question": "Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo morfologická analýza?", "expected_documents": [ "pages/students/2018/martin_wencel/README.md" ], @@ -16617,21 +18683,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "morfologická analýza" }, { - "type": "work_title", + "type": "thesis_title", "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Martin Wencel -> MENTIONS_TOPIC -> morfologická analýza", - "Martin Wencel -> HAS_WORK_TITLE -> Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + "Martin Wencel -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> morfologická analýza", + "Martin Wencel -> AUTHORED -> Thesis(title=Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16641,9 +18712,9 @@ { "id": "g0322", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Artem Yatsenko, ak jej dokument zároveň súvisí s témou anotácia?", + "question": "Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?", "expected_documents": [ "pages/students/2019/artem_yatsenko/README.md" ], @@ -16668,21 +18739,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "anotácia" }, { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Artem Yatsenko -> MENTIONS_TOPIC -> anotácia", - "Artem Yatsenko -> HAS_WORK_TITLE -> Rozpoznávanie pomenovaných entít v slovenskom jazyku" + "Artem Yatsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> anotácia", + "Artem Yatsenko -> AUTHORED -> Thesis(title=Rozpoznávanie pomenovaných entít v slovenskom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16692,9 +18768,9 @@ { "id": "g0323", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Simona Bobrovčanová, ak jej dokument zároveň súvisí s témou sumarizácia?", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo sumarizácia?", "expected_documents": [ "pages/students/2023/simona_bobrovcanova/README.md" ], @@ -16719,21 +18795,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "sumarizácia" }, { - "type": "work_title", + "type": "thesis_title", "value": "Automatická sumarizácia slovenského textu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Simona Bobrovčanová -> MENTIONS_TOPIC -> sumarizácia", - "Simona Bobrovčanová -> HAS_WORK_TITLE -> Automatická sumarizácia slovenského textu" + "Simona Bobrovčanová -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> sumarizácia", + "Simona Bobrovčanová -> AUTHORED -> Thesis(title=Automatická sumarizácia slovenského textu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16743,9 +18824,9 @@ { "id": "g0324", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Patrik Pavlišin, ak jej dokument zároveň súvisí s témou strojový preklad?", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?", "expected_documents": [ "pages/students/2016/patrik_pavlisin/README.md" ], @@ -16770,21 +18851,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" }, { - "type": "work_title", + "type": "thesis_title", "value": "Metódy automatického prekladu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Patrik Pavlišin -> MENTIONS_TOPIC -> strojový preklad", - "Patrik Pavlišin -> HAS_WORK_TITLE -> Metódy automatického prekladu" + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad", + "Patrik Pavlišin -> AUTHORED -> Thesis(title=Metódy automatického prekladu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16794,9 +18880,9 @@ { "id": "g0325", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Andrii Pervashov, ak jej dokument zároveň súvisí s témou speech-to-text?", + "question": "Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo speech-to-text?", "expected_documents": [ "pages/students/2022/andrii_pervashov/README.md" ], @@ -16821,21 +18907,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "speech-to-text" }, { - "type": "work_title", + "type": "thesis_title", "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Andrii Pervashov -> MENTIONS_TOPIC -> speech-to-text", - "Andrii Pervashov -> HAS_WORK_TITLE -> Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> speech-to-text", + "Andrii Pervashov -> AUTHORED -> Thesis(title=Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16845,9 +18936,9 @@ { "id": "g0326", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ronald Zalacko, ak jej dokument zároveň súvisí s témou robotické súťaže?", + "question": "Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo robotické súťaže?", "expected_documents": [ "pages/students/2023/ronald_zalacko/README.md" ], @@ -16872,21 +18963,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "robotické súťaže" }, { - "type": "work_title", + "type": "thesis_title", "value": "Skórovací online systém pre robotické súťaže" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Ronald Zalacko -> MENTIONS_TOPIC -> robotické súťaže", - "Ronald Zalacko -> HAS_WORK_TITLE -> Skórovací online systém pre robotické súťaže" + "Ronald Zalacko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> robotické súťaže", + "Ronald Zalacko -> AUTHORED -> Thesis(title=Skórovací online systém pre robotické súťaže)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16896,9 +18992,9 @@ { "id": "g0327", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ján Holp, ak jej dokument zároveň súvisí s témou získavanie informácií?", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo získavanie informácií?", "expected_documents": [ "pages/students/2016/jan_holp/README.md" ], @@ -16923,21 +19019,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "získavanie informácií" }, { - "type": "work_title", + "type": "thesis_title", "value": "Systém získavania informácií v slovenskom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Ján Holp -> MENTIONS_TOPIC -> získavanie informácií", - "Ján Holp -> HAS_WORK_TITLE -> Systém získavania informácií v slovenskom jazyku" + "Ján Holp -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> získavanie informácií", + "Ján Holp -> AUTHORED -> Thesis(title=Systém získavania informácií v slovenskom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16947,9 +19048,9 @@ { "id": "g0328", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň súvisí s témou špeciálny pedagóg?", + "question": "Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo špeciálny pedagóg?", "expected_documents": [ "pages/students/2023/rostyslav_rodzhuk/README.md" ], @@ -16974,21 +19075,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "špeciálny pedagóg" }, { - "type": "work_title", + "type": "thesis_title", "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Rostyslav Rodzhuk -> MENTIONS_TOPIC -> špeciálny pedagóg", - "Rostyslav Rodzhuk -> HAS_WORK_TITLE -> Inteligentný agent pre podporu práce špeciálneho pedagóga" + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> špeciálny pedagóg", + "Rostyslav Rodzhuk -> AUTHORED -> Thesis(title=Inteligentný agent pre podporu práce špeciálneho pedagóga)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -16998,9 +19104,9 @@ { "id": "g0329", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Valerii Kutsenko, ak jej dokument zároveň súvisí s témou GraphRAG?", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md" ], @@ -17025,21 +19131,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "GraphRAG" }, { - "type": "work_title", + "type": "thesis_title", "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Valerii Kutsenko -> MENTIONS_TOPIC -> GraphRAG", - "Valerii Kutsenko -> HAS_WORK_TITLE -> Zlepšenie vyhľadávania pomocou znalostných grafov" + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> GraphRAG", + "Valerii Kutsenko -> AUTHORED -> Thesis(title=Zlepšenie vyhľadávania pomocou znalostných grafov)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17049,9 +19160,9 @@ { "id": "g0330", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Tetiana Mohorian, ak jej dokument zároveň súvisí s témou LLM?", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo LLM?", "expected_documents": [ "pages/students/2022/tetiana_mohorian/README.md" ], @@ -17076,21 +19187,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "LLM" }, { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Tetiana Mohorian -> MENTIONS_TOPIC -> LLM", - "Tetiana Mohorian -> HAS_WORK_TITLE -> Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + "Tetiana Mohorian -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> LLM", + "Tetiana Mohorian -> AUTHORED -> Thesis(title=Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17100,9 +19216,9 @@ { "id": "g0331", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň súvisí s témou deduplikácia?", + "question": "Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo deduplikácia?", "expected_documents": [ "pages/students/2023/yevhenii_medushivskyi/README.md" ], @@ -17127,21 +19243,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "deduplikácia" }, { - "type": "work_title", + "type": "thesis_title", "value": "Získavanie textu z webových stránok" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Yevhenii Medushivskyi -> MENTIONS_TOPIC -> deduplikácia", - "Yevhenii Medushivskyi -> HAS_WORK_TITLE -> Získavanie textu z webových stránok" + "Yevhenii Medushivskyi -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> deduplikácia", + "Yevhenii Medushivskyi -> AUTHORED -> Thesis(title=Získavanie textu z webových stránok)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17151,9 +19272,9 @@ { "id": "g0332", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Martin Wencel, ak jej dokument zároveň súvisí s témou Spacy?", + "question": "Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?", "expected_documents": [ "pages/students/2018/martin_wencel/README.md" ], @@ -17178,21 +19299,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" }, { - "type": "work_title", + "type": "thesis_title", "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Martin Wencel -> MENTIONS_TOPIC -> Spacy", - "Martin Wencel -> HAS_WORK_TITLE -> Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + "Martin Wencel -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy", + "Martin Wencel -> AUTHORED -> Thesis(title=Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17202,9 +19328,9 @@ { "id": "g0333", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň súvisí s témou LLM?", + "question": "Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo LLM?", "expected_documents": [ "pages/students/2023/rostyslav_rodzhuk/README.md" ], @@ -17229,21 +19355,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "LLM" }, { - "type": "work_title", + "type": "thesis_title", "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Rostyslav Rodzhuk -> MENTIONS_TOPIC -> LLM", - "Rostyslav Rodzhuk -> HAS_WORK_TITLE -> Inteligentný agent pre podporu práce špeciálneho pedagóga" + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> LLM", + "Rostyslav Rodzhuk -> AUTHORED -> Thesis(title=Inteligentný agent pre podporu práce špeciálneho pedagóga)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17253,9 +19384,9 @@ { "id": "g0334", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Filip Tomáš, ak jej dokument zároveň súvisí s témou CI/CD?", + "question": "Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo CI/CD?", "expected_documents": [ "pages/students/2019/filip_tomas/README.md" ], @@ -17280,21 +19411,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "CI/CD" }, { - "type": "work_title", + "type": "thesis_title", "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Filip Tomáš -> MENTIONS_TOPIC -> CI/CD", - "Filip Tomáš -> HAS_WORK_TITLE -> Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + "Filip Tomáš -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> CI/CD", + "Filip Tomáš -> AUTHORED -> Thesis(title=Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17304,9 +19440,9 @@ { "id": "g0335", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Eduard Matovka, ak jej dokument zároveň súvisí s témou slovenský jazykový model?", + "question": "Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo slovenský jazykový model?", "expected_documents": [ "pages/students/2021/eduard_matovka/README.md" ], @@ -17331,21 +19467,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "slovenský jazykový model" }, { - "type": "work_title", + "type": "thesis_title", "value": "Slovenská konverzačná umelá inteligencia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Eduard Matovka -> MENTIONS_TOPIC -> slovenský jazykový model", - "Eduard Matovka -> HAS_WORK_TITLE -> Slovenská konverzačná umelá inteligencia" + "Eduard Matovka -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenský jazykový model", + "Eduard Matovka -> AUTHORED -> Thesis(title=Slovenská konverzačná umelá inteligencia)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17355,9 +19496,9 @@ { "id": "g0336", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Artem Yatsenko, ak jej dokument zároveň súvisí s témou pomenované entity?", + "question": "Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo pomenované entity?", "expected_documents": [ "pages/students/2019/artem_yatsenko/README.md" ], @@ -17382,21 +19523,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "pomenované entity" }, { - "type": "work_title", + "type": "thesis_title", "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Artem Yatsenko -> MENTIONS_TOPIC -> pomenované entity", - "Artem Yatsenko -> HAS_WORK_TITLE -> Rozpoznávanie pomenovaných entít v slovenskom jazyku" + "Artem Yatsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> pomenované entity", + "Artem Yatsenko -> AUTHORED -> Thesis(title=Rozpoznávanie pomenovaných entít v slovenskom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17406,9 +19552,9 @@ { "id": "g0337", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ján Holp, ak jej dokument zároveň súvisí s témou slovenský internet?", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo slovenský internet?", "expected_documents": [ "pages/students/2016/jan_holp/README.md" ], @@ -17433,21 +19579,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "slovenský internet" }, { - "type": "work_title", + "type": "thesis_title", "value": "Systém získavania informácií v slovenskom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Ján Holp -> MENTIONS_TOPIC -> slovenský internet", - "Ján Holp -> HAS_WORK_TITLE -> Systém získavania informácií v slovenskom jazyku" + "Ján Holp -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenský internet", + "Ján Holp -> AUTHORED -> Thesis(title=Systém získavania informácií v slovenskom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17457,9 +19608,9 @@ { "id": "g0338", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Oleksandr Dorybohov, ak jej dokument zároveň súvisí s témou agent?", + "question": "Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo agent?", "expected_documents": [ "pages/students/2023/oleksandr_dorybohov/README.md" ], @@ -17484,21 +19635,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "agent" }, { - "type": "work_title", + "type": "thesis_title", "value": "Automatické odpovede na otázky v právnej oblasti" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Oleksandr Dorybohov -> MENTIONS_TOPIC -> agent", - "Oleksandr Dorybohov -> HAS_WORK_TITLE -> Automatické odpovede na otázky v právnej oblasti" + "Oleksandr Dorybohov -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> agent", + "Oleksandr Dorybohov -> AUTHORED -> Thesis(title=Automatické odpovede na otázky v právnej oblasti)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17508,9 +19664,9 @@ { "id": "g0339", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Samuel Vasiľ, ak jej dokument zároveň súvisí s témou MCP?", + "question": "Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo MCP?", "expected_documents": [ "pages/students/2022/samuel_vasil/README.md" ], @@ -17535,21 +19691,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "MCP" }, { - "type": "work_title", + "type": "thesis_title", "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Samuel Vasiľ -> MENTIONS_TOPIC -> MCP", - "Samuel Vasiľ -> HAS_WORK_TITLE -> Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + "Samuel Vasiľ -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> MCP", + "Samuel Vasiľ -> AUTHORED -> Thesis(title=Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17559,9 +19720,9 @@ { "id": "g0340", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Matej Ščišľak, ak jej dokument zároveň súvisí s témou GraphRAG?", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?", "expected_documents": [ "pages/students/2021/matej_scislak/README.md" ], @@ -17586,21 +19747,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "GraphRAG" }, { - "type": "work_title", + "type": "thesis_title", "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Matej Ščišľak -> MENTIONS_TOPIC -> GraphRAG", - "Matej Ščišľak -> HAS_WORK_TITLE -> Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> GraphRAG", + "Matej Ščišľak -> AUTHORED -> Thesis(title=Znalostné grafy pre zlepšenie vyhľadávania právnych informácií)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17610,9 +19776,9 @@ { "id": "g0341", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Michal Stromko, ak jej dokument zároveň súvisí s témou Elasticsearch?", + "question": "Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo Elasticsearch?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md" ], @@ -17637,21 +19803,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Elasticsearch" }, { - "type": "work_title", + "type": "thesis_title", "value": "Indexovanie slovenského textu pomocou Elasticsearch" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Michal Stromko -> MENTIONS_TOPIC -> Elasticsearch", - "Michal Stromko -> HAS_WORK_TITLE -> Indexovanie slovenského textu pomocou Elasticsearch" + "Michal Stromko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Elasticsearch", + "Michal Stromko -> AUTHORED -> Thesis(title=Indexovanie slovenského textu pomocou Elasticsearch)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17661,9 +19832,9 @@ { "id": "g0342", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Martin Šarišský, ak jej dokument zároveň súvisí s témou agent?", + "question": "Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo agent?", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md" ], @@ -17688,21 +19859,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "agent" }, { - "type": "work_title", + "type": "thesis_title", "value": "Agentové systémy pomocou veľkého jazykového modelu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Martin Šarišský -> MENTIONS_TOPIC -> agent", - "Martin Šarišský -> HAS_WORK_TITLE -> Agentové systémy pomocou veľkého jazykového modelu" + "Martin Šarišský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> agent", + "Martin Šarišský -> AUTHORED -> Thesis(title=Agentové systémy pomocou veľkého jazykového modelu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17712,9 +19888,9 @@ { "id": "g0343", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň súvisí s témou crawler?", + "question": "Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo crawler?", "expected_documents": [ "pages/students/2023/yevhenii_medushivskyi/README.md" ], @@ -17739,21 +19915,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "crawler" }, { - "type": "work_title", + "type": "thesis_title", "value": "Získavanie textu z webových stránok" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Yevhenii Medushivskyi -> MENTIONS_TOPIC -> crawler", - "Yevhenii Medushivskyi -> HAS_WORK_TITLE -> Získavanie textu z webových stránok" + "Yevhenii Medushivskyi -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> crawler", + "Yevhenii Medushivskyi -> AUTHORED -> Thesis(title=Získavanie textu z webových stránok)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17763,9 +19944,9 @@ { "id": "g0344", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Vladimír Ferko, ak jej dokument zároveň súvisí s témou hate speech?", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?", "expected_documents": [ "pages/students/2021/vladimir_ferko/README.md" ], @@ -17790,21 +19971,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "hate speech" }, { - "type": "work_title", + "type": "thesis_title", "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Vladimír Ferko -> MENTIONS_TOPIC -> hate speech", - "Vladimír Ferko -> HAS_WORK_TITLE -> Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + "Vladimír Ferko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> hate speech", + "Vladimír Ferko -> AUTHORED -> Thesis(title=Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17814,9 +20000,9 @@ { "id": "g0345", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Maroš Harahus, ak jej dokument zároveň súvisí s témou Spacy?", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md" ], @@ -17841,21 +20027,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Spacy" }, { - "type": "work_title", + "type": "thesis_title", "value": "Neurónová morfologická anotácia slovenského jazyka" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy", - "Maroš Harahus -> HAS_WORK_TITLE -> Neurónová morfologická anotácia slovenského jazyka" + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy", + "Maroš Harahus -> AUTHORED -> Thesis(title=Neurónová morfologická anotácia slovenského jazyka)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17865,9 +20056,9 @@ { "id": "g0346", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Valerii Kutsenko, ak jej dokument zároveň súvisí s témou RAG?", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo RAG?", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md" ], @@ -17892,21 +20083,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "RAG" }, { - "type": "work_title", + "type": "thesis_title", "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Valerii Kutsenko -> MENTIONS_TOPIC -> RAG", - "Valerii Kutsenko -> HAS_WORK_TITLE -> Zlepšenie vyhľadávania pomocou znalostných grafov" + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> RAG", + "Valerii Kutsenko -> AUTHORED -> Thesis(title=Zlepšenie vyhľadávania pomocou znalostných grafov)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17916,9 +20112,9 @@ { "id": "g0347", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Patrik Pavlišin, ak jej dokument zároveň súvisí s témou paralelný korpus?", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo paralelný korpus?", "expected_documents": [ "pages/students/2016/patrik_pavlisin/README.md" ], @@ -17943,21 +20139,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "paralelný korpus" }, { - "type": "work_title", + "type": "thesis_title", "value": "Metódy automatického prekladu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Patrik Pavlišin -> MENTIONS_TOPIC -> paralelný korpus", - "Patrik Pavlišin -> HAS_WORK_TITLE -> Metódy automatického prekladu" + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> paralelný korpus", + "Patrik Pavlišin -> AUTHORED -> Thesis(title=Metódy automatického prekladu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -17967,9 +20168,9 @@ { "id": "g0348", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Vladimír Ferko, ak jej dokument zároveň súvisí s témou SlovakBERT?", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo SlovakBERT?", "expected_documents": [ "pages/students/2021/vladimir_ferko/README.md" ], @@ -17994,21 +20195,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "SlovakBERT" }, { - "type": "work_title", + "type": "thesis_title", "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Vladimír Ferko -> MENTIONS_TOPIC -> SlovakBERT", - "Vladimír Ferko -> HAS_WORK_TITLE -> Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + "Vladimír Ferko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> SlovakBERT", + "Vladimír Ferko -> AUTHORED -> Thesis(title=Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18018,9 +20224,9 @@ { "id": "g0349", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Vladimír Ferko, ak jej dokument zároveň súvisí s témou anotácia?", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?", "expected_documents": [ "pages/students/2021/vladimir_ferko/README.md" ], @@ -18045,21 +20251,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "anotácia" }, { - "type": "work_title", + "type": "thesis_title", "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Vladimír Ferko -> MENTIONS_TOPIC -> anotácia", - "Vladimír Ferko -> HAS_WORK_TITLE -> Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + "Vladimír Ferko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> anotácia", + "Vladimír Ferko -> AUTHORED -> Thesis(title=Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18069,9 +20280,9 @@ { "id": "g0350", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Lukáš Pokrývka, ak jej dokument zároveň súvisí s témou PyTorch?", + "question": "Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo PyTorch?", "expected_documents": [ "pages/students/2016/lukas_pokryvka/README.md" ], @@ -18096,21 +20307,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "PyTorch" }, { - "type": "work_title", + "type": "thesis_title", "value": "Paralelné trénovanie neurónových sietí" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Lukáš Pokrývka -> MENTIONS_TOPIC -> PyTorch", - "Lukáš Pokrývka -> HAS_WORK_TITLE -> Paralelné trénovanie neurónových sietí" + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> PyTorch", + "Lukáš Pokrývka -> AUTHORED -> Thesis(title=Paralelné trénovanie neurónových sietí)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18120,9 +20336,9 @@ { "id": "g0351", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Filip Tomáš, ak jej dokument zároveň súvisí s témou Docker Compose?", + "question": "Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo Docker Compose?", "expected_documents": [ "pages/students/2019/filip_tomas/README.md" ], @@ -18147,21 +20363,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Docker Compose" }, { - "type": "work_title", + "type": "thesis_title", "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Filip Tomáš -> MENTIONS_TOPIC -> Docker Compose", - "Filip Tomáš -> HAS_WORK_TITLE -> Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + "Filip Tomáš -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Docker Compose", + "Filip Tomáš -> AUTHORED -> Thesis(title=Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18171,9 +20392,9 @@ { "id": "g0352", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Alina Vitko, ak jej dokument zároveň súvisí s témou Streamlit?", + "question": "Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Streamlit?", "expected_documents": [ "pages/students/2019/alina_vitko/README.md" ], @@ -18198,21 +20419,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Streamlit" }, { - "type": "work_title", + "type": "thesis_title", "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Alina Vitko -> MENTIONS_TOPIC -> Streamlit", - "Alina Vitko -> HAS_WORK_TITLE -> Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + "Alina Vitko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Streamlit", + "Alina Vitko -> AUTHORED -> Thesis(title=Systémy pre generovanie odpovede na otázku v prirodzenom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18222,9 +20448,9 @@ { "id": "g0353", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Dominik Nagy, ak jej dokument zároveň súvisí s témou strojový preklad?", + "question": "Aký je názov práce osoby Dominik Nagy, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?", "expected_documents": [ "pages/students/2016/dominik_nagy/README.md" ], @@ -18249,21 +20475,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "strojový preklad" }, { - "type": "work_title", + "type": "thesis_title", "value": "Neurónový strojový preklad pomocou knižnice Fairseq" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Dominik Nagy -> MENTIONS_TOPIC -> strojový preklad", - "Dominik Nagy -> HAS_WORK_TITLE -> Neurónový strojový preklad pomocou knižnice Fairseq" + "Dominik Nagy -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> strojový preklad", + "Dominik Nagy -> AUTHORED -> Thesis(title=Neurónový strojový preklad pomocou knižnice Fairseq)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18273,9 +20504,9 @@ { "id": "g0354", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ondrej Megela, ak jej dokument zároveň súvisí s témou BERT?", + "question": "Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo BERT?", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md" ], @@ -18300,21 +20531,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "BERT" }, { - "type": "work_title", + "type": "thesis_title", "value": "Neurónové jazykové modelovanie typu BERT" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Ondrej Megela -> MENTIONS_TOPIC -> BERT", - "Ondrej Megela -> HAS_WORK_TITLE -> Neurónové jazykové modelovanie typu BERT" + "Ondrej Megela -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> BERT", + "Ondrej Megela -> AUTHORED -> Thesis(title=Neurónové jazykové modelovanie typu BERT)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18324,9 +20560,9 @@ { "id": "g0355", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ján Holp, ak jej dokument zároveň súvisí s témou PageRank?", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo PageRank?", "expected_documents": [ "pages/students/2016/jan_holp/README.md" ], @@ -18351,21 +20587,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "PageRank" }, { - "type": "work_title", + "type": "thesis_title", "value": "Systém získavania informácií v slovenskom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Ján Holp -> MENTIONS_TOPIC -> PageRank", - "Ján Holp -> HAS_WORK_TITLE -> Systém získavania informácií v slovenskom jazyku" + "Ján Holp -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> PageRank", + "Ján Holp -> AUTHORED -> Thesis(title=Systém získavania informácií v slovenskom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18375,9 +20616,9 @@ { "id": "g0356", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Márk Fehér, ak jej dokument zároveň súvisí s témou klasifikácia textu?", + "question": "Aký je názov práce osoby Márk Fehér, ak jej dokument zároveň obsahuje kľúčové slovo klasifikácia textu?", "expected_documents": [ "pages/students/2016/mark_feher/README.md" ], @@ -18402,21 +20643,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "klasifikácia textu" }, { - "type": "work_title", + "type": "thesis_title", "value": "Klasifikácia textu metódami strojového učenia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Márk Fehér -> MENTIONS_TOPIC -> klasifikácia textu", - "Márk Fehér -> HAS_WORK_TITLE -> Klasifikácia textu metódami strojového učenia" + "Márk Fehér -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> klasifikácia textu", + "Márk Fehér -> AUTHORED -> Thesis(title=Klasifikácia textu metódami strojového učenia)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18426,9 +20672,9 @@ { "id": "g0357", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Denis Le Thanh, ak jej dokument zároveň súvisí s témou Slovak Mistral?", + "question": "Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo Slovak Mistral?", "expected_documents": [ "pages/students/2023/denis_le_thanh/README.md" ], @@ -18453,21 +20699,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Slovak Mistral" }, { - "type": "work_title", + "type": "thesis_title", "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Denis Le Thanh -> MENTIONS_TOPIC -> Slovak Mistral", - "Denis Le Thanh -> HAS_WORK_TITLE -> Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + "Denis Le Thanh -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Slovak Mistral", + "Denis Le Thanh -> AUTHORED -> Thesis(title=Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18477,9 +20728,9 @@ { "id": "g0358", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Denis Le Thanh, ak jej dokument zároveň súvisí s témou kyberbezpečnosť?", + "question": "Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo kyberbezpečnosť?", "expected_documents": [ "pages/students/2023/denis_le_thanh/README.md" ], @@ -18504,21 +20755,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "kyberbezpečnosť" }, { - "type": "work_title", + "type": "thesis_title", "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Denis Le Thanh -> MENTIONS_TOPIC -> kyberbezpečnosť", - "Denis Le Thanh -> HAS_WORK_TITLE -> Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + "Denis Le Thanh -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> kyberbezpečnosť", + "Denis Le Thanh -> AUTHORED -> Thesis(title=Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18528,9 +20784,9 @@ { "id": "g0359", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Simona Bobrovčanová, ak jej dokument zároveň súvisí s témou právne dokumenty?", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo právne dokumenty?", "expected_documents": [ "pages/students/2023/simona_bobrovcanova/README.md" ], @@ -18555,21 +20811,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "právne dokumenty" }, { - "type": "work_title", + "type": "thesis_title", "value": "Automatická sumarizácia slovenského textu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Simona Bobrovčanová -> MENTIONS_TOPIC -> právne dokumenty", - "Simona Bobrovčanová -> HAS_WORK_TITLE -> Automatická sumarizácia slovenského textu" + "Simona Bobrovčanová -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> právne dokumenty", + "Simona Bobrovčanová -> AUTHORED -> Thesis(title=Automatická sumarizácia slovenského textu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18579,9 +20840,9 @@ { "id": "g0360", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Maksym Zatirka, ak jej dokument zároveň súvisí s témou slovenské právo?", + "question": "Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo slovenské právo?", "expected_documents": [ "pages/students/2023/maksym_zatirka/README.md" ], @@ -18606,21 +20867,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "slovenské právo" }, { - "type": "work_title", + "type": "thesis_title", "value": "Grafová databáza pre podporu generovania slovenského jazyka" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Maksym Zatirka -> MENTIONS_TOPIC -> slovenské právo", - "Maksym Zatirka -> HAS_WORK_TITLE -> Grafová databáza pre podporu generovania slovenského jazyka" + "Maksym Zatirka -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenské právo", + "Maksym Zatirka -> AUTHORED -> Thesis(title=Grafová databáza pre podporu generovania slovenského jazyka)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18630,9 +20896,9 @@ { "id": "g0361", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Michal Stromko, ak jej dokument zároveň súvisí s témou FAISS?", + "question": "Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md" ], @@ -18657,21 +20923,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "FAISS" }, { - "type": "work_title", + "type": "thesis_title", "value": "Indexovanie slovenského textu pomocou Elasticsearch" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Michal Stromko -> MENTIONS_TOPIC -> FAISS", - "Michal Stromko -> HAS_WORK_TITLE -> Indexovanie slovenského textu pomocou Elasticsearch" + "Michal Stromko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> FAISS", + "Michal Stromko -> AUTHORED -> Thesis(title=Indexovanie slovenského textu pomocou Elasticsearch)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18681,9 +20952,9 @@ { "id": "g0362", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Alina Vitko, ak jej dokument zároveň súvisí s témou Question Answering?", + "question": "Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Question Answering?", "expected_documents": [ "pages/students/2019/alina_vitko/README.md" ], @@ -18708,21 +20979,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Question Answering" }, { - "type": "work_title", + "type": "thesis_title", "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Alina Vitko -> MENTIONS_TOPIC -> Question Answering", - "Alina Vitko -> HAS_WORK_TITLE -> Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + "Alina Vitko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Question Answering", + "Alina Vitko -> AUTHORED -> Thesis(title=Systémy pre generovanie odpovede na otázku v prirodzenom jazyku)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18732,9 +21008,9 @@ { "id": "g0363", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Oleh Poiasnik, ak jej dokument zároveň súvisí s témou LightRAG?", + "question": "Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo LightRAG?", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md" ], @@ -18759,21 +21035,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "LightRAG" }, { - "type": "work_title", + "type": "thesis_title", "value": "Expertný agentový systém na podporu rozhodovania v lekárni" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Oleh Poiasnik -> MENTIONS_TOPIC -> LightRAG", - "Oleh Poiasnik -> HAS_WORK_TITLE -> Expertný agentový systém na podporu rozhodovania v lekárni" + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> LightRAG", + "Oleh Poiasnik -> AUTHORED -> Thesis(title=Expertný agentový systém na podporu rozhodovania v lekárni)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18783,9 +21064,9 @@ { "id": "g0364", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Daniil Huzenko, ak jej dokument zároveň súvisí s témou Kubernetes?", + "question": "Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Kubernetes?", "expected_documents": [ "pages/students/2022/daniil_huzenko/README.md" ], @@ -18810,21 +21091,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Kubernetes" }, { - "type": "work_title", + "type": "thesis_title", "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Daniil Huzenko -> MENTIONS_TOPIC -> Kubernetes", - "Daniil Huzenko -> HAS_WORK_TITLE -> Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + "Daniil Huzenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Kubernetes", + "Daniil Huzenko -> AUTHORED -> Thesis(title=Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18834,9 +21120,9 @@ { "id": "g0365", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Andrii Pervashov, ak jej dokument zároveň súvisí s témou OpenWebUI?", + "question": "Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?", "expected_documents": [ "pages/students/2022/andrii_pervashov/README.md" ], @@ -18861,21 +21147,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "OpenWebUI" }, { - "type": "work_title", + "type": "thesis_title", "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Andrii Pervashov -> MENTIONS_TOPIC -> OpenWebUI", - "Andrii Pervashov -> HAS_WORK_TITLE -> Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> OpenWebUI", + "Andrii Pervashov -> AUTHORED -> Thesis(title=Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18885,9 +21176,9 @@ { "id": "g0366", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Ondrej Megela, ak jej dokument zároveň súvisí s témou jazykové modelovanie?", + "question": "Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo jazykové modelovanie?", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md" ], @@ -18912,21 +21203,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "jazykové modelovanie" }, { - "type": "work_title", + "type": "thesis_title", "value": "Neurónové jazykové modelovanie typu BERT" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Ondrej Megela -> MENTIONS_TOPIC -> jazykové modelovanie", - "Ondrej Megela -> HAS_WORK_TITLE -> Neurónové jazykové modelovanie typu BERT" + "Ondrej Megela -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> jazykové modelovanie", + "Ondrej Megela -> AUTHORED -> Thesis(title=Neurónové jazykové modelovanie typu BERT)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18936,9 +21232,9 @@ { "id": "g0367", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Maksym Zatirka, ak jej dokument zároveň súvisí s témou grafová databáza?", + "question": "Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo grafová databáza?", "expected_documents": [ "pages/students/2023/maksym_zatirka/README.md" ], @@ -18963,21 +21259,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "grafová databáza" }, { - "type": "work_title", + "type": "thesis_title", "value": "Grafová databáza pre podporu generovania slovenského jazyka" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Maksym Zatirka -> MENTIONS_TOPIC -> grafová databáza", - "Maksym Zatirka -> HAS_WORK_TITLE -> Grafová databáza pre podporu generovania slovenského jazyka" + "Maksym Zatirka -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> grafová databáza", + "Maksym Zatirka -> AUTHORED -> Thesis(title=Grafová databáza pre podporu generovania slovenského jazyka)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -18987,9 +21288,9 @@ { "id": "g0368", "split": "dev", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Daniil Huzenko, ak jej dokument zároveň súvisí s témou Raspberry Pi?", + "question": "Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Raspberry Pi?", "expected_documents": [ "pages/students/2022/daniil_huzenko/README.md" ], @@ -19014,21 +21315,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Raspberry Pi" }, { - "type": "work_title", + "type": "thesis_title", "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Daniil Huzenko -> MENTIONS_TOPIC -> Raspberry Pi", - "Daniil Huzenko -> HAS_WORK_TITLE -> Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + "Daniil Huzenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Raspberry Pi", + "Daniil Huzenko -> AUTHORED -> Thesis(title=Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -19038,9 +21344,9 @@ { "id": "g0369", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Oleksandr Dorybohov, ak jej dokument zároveň súvisí s témou API?", + "question": "Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo API?", "expected_documents": [ "pages/students/2023/oleksandr_dorybohov/README.md" ], @@ -19065,21 +21371,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "API" }, { - "type": "work_title", + "type": "thesis_title", "value": "Automatické odpovede na otázky v právnej oblasti" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Oleksandr Dorybohov -> MENTIONS_TOPIC -> API", - "Oleksandr Dorybohov -> HAS_WORK_TITLE -> Automatické odpovede na otázky v právnej oblasti" + "Oleksandr Dorybohov -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> API", + "Oleksandr Dorybohov -> AUTHORED -> Thesis(title=Automatické odpovede na otázky v právnej oblasti)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -19089,9 +21400,9 @@ { "id": "g0370", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Samuel Vasiľ, ak jej dokument zároveň súvisí s témou OpenWebUI?", + "question": "Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?", "expected_documents": [ "pages/students/2022/samuel_vasil/README.md" ], @@ -19116,21 +21427,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "OpenWebUI" }, { - "type": "work_title", + "type": "thesis_title", "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Samuel Vasiľ -> MENTIONS_TOPIC -> OpenWebUI", - "Samuel Vasiľ -> HAS_WORK_TITLE -> Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + "Samuel Vasiľ -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> OpenWebUI", + "Samuel Vasiľ -> AUTHORED -> Thesis(title=Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -19140,9 +21456,9 @@ { "id": "g0371", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Vladyslav Yanchenko, ak jej dokument zároveň súvisí s témou Azure?", + "question": "Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo Azure?", "expected_documents": [ "pages/students/2022/vladyslav_yanchenko/README.md" ], @@ -19167,21 +21483,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "Azure" }, { - "type": "work_title", + "type": "thesis_title", "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Vladyslav Yanchenko -> MENTIONS_TOPIC -> Azure", - "Vladyslav Yanchenko -> HAS_WORK_TITLE -> Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + "Vladyslav Yanchenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Azure", + "Vladyslav Yanchenko -> AUTHORED -> Thesis(title=Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -19191,9 +21512,9 @@ { "id": "g0372", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Dmytro Ushatenko, ak jej dokument zároveň súvisí s témou dialógový systém?", + "question": "Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo dialógový systém?", "expected_documents": [ "pages/students/2017/dmytro_ushatenko/README.md" ], @@ -19218,21 +21539,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "dialógový systém" }, { - "type": "work_title", + "type": "thesis_title", "value": "Jednoduchý chatbot v jazyku Python" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Dmytro Ushatenko -> MENTIONS_TOPIC -> dialógový systém", - "Dmytro Ushatenko -> HAS_WORK_TITLE -> Jednoduchý chatbot v jazyku Python" + "Dmytro Ushatenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> dialógový systém", + "Dmytro Ushatenko -> AUTHORED -> Thesis(title=Jednoduchý chatbot v jazyku Python)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -19242,9 +21568,9 @@ { "id": "g0373", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Dárius Lindvai, ak jej dokument zároveň súvisí s témou CRF?", + "question": "Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo CRF?", "expected_documents": [ "pages/students/2016/darius_lindvai/README.md" ], @@ -19269,21 +21595,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "CRF" }, { - "type": "work_title", + "type": "thesis_title", "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Dárius Lindvai -> MENTIONS_TOPIC -> CRF", - "Dárius Lindvai -> HAS_WORK_TITLE -> Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + "Dárius Lindvai -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> CRF", + "Dárius Lindvai -> AUTHORED -> Thesis(title=Obnovenie interpunkcie pomocou hlbokých neurónových sietí)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -19293,9 +21624,9 @@ { "id": "g0374", "split": "test", - "category": "person_topic_title", + "category": "person_keyword_title", "difficulty": "hard", - "question": "Aká je téma práce osoby Martin Šarišský, ak jej dokument zároveň súvisí s témou DeepEval?", + "question": "Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo DeepEval?", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md" ], @@ -19320,21 +21651,26 @@ ], "expected_entities": [ { - "type": "topic", + "type": "keyword", "value": "DeepEval" }, { - "type": "work_title", + "type": "thesis_title", "value": "Agentové systémy pomocou veľkého jazykového modelu" } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_TITLE" + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" ], "expected_paths": [ - "Martin Šarišský -> MENTIONS_TOPIC -> DeepEval", - "Martin Šarišský -> HAS_WORK_TITLE -> Agentové systémy pomocou veľkého jazykového modelu" + "Martin Šarišský -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> DeepEval", + "Martin Šarišský -> AUTHORED -> Thesis(title=Agentové systémy pomocou veľkého jazykového modelu)" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.title" ] }, "evidence_basis": [ @@ -19344,15 +21680,14 @@ { "id": "g0375", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2022 uvedenú osobu Michal Stromko?", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou bp2022?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19376,17 +21711,21 @@ "value": "bp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Michal Stromko -> IN_CATEGORY -> bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Michal Stromko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Michal Stromko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19397,15 +21736,14 @@ { "id": "g0376", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Yevhenii Medushivskyi?", + "question": "Ktorý autor dokumentu je pri osobe Yevhenii Medushivskyi spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2023/yevhenii_medushivskyi/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19429,17 +21767,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Yevhenii Medushivskyi -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Yevhenii Medushivskyi -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Yevhenii Medushivskyi" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19450,15 +21792,14 @@ { "id": "g0377", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2027 uvedenú osobu Oleh Poiasnik?", + "question": "Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou dp2027?", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19482,17 +21823,21 @@ "value": "dp2027" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Oleh Poiasnik -> IN_CATEGORY -> dp2027 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Oleh Poiasnik" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19503,15 +21848,14 @@ { "id": "g0378", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2025 uvedenú osobu Andrii Pervashov?", + "question": "Ktorý autor dokumentu je pri osobe Andrii Pervashov spojený s kategóriou bp2025?", "expected_documents": [ "pages/students/2022/andrii_pervashov/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19535,17 +21879,21 @@ "value": "bp2025" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Andrii Pervashov -> IN_CATEGORY -> bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Andrii Pervashov" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19556,15 +21904,14 @@ { "id": "g0379", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2022 uvedenú osobu Kristián Sopkovič?", + "question": "Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou bp2022?", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19588,17 +21935,21 @@ "value": "bp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Kristián Sopkovič -> IN_CATEGORY -> bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19609,15 +21960,14 @@ { "id": "g0380", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2024 uvedenú osobu Michal Stromko?", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou dp2024?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19641,17 +21991,21 @@ "value": "dp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Michal Stromko -> IN_CATEGORY -> dp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Michal Stromko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Michal Stromko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19662,15 +22016,14 @@ { "id": "g0381", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2019 uvedenú osobu Dominik Nagy?", + "question": "Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou bp2019?", "expected_documents": [ "pages/students/2016/dominik_nagy/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19694,17 +22047,21 @@ "value": "bp2019" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Dominik Nagy -> IN_CATEGORY -> bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Dominik Nagy -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Dominik Nagy" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19715,15 +22072,14 @@ { "id": "g0382", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii vp2025 uvedenú osobu Rostyslav Rodzhuk?", + "question": "Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou vp2025?", "expected_documents": [ "pages/students/2023/rostyslav_rodzhuk/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19747,17 +22103,21 @@ "value": "vp2025" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Rostyslav Rodzhuk -> IN_CATEGORY -> vp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2025", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Rostyslav Rodzhuk" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19768,15 +22128,14 @@ { "id": "g0383", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2022 uvedenú osobu Alina Vitko?", + "question": "Ktorý autor dokumentu je pri osobe Alina Vitko spojený s kategóriou bp2022?", "expected_documents": [ "pages/students/2019/alina_vitko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19800,17 +22159,21 @@ "value": "bp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Alina Vitko -> IN_CATEGORY -> bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Alina Vitko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Alina Vitko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19821,15 +22184,14 @@ { "id": "g0384", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2027 uvedenú osobu Ján Malinovský?", + "question": "Ktorý autor dokumentu je pri osobe Ján Malinovský spojený s kategóriou dp2027?", "expected_documents": [ "pages/students/2022/jan_malinovsky/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19853,17 +22215,21 @@ "value": "dp2027" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Ján Malinovský -> IN_CATEGORY -> dp2027 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Ján Malinovský -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Ján Malinovský" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19874,15 +22240,14 @@ { "id": "g0385", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii iaeste uvedenú osobu Oliver Pejic?", + "question": "Ktorý autor dokumentu je pri osobe Oliver Pejic spojený s kategóriou iaeste?", "expected_documents": [ "pages/interns/oliver_pejic/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19906,17 +22271,21 @@ "value": "iaeste" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Oliver Pejic -> IN_CATEGORY -> iaeste -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Oliver Pejic -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> iaeste", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Oliver Pejic" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19927,15 +22296,14 @@ { "id": "g0386", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2024 uvedenú osobu Vladimír Ferko?", + "question": "Ktorý autor dokumentu je pri osobe Vladimír Ferko spojený s kategóriou bp2024?", "expected_documents": [ "pages/students/2021/vladimir_ferko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -19959,17 +22327,21 @@ "value": "bp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Vladimír Ferko -> IN_CATEGORY -> bp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Vladimír Ferko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Vladimír Ferko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -19980,15 +22352,14 @@ { "id": "g0387", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2019 uvedenú osobu Jakub Maruniak?", + "question": "Ktorý autor dokumentu je pri osobe Jakub Maruniak spojený s kategóriou bp2019?", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20012,17 +22383,21 @@ "value": "bp2019" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Jakub Maruniak -> IN_CATEGORY -> bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Jakub Maruniak" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20033,15 +22408,14 @@ { "id": "g0388", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2023 uvedenú osobu Ondrej Megela?", + "question": "Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou dp2023?", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20065,17 +22439,21 @@ "value": "dp2023" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Ondrej Megela -> IN_CATEGORY -> dp2023 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Ondrej Megela -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2023", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Ondrej Megela" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20086,15 +22464,14 @@ { "id": "g0389", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2024 uvedenú osobu Dávid Omasta?", + "question": "Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2024?", "expected_documents": [ "pages/students/2018/david_omasta/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20118,17 +22495,21 @@ "value": "dp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Dávid Omasta -> IN_CATEGORY -> dp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Dávid Omasta -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Dávid Omasta" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20139,15 +22520,14 @@ { "id": "g0390", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2021 uvedenú osobu Tomáš Kuchárik?", + "question": "Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2021?", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20171,17 +22551,21 @@ "value": "dp2021" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Tomáš Kuchárik -> IN_CATEGORY -> dp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Tomáš Kuchárik" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20192,15 +22576,14 @@ { "id": "g0391", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Samuel Vasiľ?", + "question": "Ktorý autor dokumentu je pri osobe Samuel Vasiľ spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2022/samuel_vasil/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20224,17 +22607,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Samuel Vasiľ -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Samuel Vasiľ -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Samuel Vasiľ" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20245,15 +22632,14 @@ { "id": "g0392", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2022 uvedenú osobu Dominik Nagy?", + "question": "Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou dp2022?", "expected_documents": [ "pages/students/2016/dominik_nagy/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20277,17 +22663,21 @@ "value": "dp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Dominik Nagy -> IN_CATEGORY -> dp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Dominik Nagy -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Dominik Nagy" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20298,15 +22688,14 @@ { "id": "g0393", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2026 uvedenú osobu Matej Novotný?", + "question": "Ktorý autor dokumentu je pri osobe Matej Novotný spojený s kategóriou dp2026?", "expected_documents": [ "pages/students/2021/matej_novotny/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20330,17 +22719,21 @@ "value": "dp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Matej Novotný -> IN_CATEGORY -> dp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Matej Novotný -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Matej Novotný" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20351,15 +22744,14 @@ { "id": "g0394", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Simona Bobrovčanová?", + "question": "Ktorý autor dokumentu je pri osobe Simona Bobrovčanová spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2023/simona_bobrovcanova/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20383,17 +22775,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Simona Bobrovčanová -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Simona Bobrovčanová -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Simona Bobrovčanová" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20404,15 +22800,14 @@ { "id": "g0395", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2019 uvedenú osobu Lukáš Pokrývka?", + "question": "Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou bp2019?", "expected_documents": [ "pages/students/2016/lukas_pokryvka/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20436,17 +22831,21 @@ "value": "bp2019" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Lukáš Pokrývka -> IN_CATEGORY -> bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Lukáš Pokrývka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20457,15 +22856,14 @@ { "id": "g0396", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2019 uvedenú osobu Maroš Harahus?", + "question": "Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou bp2019?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20489,17 +22887,21 @@ "value": "bp2019" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Maroš Harahus -> IN_CATEGORY -> bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Maroš Harahus" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20510,15 +22912,14 @@ { "id": "g0397", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2025 uvedenú osobu Valerii Kutsenko?", + "question": "Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou bp2025?", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20542,17 +22943,21 @@ "value": "bp2025" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Valerii Kutsenko -> IN_CATEGORY -> bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Valerii Kutsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20563,15 +22968,14 @@ { "id": "g0398", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2020 uvedenú osobu Patrik Pavlišin?", + "question": "Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou bp2020?", "expected_documents": [ "pages/students/2016/patrik_pavlisin/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20595,17 +22999,21 @@ "value": "bp2020" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Patrik Pavlišin -> IN_CATEGORY -> bp2020 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2020", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Patrik Pavlišin" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20616,15 +23024,14 @@ { "id": "g0399", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2024 uvedenú osobu Filip Tomáš?", + "question": "Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2024?", "expected_documents": [ "pages/students/2019/filip_tomas/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20648,17 +23055,21 @@ "value": "dp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Filip Tomáš -> IN_CATEGORY -> dp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Filip Tomáš" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20669,15 +23080,14 @@ { "id": "g0400", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2019 uvedenú osobu Ján Holp?", + "question": "Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou bp2019?", "expected_documents": [ "pages/students/2016/jan_holp/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20701,17 +23111,21 @@ "value": "bp2019" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Ján Holp -> IN_CATEGORY -> bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Ján Holp -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Ján Holp" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20722,15 +23136,14 @@ { "id": "g0401", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Ronald Zalacko?", + "question": "Ktorý autor dokumentu je pri osobe Ronald Zalacko spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2023/ronald_zalacko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20754,17 +23167,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Ronald Zalacko -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Ronald Zalacko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Ronald Zalacko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20775,15 +23192,14 @@ { "id": "g0402", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2021 uvedenú osobu Martin Wencel?", + "question": "Ktorý autor dokumentu je pri osobe Martin Wencel spojený s kategóriou bp2021?", "expected_documents": [ "pages/students/2018/martin_wencel/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20807,17 +23223,21 @@ "value": "bp2021" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Martin Wencel -> IN_CATEGORY -> bp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Martin Wencel -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2021", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Martin Wencel" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20828,15 +23248,14 @@ { "id": "g0403", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2024 uvedenú osobu Eduard Matovka?", + "question": "Ktorý autor dokumentu je pri osobe Eduard Matovka spojený s kategóriou bp2024?", "expected_documents": [ "pages/students/2021/eduard_matovka/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20860,17 +23279,21 @@ "value": "bp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Eduard Matovka -> IN_CATEGORY -> bp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Eduard Matovka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Eduard Matovka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20881,15 +23304,14 @@ { "id": "g0404", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2025 uvedenú osobu Filip Tomáš?", + "question": "Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2025?", "expected_documents": [ "pages/students/2019/filip_tomas/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20913,17 +23335,21 @@ "value": "dp2025" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Filip Tomáš -> IN_CATEGORY -> dp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2025", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Filip Tomáš" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20934,15 +23360,14 @@ { "id": "g0405", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2024 uvedenú osobu Matej Ščišľak?", + "question": "Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou bp2024?", "expected_documents": [ "pages/students/2021/matej_scislak/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" ], "expected_answer_contains": [ "Daniel Hladek", @@ -20966,17 +23391,21 @@ "value": "bp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Matej Ščišľak -> IN_CATEGORY -> bp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Matej Ščišľak" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -20987,15 +23416,14 @@ { "id": "g0406", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2022 uvedenú osobu Márk Fehér?", + "question": "Ktorý autor dokumentu je pri osobe Márk Fehér spojený s kategóriou dp2022?", "expected_documents": [ "pages/students/2016/mark_feher/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21019,17 +23447,21 @@ "value": "dp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Márk Fehér -> IN_CATEGORY -> dp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Márk Fehér -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Márk Fehér" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21040,15 +23472,14 @@ { "id": "g0407", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Samuel Džurina?", + "question": "Ktorý autor dokumentu je pri osobe Samuel Džurina spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2023/samuel_dzurina/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21072,17 +23503,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Samuel Džurina -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Samuel Džurina -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Samuel Džurina" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21093,15 +23528,14 @@ { "id": "g0408", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2022 uvedenú osobu Patrik Pavlišin?", + "question": "Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou dp2022?", "expected_documents": [ "pages/students/2016/patrik_pavlisin/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21125,17 +23559,21 @@ "value": "dp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Patrik Pavlišin -> IN_CATEGORY -> dp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Patrik Pavlišin" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21146,15 +23584,14 @@ { "id": "g0409", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Oleksandr Dorybohov?", + "question": "Ktorý autor dokumentu je pri osobe Oleksandr Dorybohov spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2023/oleksandr_dorybohov/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21178,17 +23615,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Oleksandr Dorybohov -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Oleksandr Dorybohov -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Oleksandr Dorybohov" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21199,15 +23640,14 @@ { "id": "g0410", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii erasmus uvedenú osobu Bogdan Paul Chiș?", + "question": "Ktorý autor dokumentu je pri osobe Bogdan Paul Chiș spojený s kategóriou erasmus?", "expected_documents": [ "pages/interns/bogdan_paul_chis/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21231,17 +23671,21 @@ "value": "erasmus" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Bogdan Paul Chiș -> IN_CATEGORY -> erasmus -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Bogdan Paul Chiș -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> erasmus", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Bogdan Paul Chiș" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21252,15 +23696,14 @@ { "id": "g0411", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2021 uvedenú osobu Ján Holp?", + "question": "Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou dp2021?", "expected_documents": [ "pages/students/2016/jan_holp/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21284,17 +23727,21 @@ "value": "dp2021" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Ján Holp -> IN_CATEGORY -> dp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Ján Holp -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Ján Holp" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21305,15 +23752,14 @@ { "id": "g0412", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2027 uvedenú osobu Ján Pták?", + "question": "Ktorý autor dokumentu je pri osobe Ján Pták spojený s kategóriou dp2027?", "expected_documents": [ "pages/students/2022/jan_ptak/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21337,17 +23783,21 @@ "value": "dp2027" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Ján Pták -> IN_CATEGORY -> dp2027 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Ján Pták -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Ján Pták" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21358,15 +23808,14 @@ { "id": "g0413", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2020 uvedenú osobu Dmytro Ushatenko?", + "question": "Ktorý autor dokumentu je pri osobe Dmytro Ushatenko spojený s kategóriou bp2020?", "expected_documents": [ "pages/students/2017/dmytro_ushatenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21390,17 +23839,21 @@ "value": "bp2020" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Dmytro Ushatenko -> IN_CATEGORY -> bp2020 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Dmytro Ushatenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2020", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Dmytro Ushatenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21411,15 +23864,14 @@ { "id": "g0414", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii vp2023 uvedenú osobu Martin Šarišský?", + "question": "Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou vp2023?", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21443,17 +23895,21 @@ "value": "vp2023" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Martin Šarišský -> IN_CATEGORY -> vp2023 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Martin Šarišský -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2023", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Martin Šarišský" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21464,15 +23920,14 @@ { "id": "g0415", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii iaeste uvedenú osobu Cesar Abascal Gutierrez?", + "question": "Ktorý autor dokumentu je pri osobe Cesar Abascal Gutierrez spojený s kategóriou iaeste?", "expected_documents": [ "pages/interns/cesar_gutierrez/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21496,17 +23951,21 @@ "value": "iaeste" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Cesar Abascal Gutierrez -> IN_CATEGORY -> iaeste -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Cesar Abascal Gutierrez -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> iaeste", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Cesar Abascal Gutierrez" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21517,15 +23976,14 @@ { "id": "g0416", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2021 uvedenú osobu Ondrej Megela?", + "question": "Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou bp2021?", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21549,17 +24007,21 @@ "value": "bp2021" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Ondrej Megela -> IN_CATEGORY -> bp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Ondrej Megela -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2021", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Ondrej Megela" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21570,15 +24032,14 @@ { "id": "g0417", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2022 uvedenú osobu Tomáš Kuchárik?", + "question": "Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2022?", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21602,17 +24063,21 @@ "value": "dp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Tomáš Kuchárik -> IN_CATEGORY -> dp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Tomáš Kuchárik" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21623,15 +24088,14 @@ { "id": "g0418", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2022 uvedenú osobu Filip Tomáš?", + "question": "Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou bp2022?", "expected_documents": [ "pages/students/2019/filip_tomas/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21655,17 +24119,21 @@ "value": "bp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Filip Tomáš -> IN_CATEGORY -> bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Filip Tomáš" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21676,15 +24144,14 @@ { "id": "g0419", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2019 uvedenú osobu Dárius Lindvai?", + "question": "Ktorý autor dokumentu je pri osobe Dárius Lindvai spojený s kategóriou bp2019?", "expected_documents": [ "pages/students/2016/darius_lindvai/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21708,17 +24175,21 @@ "value": "bp2019" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Dárius Lindvai -> IN_CATEGORY -> bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Dárius Lindvai -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Dárius Lindvai" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21729,15 +24200,14 @@ { "id": "g0420", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii vp2021 uvedenú osobu Michal Stromko?", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou vp2021?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21761,17 +24231,21 @@ "value": "vp2021" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Michal Stromko -> IN_CATEGORY -> vp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Michal Stromko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2021", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Michal Stromko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21782,15 +24256,14 @@ { "id": "g0421", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii iaeste uvedenú osobu Youssef Ressaissi?", + "question": "Ktorý autor dokumentu je pri osobe Youssef Ressaissi spojený s kategóriou iaeste?", "expected_documents": [ "pages/interns/yussef_ressaissi/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21814,17 +24287,21 @@ "value": "iaeste" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Youssef Ressaissi -> IN_CATEGORY -> iaeste -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Youssef Ressaissi -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> iaeste", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Youssef Ressaissi" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21835,15 +24312,14 @@ { "id": "g0422", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Rostyslav Rodzhuk?", + "question": "Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2023/rostyslav_rodzhuk/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21867,17 +24343,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Rostyslav Rodzhuk -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Rostyslav Rodzhuk" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21888,15 +24368,14 @@ { "id": "g0423", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2021 uvedenú osobu Lukáš Pokrývka?", + "question": "Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou dp2021?", "expected_documents": [ "pages/students/2016/lukas_pokryvka/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21920,17 +24399,21 @@ "value": "dp2021" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Lukáš Pokrývka -> IN_CATEGORY -> dp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Lukáš Pokrývka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21941,15 +24424,14 @@ { "id": "g0424", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii vp2024 uvedenú osobu Valerii Kutsenko?", + "question": "Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou vp2024?", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -21973,17 +24455,21 @@ "value": "vp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Valerii Kutsenko -> IN_CATEGORY -> vp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Valerii Kutsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -21994,15 +24480,14 @@ { "id": "g0425", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2024 uvedenú osobu Kristián Sopkovič?", + "question": "Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou dp2024?", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22026,17 +24511,21 @@ "value": "dp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Kristián Sopkovič -> IN_CATEGORY -> dp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Kristián Sopkovič" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22047,15 +24536,14 @@ { "id": "g0426", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2022 uvedenú osobu Artem Yatsenko?", + "question": "Ktorý autor dokumentu je pri osobe Artem Yatsenko spojený s kategóriou bp2022?", "expected_documents": [ "pages/students/2019/artem_yatsenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22079,17 +24567,21 @@ "value": "bp2022" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Artem Yatsenko -> IN_CATEGORY -> bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Artem Yatsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Artem Yatsenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22100,15 +24592,14 @@ { "id": "g0427", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2021 uvedenú osobu Maroš Harahus?", + "question": "Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou dp2021?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22132,17 +24623,21 @@ "value": "dp2021" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Maroš Harahus -> IN_CATEGORY -> dp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Maroš Harahus -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Maroš Harahus" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22153,15 +24648,14 @@ { "id": "g0428", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2025 uvedenú osobu Vladyslav Yanchenko?", + "question": "Ktorý autor dokumentu je pri osobe Vladyslav Yanchenko spojený s kategóriou bp2025?", "expected_documents": [ "pages/students/2022/vladyslav_yanchenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22185,17 +24679,21 @@ "value": "bp2025" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Vladyslav Yanchenko -> IN_CATEGORY -> bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Vladyslav Yanchenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Vladyslav Yanchenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22206,15 +24704,14 @@ { "id": "g0429", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2026 uvedenú osobu Maksym Zatirka?", + "question": "Ktorý autor dokumentu je pri osobe Maksym Zatirka spojený s kategóriou bp2026?", "expected_documents": [ "pages/students/2023/maksym_zatirka/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22238,17 +24735,21 @@ "value": "bp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Maksym Zatirka -> IN_CATEGORY -> bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Maksym Zatirka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Maksym Zatirka" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22259,15 +24760,14 @@ { "id": "g0430", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2024 uvedenú osobu Martin Šarišský?", + "question": "Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou bp2024?", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22291,17 +24791,21 @@ "value": "bp2024" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Martin Šarišský -> IN_CATEGORY -> bp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Martin Šarišský -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2024", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Martin Šarišský" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22312,15 +24816,14 @@ { "id": "g0431", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii iaeste uvedenú osobu Sevval Bulburu?", + "question": "Ktorý autor dokumentu je pri osobe Sevval Bulburu spojený s kategóriou iaeste?", "expected_documents": [ "pages/interns/sevval_bulburu/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22344,17 +24847,21 @@ "value": "iaeste" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Sevval Bulburu -> IN_CATEGORY -> iaeste -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Sevval Bulburu -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> iaeste", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Sevval Bulburu" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22365,15 +24872,14 @@ { "id": "g0432", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii dp2026 uvedenú osobu Martin Šarišský?", + "question": "Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou dp2026?", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22397,17 +24903,21 @@ "value": "dp2026" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Martin Šarišský -> IN_CATEGORY -> dp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Martin Šarišský -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2026", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Martin Šarišský" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22418,15 +24928,14 @@ { "id": "g0433", "split": "dev", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2025 uvedenú osobu Daniil Huzenko?", + "question": "Ktorý autor dokumentu je pri osobe Daniil Huzenko spojený s kategóriou bp2025?", "expected_documents": [ "pages/students/2022/daniil_huzenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22450,17 +24959,21 @@ "value": "bp2025" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Daniil Huzenko -> IN_CATEGORY -> bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Daniil Huzenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Daniil Huzenko" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22471,15 +24984,14 @@ { "id": "g0434", "split": "test", - "category": "author_category_multi_hop", + "category": "document_author_category_multi_hop", "difficulty": "hard", - "question": "Ktorý autor má na svojej autorskej stránke v kategórii bp2025 uvedenú osobu Oleh Poiasnik?", + "question": "Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou bp2025?", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" ], "expected_answer_contains": [ "Daniel Hladek", @@ -22503,17 +25015,21 @@ "value": "bp2025" }, { - "type": "author", + "type": "document_author", "value": "Daniel Hladek" } ], "expected_relations": [ + "HAS_DOCUMENT", "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "AUTHORED_DOCUMENT" ], "expected_paths": [ - "Oleh Poiasnik -> IN_CATEGORY -> bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" - ] + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Daniel Hladek -> AUTHORED_DOCUMENT -> Document <- HAS_DOCUMENT <- Oleh Poiasnik" + ], + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22526,19 +25042,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Dávid Omasta?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?", "expected_documents": [ "pages/students/2018/david_omasta/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" ], "expected_answer_contains": [ "Dávid Omasta", "dp2023", - "dp2024", - "Daniel Hladek" + "dp2024" ], "should_answer": true, "graph": { @@ -22559,27 +25073,23 @@ { "type": "category", "value": "dp2024" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Dávid Omasta -> IN_CATEGORY -> dp2023", - "Dávid Omasta -> IN_CATEGORY -> dp2024", - "dp2023 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Dávid Omasta -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2023", + "Dávid Omasta -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024" ], "expected_entity_set": [ "dp2023", "dp2024" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22592,19 +25102,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Ondrej Megela?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" ], "expected_answer_contains": [ "Ondrej Megela", "bp2021", - "dp2023", - "Daniel Hladek" + "dp2023" ], "should_answer": true, "graph": { @@ -22625,27 +25133,23 @@ { "type": "category", "value": "dp2023" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Ondrej Megela -> IN_CATEGORY -> bp2021", - "Ondrej Megela -> IN_CATEGORY -> dp2023", - "bp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Ondrej Megela -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2021", + "Ondrej Megela -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2023" ], "expected_entity_set": [ "bp2021", "dp2023" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22658,19 +25162,17 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Lukáš Pokrývka?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?", "expected_documents": [ "pages/students/2016/lukas_pokryvka/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" ], "expected_answer_contains": [ "Lukáš Pokrývka", "bp2019", - "dp2021", - "Daniel Hladek" + "dp2021" ], "should_answer": true, "graph": { @@ -22691,27 +25193,23 @@ { "type": "category", "value": "dp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Lukáš Pokrývka -> IN_CATEGORY -> bp2019", - "Lukáš Pokrývka -> IN_CATEGORY -> dp2021", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021" ], "expected_entity_set": [ "bp2019", "dp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22724,19 +25222,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Dominik Nagy?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?", "expected_documents": [ "pages/students/2016/dominik_nagy/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" ], "expected_answer_contains": [ "Dominik Nagy", "bp2019", - "dp2022", - "Daniel Hladek" + "dp2022" ], "should_answer": true, "graph": { @@ -22757,27 +25253,23 @@ { "type": "category", "value": "dp2022" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Dominik Nagy -> IN_CATEGORY -> bp2019", - "Dominik Nagy -> IN_CATEGORY -> dp2022", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Dominik Nagy -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Dominik Nagy -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022" ], "expected_entity_set": [ "bp2019", "dp2022" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22790,19 +25282,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Maroš Harahus?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" ], "expected_answer_contains": [ "Maroš Harahus", "bp2019", - "dp2021", - "Daniel Hladek" + "dp2021" ], "should_answer": true, "graph": { @@ -22823,27 +25313,23 @@ { "type": "category", "value": "dp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Maroš Harahus -> IN_CATEGORY -> bp2019", - "Maroš Harahus -> IN_CATEGORY -> dp2021", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Maroš Harahus -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Maroš Harahus -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021" ], "expected_entity_set": [ "bp2019", "dp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22856,20 +25342,18 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Valerii Kutsenko?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" ], "expected_answer_contains": [ "Valerii Kutsenko", "bp2025", "dp2027", - "vp2024", - "Daniel Hladek" + "vp2024" ], "should_answer": true, "graph": { @@ -22894,30 +25378,25 @@ { "type": "category", "value": "vp2024" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Valerii Kutsenko -> IN_CATEGORY -> bp2025", - "Valerii Kutsenko -> IN_CATEGORY -> dp2027", - "Valerii Kutsenko -> IN_CATEGORY -> vp2024", - "bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027", + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2024" ], "expected_entity_set": [ "bp2025", "dp2027", "vp2024" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -22930,20 +25409,18 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Filip Tomáš?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?", "expected_documents": [ "pages/students/2019/filip_tomas/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" ], "expected_answer_contains": [ "Filip Tomáš", "bp2022", "dp2024", - "dp2025", - "Daniel Hladek" + "dp2025" ], "should_answer": true, "graph": { @@ -22968,30 +25445,25 @@ { "type": "category", "value": "dp2025" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Filip Tomáš -> IN_CATEGORY -> bp2022", - "Filip Tomáš -> IN_CATEGORY -> dp2024", - "Filip Tomáš -> IN_CATEGORY -> dp2025", - "bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024", + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2025" ], "expected_entity_set": [ "bp2022", "dp2024", "dp2025" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23004,20 +25476,18 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Patrik Pavlišin?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?", "expected_documents": [ "pages/students/2016/patrik_pavlisin/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" ], "expected_answer_contains": [ "Patrik Pavlišin", "bp2020", "dp2022", - "tp2021", - "Daniel Hladek" + "tp2021" ], "should_answer": true, "graph": { @@ -23042,30 +25512,25 @@ { "type": "category", "value": "tp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Patrik Pavlišin -> IN_CATEGORY -> bp2020", - "Patrik Pavlišin -> IN_CATEGORY -> dp2022", - "Patrik Pavlišin -> IN_CATEGORY -> tp2021", - "bp2020 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2020", + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022", + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> tp2021" ], "expected_entity_set": [ "bp2020", "dp2022", "tp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23078,19 +25543,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Kristián Sopkovič?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" ], "expected_answer_contains": [ "Kristián Sopkovič", "bp2022", - "dp2024", - "Daniel Hladek" + "dp2024" ], "should_answer": true, "graph": { @@ -23111,27 +25574,23 @@ { "type": "category", "value": "dp2024" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Kristián Sopkovič -> IN_CATEGORY -> bp2022", - "Kristián Sopkovič -> IN_CATEGORY -> dp2024", - "bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024" ], "expected_entity_set": [ "bp2022", "dp2024" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23144,19 +25603,17 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Oleh Poiasnik?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" ], "expected_answer_contains": [ "Oleh Poiasnik", "bp2025", - "dp2027", - "Daniel Hladek" + "dp2027" ], "should_answer": true, "graph": { @@ -23177,27 +25634,23 @@ { "type": "category", "value": "dp2027" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Oleh Poiasnik -> IN_CATEGORY -> bp2025", - "Oleh Poiasnik -> IN_CATEGORY -> dp2027", - "bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027" ], "expected_entity_set": [ "bp2025", "dp2027" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23210,19 +25663,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Tomáš Kuchárik?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" ], "expected_answer_contains": [ "Tomáš Kuchárik", "dp2021", - "dp2022", - "Daniel Hladek" + "dp2022" ], "should_answer": true, "graph": { @@ -23243,27 +25694,23 @@ { "type": "category", "value": "dp2022" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Tomáš Kuchárik -> IN_CATEGORY -> dp2021", - "Tomáš Kuchárik -> IN_CATEGORY -> dp2022", - "dp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021", + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022" ], "expected_entity_set": [ "dp2021", "dp2022" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23276,19 +25723,17 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Dárius Lindvai?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dárius Lindvai?", "expected_documents": [ "pages/students/2016/darius_lindvai/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" ], "expected_answer_contains": [ "Dárius Lindvai", "bp2019", - "dp2021", - "Daniel Hladek" + "dp2021" ], "should_answer": true, "graph": { @@ -23309,27 +25754,23 @@ { "type": "category", "value": "dp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Dárius Lindvai -> IN_CATEGORY -> bp2019", - "Dárius Lindvai -> IN_CATEGORY -> dp2021", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Dárius Lindvai -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Dárius Lindvai -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021" ], "expected_entity_set": [ "bp2019", "dp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23342,19 +25783,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Ján Holp?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ján Holp?", "expected_documents": [ "pages/students/2016/jan_holp/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" ], "expected_answer_contains": [ "Ján Holp", "bp2019", - "dp2021", - "Daniel Hladek" + "dp2021" ], "should_answer": true, "graph": { @@ -23375,27 +25814,23 @@ { "type": "category", "value": "dp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Ján Holp -> IN_CATEGORY -> bp2019", - "Ján Holp -> IN_CATEGORY -> dp2021", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Ján Holp -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Ján Holp -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021" ], "expected_entity_set": [ "bp2019", "dp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23408,19 +25843,17 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Andrii Pervashov?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Andrii Pervashov?", "expected_documents": [ "pages/students/2022/andrii_pervashov/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" ], "expected_answer_contains": [ "Andrii Pervashov", "bp2025", - "dp2027", - "Daniel Hladek" + "dp2027" ], "should_answer": true, "graph": { @@ -23441,27 +25874,23 @@ { "type": "category", "value": "dp2027" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Andrii Pervashov -> IN_CATEGORY -> bp2025", - "Andrii Pervashov -> IN_CATEGORY -> dp2027", - "bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027" ], "expected_entity_set": [ "bp2025", "dp2027" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23474,19 +25903,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Jakub Maruniak?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Jakub Maruniak?", "expected_documents": [ "pages/students/2016/jakub_maruniak/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" ], "expected_answer_contains": [ "Jakub Maruniak", "bp2019", - "dp2021", - "Daniel Hladek" + "dp2021" ], "should_answer": true, "graph": { @@ -23507,27 +25934,23 @@ { "type": "category", "value": "dp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Jakub Maruniak -> IN_CATEGORY -> bp2019", - "Jakub Maruniak -> IN_CATEGORY -> dp2021", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Jakub Maruniak -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021" ], "expected_entity_set": [ "bp2019", "dp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23540,20 +25963,18 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Michal Stromko?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Michal Stromko?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" ], "expected_answer_contains": [ "Michal Stromko", "bp2022", "dp2024", - "vp2021", - "Daniel Hladek" + "vp2021" ], "should_answer": true, "graph": { @@ -23578,30 +25999,25 @@ { "type": "category", "value": "vp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Michal Stromko -> IN_CATEGORY -> bp2022", - "Michal Stromko -> IN_CATEGORY -> dp2024", - "Michal Stromko -> IN_CATEGORY -> vp2021", - "bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Michal Stromko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Michal Stromko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024", + "Michal Stromko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2021" ], "expected_entity_set": [ "bp2022", "dp2024", "vp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23614,20 +26030,18 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Martin Šarišský?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Martin Šarišský?", "expected_documents": [ "pages/students/2021/martin_sarissky/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" ], "expected_answer_contains": [ "Martin Šarišský", "bp2024", "dp2026", - "vp2023", - "Daniel Hladek" + "vp2023" ], "should_answer": true, "graph": { @@ -23652,30 +26066,25 @@ { "type": "category", "value": "vp2023" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Martin Šarišský -> IN_CATEGORY -> bp2024", - "Martin Šarišský -> IN_CATEGORY -> dp2026", - "Martin Šarišský -> IN_CATEGORY -> vp2023", - "bp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Martin Šarišský -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2024", + "Martin Šarišský -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2026", + "Martin Šarišský -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2023" ], "expected_entity_set": [ "bp2024", "dp2026", "vp2023" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23688,19 +26097,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Matej Ščišľak?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Matej Ščišľak?", "expected_documents": [ "pages/students/2021/matej_scislak/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" ], "expected_answer_contains": [ "Matej Ščišľak", "bp2024", - "dp2026", - "Daniel Hladek" + "dp2026" ], "should_answer": true, "graph": { @@ -23721,27 +26128,23 @@ { "type": "category", "value": "dp2026" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Matej Ščišľak -> IN_CATEGORY -> bp2024", - "Matej Ščišľak -> IN_CATEGORY -> dp2026", - "bp2024 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2024", + "Matej Ščišľak -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2026" ], "expected_entity_set": [ "bp2024", "dp2026" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23754,19 +26157,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "V ktorých kategóriách na autorskej stránke Daniela Hladka sa nachádza osoba Rostyslav Rodzhuk?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Rostyslav Rodzhuk?", "expected_documents": [ "pages/students/2023/rostyslav_rodzhuk/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" ], "expected_answer_contains": [ "Rostyslav Rodzhuk", "bp2026", - "vp2025", - "Daniel Hladek" + "vp2025" ], "should_answer": true, "graph": { @@ -23787,27 +26188,23 @@ { "type": "category", "value": "vp2025" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Rostyslav Rodzhuk -> IN_CATEGORY -> bp2026", - "Rostyslav Rodzhuk -> IN_CATEGORY -> vp2025", - "bp2026 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2026", + "Rostyslav Rodzhuk -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2025" ], "expected_entity_set": [ "bp2026", "vp2025" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23820,19 +26217,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Dávid Omasta s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?", "expected_documents": [ "pages/students/2018/david_omasta/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" ], "expected_answer_contains": [ "Dávid Omasta", "dp2023", - "dp2024", - "Daniel Hladek" + "dp2024" ], "should_answer": true, "graph": { @@ -23853,27 +26248,23 @@ { "type": "category", "value": "dp2024" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Dávid Omasta -> IN_CATEGORY -> dp2023", - "Dávid Omasta -> IN_CATEGORY -> dp2024", - "dp2023 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Dávid Omasta -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2023", + "Dávid Omasta -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024" ], "expected_entity_set": [ "dp2023", "dp2024" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23886,19 +26277,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Ondrej Megela s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?", "expected_documents": [ "pages/students/2018/ondrej_megela/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" ], "expected_answer_contains": [ "Ondrej Megela", "bp2021", - "dp2023", - "Daniel Hladek" + "dp2023" ], "should_answer": true, "graph": { @@ -23919,27 +26308,23 @@ { "type": "category", "value": "dp2023" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Ondrej Megela -> IN_CATEGORY -> bp2021", - "Ondrej Megela -> IN_CATEGORY -> dp2023", - "bp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Ondrej Megela -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2021", + "Ondrej Megela -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2023" ], "expected_entity_set": [ "bp2021", "dp2023" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -23952,19 +26337,17 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Lukáš Pokrývka s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?", "expected_documents": [ "pages/students/2016/lukas_pokryvka/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" ], "expected_answer_contains": [ "Lukáš Pokrývka", "bp2019", - "dp2021", - "Daniel Hladek" + "dp2021" ], "should_answer": true, "graph": { @@ -23985,27 +26368,23 @@ { "type": "category", "value": "dp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Lukáš Pokrývka -> IN_CATEGORY -> bp2019", - "Lukáš Pokrývka -> IN_CATEGORY -> dp2021", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021" ], "expected_entity_set": [ "bp2019", "dp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24018,19 +26397,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Dominik Nagy s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?", "expected_documents": [ "pages/students/2016/dominik_nagy/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" ], "expected_answer_contains": [ "Dominik Nagy", "bp2019", - "dp2022", - "Daniel Hladek" + "dp2022" ], "should_answer": true, "graph": { @@ -24051,27 +26428,23 @@ { "type": "category", "value": "dp2022" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Dominik Nagy -> IN_CATEGORY -> bp2019", - "Dominik Nagy -> IN_CATEGORY -> dp2022", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Dominik Nagy -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Dominik Nagy -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022" ], "expected_entity_set": [ "bp2019", "dp2022" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24084,19 +26457,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Maroš Harahus s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" ], "expected_answer_contains": [ "Maroš Harahus", "bp2019", - "dp2021", - "Daniel Hladek" + "dp2021" ], "should_answer": true, "graph": { @@ -24117,27 +26488,23 @@ { "type": "category", "value": "dp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Maroš Harahus -> IN_CATEGORY -> bp2019", - "Maroš Harahus -> IN_CATEGORY -> dp2021", - "bp2019 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Maroš Harahus -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2019", + "Maroš Harahus -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021" ], "expected_entity_set": [ "bp2019", "dp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24150,20 +26517,18 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Valerii Kutsenko s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?", "expected_documents": [ "pages/students/2022/valerii_kutsenko/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" ], "expected_answer_contains": [ "Valerii Kutsenko", "bp2025", "dp2027", - "vp2024", - "Daniel Hladek" + "vp2024" ], "should_answer": true, "graph": { @@ -24188,30 +26553,25 @@ { "type": "category", "value": "vp2024" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Valerii Kutsenko -> IN_CATEGORY -> bp2025", - "Valerii Kutsenko -> IN_CATEGORY -> dp2027", - "Valerii Kutsenko -> IN_CATEGORY -> vp2024", - "bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027", + "Valerii Kutsenko -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> vp2024" ], "expected_entity_set": [ "bp2025", "dp2027", "vp2024" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24224,20 +26584,18 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Filip Tomáš s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?", "expected_documents": [ "pages/students/2019/filip_tomas/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" ], "expected_answer_contains": [ "Filip Tomáš", "bp2022", "dp2024", - "dp2025", - "Daniel Hladek" + "dp2025" ], "should_answer": true, "graph": { @@ -24262,30 +26620,25 @@ { "type": "category", "value": "dp2025" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Filip Tomáš -> IN_CATEGORY -> bp2022", - "Filip Tomáš -> IN_CATEGORY -> dp2024", - "Filip Tomáš -> IN_CATEGORY -> dp2025", - "bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024", + "Filip Tomáš -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2025" ], "expected_entity_set": [ "bp2022", "dp2024", "dp2025" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24298,20 +26651,18 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Patrik Pavlišin s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?", "expected_documents": [ "pages/students/2016/patrik_pavlisin/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" ], "expected_answer_contains": [ "Patrik Pavlišin", "bp2020", "dp2022", - "tp2021", - "Daniel Hladek" + "tp2021" ], "should_answer": true, "graph": { @@ -24336,30 +26687,25 @@ { "type": "category", "value": "tp2021" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Patrik Pavlišin -> IN_CATEGORY -> bp2020", - "Patrik Pavlišin -> IN_CATEGORY -> dp2022", - "Patrik Pavlišin -> IN_CATEGORY -> tp2021", - "bp2020 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2020", + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022", + "Patrik Pavlišin -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> tp2021" ], "expected_entity_set": [ "bp2020", "dp2022", "tp2021" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24372,19 +26718,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Kristián Sopkovič s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" ], "expected_answer_contains": [ "Kristián Sopkovič", "bp2022", - "dp2024", - "Daniel Hladek" + "dp2024" ], "should_answer": true, "graph": { @@ -24405,27 +26749,23 @@ { "type": "category", "value": "dp2024" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Kristián Sopkovič -> IN_CATEGORY -> bp2022", - "Kristián Sopkovič -> IN_CATEGORY -> dp2024", - "bp2022 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2022", + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2024" ], "expected_entity_set": [ "bp2022", "dp2024" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24438,19 +26778,17 @@ "split": "test", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Oleh Poiasnik s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" ], "expected_answer_contains": [ "Oleh Poiasnik", "bp2025", - "dp2027", - "Daniel Hladek" + "dp2027" ], "should_answer": true, "graph": { @@ -24471,27 +26809,23 @@ { "type": "category", "value": "dp2027" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Oleh Poiasnik -> IN_CATEGORY -> bp2025", - "Oleh Poiasnik -> IN_CATEGORY -> dp2027", - "bp2025 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> bp2025", + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2027" ], "expected_entity_set": [ "bp2025", "dp2027" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24504,19 +26838,17 @@ "split": "dev", "category": "person_multiple_categories", "difficulty": "hard", - "question": "Aké kategórie spájajú osobu Tomáš Kuchárik s autorom Daniel Hladek?", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?", "expected_documents": [ "pages/students/2016/tomas_kucharik/README.md" ], "expected_source_urls": [ - "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", - "https://zp.kemt.fei.tuke.sk/authors/daniel-hladek" + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" ], "expected_answer_contains": [ "Tomáš Kuchárik", "dp2021", - "dp2022", - "Daniel Hladek" + "dp2022" ], "should_answer": true, "graph": { @@ -24537,27 +26869,23 @@ { "type": "category", "value": "dp2022" - }, - { - "type": "author", - "value": "Daniel Hladek" } ], "expected_relations": [ - "IN_CATEGORY", - "IN_CATEGORY", - "CATEGORY_AUTHORED_BY" + "HAS_DOCUMENT", + "IN_CATEGORY" ], "expected_paths": [ - "Tomáš Kuchárik -> IN_CATEGORY -> dp2021", - "Tomáš Kuchárik -> IN_CATEGORY -> dp2022", - "dp2021 -> CATEGORY_AUTHORED_BY -> Daniel Hladek" + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2021", + "Tomáš Kuchárik -> HAS_DOCUMENT -> Document -> IN_CATEGORY -> dp2022" ], "expected_entity_set": [ "dp2021", "dp2022" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [] }, "evidence_basis": [ "questions_extended_2000", @@ -24627,13 +26955,11 @@ "value": "Maroš Harahus" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Jakub Maruniak -> HAS_WORK_YEAR -> 2021", - "Ján Holp -> HAS_WORK_YEAR -> 2021", - "Maroš Harahus -> HAS_WORK_YEAR -> 2021" + "Jakub Maruniak -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Ján Holp -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Maroš Harahus -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -24641,7 +26967,17 @@ "Ján Holp", "Maroš Harahus" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -24710,13 +27046,11 @@ "value": "Kristián Sopkovič" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022", - "Dominik Nagy -> HAS_WORK_YEAR -> 2022", - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Dominik Nagy -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -24724,7 +27058,17 @@ "Dominik Nagy", "Kristián Sopkovič" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -24782,19 +27126,27 @@ "value": "Lukáš Pokrývka" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dárius Lindvai -> HAS_WORK_YEAR -> 2021", - "Lukáš Pokrývka -> HAS_WORK_YEAR -> 2021" + "Dárius Lindvai -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Lukáš Pokrývka -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Dárius Lindvai", "Lukáš Pokrývka" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -24863,13 +27215,11 @@ "value": "Márk Fehér" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Alina Vitko -> HAS_WORK_YEAR -> 2022", - "Filip Tomáš -> HAS_WORK_YEAR -> 2022", - "Márk Fehér -> HAS_WORK_YEAR -> 2022" + "Alina Vitko -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Filip Tomáš -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Márk Fehér -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -24877,7 +27227,17 @@ "Filip Tomáš", "Márk Fehér" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -24935,19 +27295,27 @@ "value": "Patrik Pavlišin" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ondrej Megela -> HAS_WORK_YEAR -> 2020", - "Patrik Pavlišin -> HAS_WORK_YEAR -> 2020" + "Ondrej Megela -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Patrik Pavlišin -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Ondrej Megela", "Patrik Pavlišin" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25005,19 +27373,27 @@ "value": "Martin Wencel" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dmytro Ushatenko -> HAS_WORK_YEAR -> 2020", - "Martin Wencel -> HAS_WORK_YEAR -> 2020" + "Dmytro Ushatenko -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Martin Wencel -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Dmytro Ushatenko", "Martin Wencel" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25075,19 +27451,27 @@ "value": "Vladimír Ferko" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dávid Omasta -> HAS_WORK_YEAR -> 2024", - "Vladimír Ferko -> HAS_WORK_YEAR -> 2024" + "Dávid Omasta -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Vladimír Ferko -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Dávid Omasta", "Vladimír Ferko" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25156,13 +27540,11 @@ "value": "Maksym Zatirka" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026", - "Ján Malinovský -> HAS_WORK_YEAR -> 2026", - "Maksym Zatirka -> HAS_WORK_YEAR -> 2026" + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Ján Malinovský -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Maksym Zatirka -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -25170,7 +27552,17 @@ "Ján Malinovský", "Maksym Zatirka" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25239,13 +27631,11 @@ "value": "Matej Ščišľak" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ján Pták -> HAS_WORK_YEAR -> 2026", - "Matej Novotný -> HAS_WORK_YEAR -> 2026", - "Matej Ščišľak -> HAS_WORK_YEAR -> 2026" + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Matej Novotný -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Matej Ščišľak -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -25253,7 +27643,17 @@ "Matej Novotný", "Matej Ščišľak" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25311,19 +27711,27 @@ "value": "Oleh Poiasnik" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Andrii Pervashov -> HAS_WORK_YEAR -> 2027", - "Oleh Poiasnik -> HAS_WORK_YEAR -> 2027" + "Andrii Pervashov -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Oleh Poiasnik -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Andrii Pervashov", "Oleh Poiasnik" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25381,19 +27789,27 @@ "value": "Tetiana Mohorian" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Daniil Huzenko -> HAS_WORK_YEAR -> 2025", - "Tetiana Mohorian -> HAS_WORK_YEAR -> 2025" + "Daniil Huzenko -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Tetiana Mohorian -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Daniil Huzenko", "Tetiana Mohorian" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25462,13 +27878,11 @@ "value": "Maroš Harahus" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Jakub Maruniak -> HAS_WORK_YEAR -> 2021", - "Ján Holp -> HAS_WORK_YEAR -> 2021", - "Maroš Harahus -> HAS_WORK_YEAR -> 2021" + "Jakub Maruniak -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Ján Holp -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Maroš Harahus -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -25476,7 +27890,17 @@ "Ján Holp", "Maroš Harahus" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25545,13 +27969,11 @@ "value": "Kristián Sopkovič" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Artem Yatsenko -> HAS_WORK_YEAR -> 2022", - "Dominik Nagy -> HAS_WORK_YEAR -> 2022", - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022" + "Artem Yatsenko -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Dominik Nagy -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -25559,7 +27981,17 @@ "Dominik Nagy", "Kristián Sopkovič" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25617,19 +28049,27 @@ "value": "Lukáš Pokrývka" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Dárius Lindvai -> HAS_WORK_YEAR -> 2021", - "Lukáš Pokrývka -> HAS_WORK_YEAR -> 2021" + "Dárius Lindvai -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Lukáš Pokrývka -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Dárius Lindvai", "Lukáš Pokrývka" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25698,13 +28138,11 @@ "value": "Márk Fehér" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Alina Vitko -> HAS_WORK_YEAR -> 2022", - "Filip Tomáš -> HAS_WORK_YEAR -> 2022", - "Márk Fehér -> HAS_WORK_YEAR -> 2022" + "Alina Vitko -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Filip Tomáš -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Márk Fehér -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 3, "expected_entity_set": [ @@ -25712,7 +28150,17 @@ "Filip Tomáš", "Márk Fehér" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25770,19 +28218,27 @@ "value": "Patrik Pavlišin" } ], - "expected_relations": [ - "HAS_WORK_YEAR" - ], + "expected_relations": [], "expected_paths": [ - "Ondrej Megela -> HAS_WORK_YEAR -> 2020", - "Patrik Pavlišin -> HAS_WORK_YEAR -> 2020" + "Ondrej Megela -> (AUTHORED Thesis | HAS_WORK Work) [year=None]", + "Patrik Pavlišin -> (AUTHORED Thesis | HAS_WORK Work) [year=None]" ], "expected_count": 2, "expected_entity_set": [ "Ondrej Megela", "Patrik Pavlišin" ], - "entity_set_mode": "exact" + "entity_set_mode": "exact", + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] + ] }, "evidence_basis": [ "questions_extended_2000" @@ -25794,7 +28250,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument súvisí s témou inštrukcie a jej práca je uvedená v roku 2026?", + "question": "Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo inštrukcie a jej práca je uvedená v roku 2026?", "expected_documents": [ "pages/students/2023/denis_le_thanh/README.md", "pages/students/2022/jan_malinovsky/README.md" @@ -25829,7 +28285,7 @@ "value": "Denis Le Thanh" }, { - "type": "topic", + "type": "keyword", "value": "inštrukcie" }, { @@ -25838,12 +28294,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Denis Le Thanh -> MENTIONS_TOPIC -> inštrukcie", - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026" + "Denis Le Thanh -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> inštrukcie", + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -25856,7 +28322,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument súvisí s témou Slovak Mistral a jej práca je uvedená v roku 2026?", + "question": "Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Slovak Mistral a jej práca je uvedená v roku 2026?", "expected_documents": [ "pages/students/2023/denis_le_thanh/README.md", "pages/students/2022/jan_malinovsky/README.md" @@ -25891,7 +28357,7 @@ "value": "Denis Le Thanh" }, { - "type": "topic", + "type": "keyword", "value": "Slovak Mistral" }, { @@ -25900,12 +28366,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Denis Le Thanh -> MENTIONS_TOPIC -> Slovak Mistral", - "Denis Le Thanh -> HAS_WORK_YEAR -> 2026" + "Denis Le Thanh -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Slovak Mistral", + "Denis Le Thanh -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -25918,7 +28394,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Oleh Poiasnik a Andrii Pervashov spĺňa obe podmienky: jej dokument súvisí s témou znalostný graf a jej práca je uvedená v roku 2027?", + "question": "Ktorá z osôb Oleh Poiasnik a Andrii Pervashov spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo znalostný graf a jej práca je uvedená v roku 2027?", "expected_documents": [ "pages/students/2022/oleh_poiasnik/README.md", "pages/students/2022/andrii_pervashov/README.md" @@ -25953,7 +28429,7 @@ "value": "Oleh Poiasnik" }, { - "type": "topic", + "type": "keyword", "value": "znalostný graf" }, { @@ -25962,12 +28438,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Oleh Poiasnik -> MENTIONS_TOPIC -> znalostný graf", - "Oleh Poiasnik -> HAS_WORK_YEAR -> 2027" + "Oleh Poiasnik -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> znalostný graf", + "Oleh Poiasnik -> (AUTHORED Thesis | HAS_WORK Work) [year=2027]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -25980,7 +28466,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Ján Pták a Matej Novotný spĺňa obe podmienky: jej dokument súvisí s témou OpenWebUI a jej práca je uvedená v roku 2026?", + "question": "Ktorá z osôb Ján Pták a Matej Novotný spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo OpenWebUI a jej práca je uvedená v roku 2026?", "expected_documents": [ "pages/students/2022/jan_ptak/README.md", "pages/students/2021/matej_novotny/README.md" @@ -26015,7 +28501,7 @@ "value": "Ján Pták" }, { - "type": "topic", + "type": "keyword", "value": "OpenWebUI" }, { @@ -26024,12 +28510,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ján Pták -> MENTIONS_TOPIC -> OpenWebUI", - "Ján Pták -> HAS_WORK_YEAR -> 2026" + "Ján Pták -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> OpenWebUI", + "Ján Pták -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26042,7 +28538,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument súvisí s témou Elasticsearch a jej práca je uvedená v roku 2022?", + "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Elasticsearch a jej práca je uvedená v roku 2022?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -26077,7 +28573,7 @@ "value": "Michal Stromko" }, { - "type": "topic", + "type": "keyword", "value": "Elasticsearch" }, { @@ -26086,12 +28582,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Michal Stromko -> MENTIONS_TOPIC -> Elasticsearch", - "Michal Stromko -> HAS_WORK_YEAR -> 2022" + "Michal Stromko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Elasticsearch", + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26104,7 +28610,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument súvisí s témou LLM a jej práca je uvedená v roku 2025?", + "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo LLM a jej práca je uvedená v roku 2025?", "expected_documents": [ "pages/students/2022/tetiana_mohorian/README.md", "pages/students/2022/daniil_huzenko/README.md" @@ -26139,7 +28645,7 @@ "value": "Tetiana Mohorian" }, { - "type": "topic", + "type": "keyword", "value": "LLM" }, { @@ -26148,12 +28654,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tetiana Mohorian -> MENTIONS_TOPIC -> LLM", - "Tetiana Mohorian -> HAS_WORK_YEAR -> 2025" + "Tetiana Mohorian -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> LLM", + "Tetiana Mohorian -> (AUTHORED Thesis | HAS_WORK Work) [year=2025]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26166,7 +28682,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Martin Wencel a Dmytro Ushatenko spĺňa obe podmienky: jej dokument súvisí s témou pomenované entity a jej práca je uvedená v roku 2020?", + "question": "Ktorá z osôb Martin Wencel a Dmytro Ushatenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo pomenované entity a jej práca je uvedená v roku 2020?", "expected_documents": [ "pages/students/2018/martin_wencel/README.md", "pages/students/2017/dmytro_ushatenko/README.md" @@ -26201,7 +28717,7 @@ "value": "Martin Wencel" }, { - "type": "topic", + "type": "keyword", "value": "pomenované entity" }, { @@ -26210,12 +28726,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Martin Wencel -> MENTIONS_TOPIC -> pomenované entity", - "Martin Wencel -> HAS_WORK_YEAR -> 2020" + "Martin Wencel -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> pomenované entity", + "Martin Wencel -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26228,7 +28754,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument súvisí s témou FAISS a jej práca je uvedená v roku 2022?", + "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo FAISS a jej práca je uvedená v roku 2022?", "expected_documents": [ "pages/students/2019/michal_stromko/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -26263,7 +28789,7 @@ "value": "Michal Stromko" }, { - "type": "topic", + "type": "keyword", "value": "FAISS" }, { @@ -26272,12 +28798,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Michal Stromko -> MENTIONS_TOPIC -> FAISS", - "Michal Stromko -> HAS_WORK_YEAR -> 2022" + "Michal Stromko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> FAISS", + "Michal Stromko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26290,7 +28826,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Dárius Lindvai a Lukáš Pokrývka spĺňa obe podmienky: jej dokument súvisí s témou CRF a jej práca je uvedená v roku 2021?", + "question": "Ktorá z osôb Dárius Lindvai a Lukáš Pokrývka spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo CRF a jej práca je uvedená v roku 2021?", "expected_documents": [ "pages/students/2016/darius_lindvai/README.md", "pages/students/2016/lukas_pokryvka/README.md" @@ -26325,7 +28861,7 @@ "value": "Dárius Lindvai" }, { - "type": "topic", + "type": "keyword", "value": "CRF" }, { @@ -26334,12 +28870,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Dárius Lindvai -> MENTIONS_TOPIC -> CRF", - "Dárius Lindvai -> HAS_WORK_YEAR -> 2021" + "Dárius Lindvai -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> CRF", + "Dárius Lindvai -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26352,7 +28898,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument súvisí s témou prompting a jej práca je uvedená v roku 2025?", + "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo prompting a jej práca je uvedená v roku 2025?", "expected_documents": [ "pages/students/2022/tetiana_mohorian/README.md", "pages/students/2022/daniil_huzenko/README.md" @@ -26387,7 +28933,7 @@ "value": "Tetiana Mohorian" }, { - "type": "topic", + "type": "keyword", "value": "prompting" }, { @@ -26396,12 +28942,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Tetiana Mohorian -> MENTIONS_TOPIC -> prompting", - "Tetiana Mohorian -> HAS_WORK_YEAR -> 2025" + "Tetiana Mohorian -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> prompting", + "Tetiana Mohorian -> (AUTHORED Thesis | HAS_WORK Work) [year=2025]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26414,7 +28970,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Alina Vitko a Filip Tomáš spĺňa obe podmienky: jej dokument súvisí s témou Streamlit a jej práca je uvedená v roku 2022?", + "question": "Ktorá z osôb Alina Vitko a Filip Tomáš spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Streamlit a jej práca je uvedená v roku 2022?", "expected_documents": [ "pages/students/2019/alina_vitko/README.md", "pages/students/2019/filip_tomas/README.md" @@ -26449,7 +29005,7 @@ "value": "Alina Vitko" }, { - "type": "topic", + "type": "keyword", "value": "Streamlit" }, { @@ -26458,12 +29014,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Alina Vitko -> MENTIONS_TOPIC -> Streamlit", - "Alina Vitko -> HAS_WORK_YEAR -> 2022" + "Alina Vitko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Streamlit", + "Alina Vitko -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26476,7 +29042,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Yevhenii Medushivskyi a Ján Pták spĺňa obe podmienky: jej dokument súvisí s témou webový korpus a jej práca je uvedená v roku 2026?", + "question": "Ktorá z osôb Yevhenii Medushivskyi a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo webový korpus a jej práca je uvedená v roku 2026?", "expected_documents": [ "pages/students/2023/yevhenii_medushivskyi/README.md", "pages/students/2022/jan_ptak/README.md" @@ -26511,7 +29077,7 @@ "value": "Yevhenii Medushivskyi" }, { - "type": "topic", + "type": "keyword", "value": "webový korpus" }, { @@ -26520,12 +29086,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Yevhenii Medushivskyi -> MENTIONS_TOPIC -> webový korpus", - "Yevhenii Medushivskyi -> HAS_WORK_YEAR -> 2026" + "Yevhenii Medushivskyi -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> webový korpus", + "Yevhenii Medushivskyi -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26538,7 +29114,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Simona Bobrovčanová a Ján Pták spĺňa obe podmienky: jej dokument súvisí s témou právne dokumenty a jej práca je uvedená v roku 2026?", + "question": "Ktorá z osôb Simona Bobrovčanová a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo právne dokumenty a jej práca je uvedená v roku 2026?", "expected_documents": [ "pages/students/2023/simona_bobrovcanova/README.md", "pages/students/2022/jan_ptak/README.md" @@ -26573,7 +29149,7 @@ "value": "Simona Bobrovčanová" }, { - "type": "topic", + "type": "keyword", "value": "právne dokumenty" }, { @@ -26582,12 +29158,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Simona Bobrovčanová -> MENTIONS_TOPIC -> právne dokumenty", - "Simona Bobrovčanová -> HAS_WORK_YEAR -> 2026" + "Simona Bobrovčanová -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> právne dokumenty", + "Simona Bobrovčanová -> (AUTHORED Thesis | HAS_WORK Work) [year=2026]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26600,7 +29186,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Dmytro Ushatenko a Martin Wencel spĺňa obe podmienky: jej dokument súvisí s témou chatbot a jej práca je uvedená v roku 2020?", + "question": "Ktorá z osôb Dmytro Ushatenko a Martin Wencel spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo chatbot a jej práca je uvedená v roku 2020?", "expected_documents": [ "pages/students/2017/dmytro_ushatenko/README.md", "pages/students/2018/martin_wencel/README.md" @@ -26635,7 +29221,7 @@ "value": "Dmytro Ushatenko" }, { - "type": "topic", + "type": "keyword", "value": "chatbot" }, { @@ -26644,12 +29230,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Dmytro Ushatenko -> MENTIONS_TOPIC -> chatbot", - "Dmytro Ushatenko -> HAS_WORK_YEAR -> 2020" + "Dmytro Ushatenko -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> chatbot", + "Dmytro Ushatenko -> (AUTHORED Thesis | HAS_WORK Work) [year=2020]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26662,7 +29258,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Kristián Sopkovič a Artem Yatsenko spĺňa obe podmienky: jej dokument súvisí s témou slovenčina a jej práca je uvedená v roku 2022?", + "question": "Ktorá z osôb Kristián Sopkovič a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenčina a jej práca je uvedená v roku 2022?", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -26697,7 +29293,7 @@ "value": "Kristián Sopkovič" }, { - "type": "topic", + "type": "keyword", "value": "slovenčina" }, { @@ -26706,12 +29302,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Kristián Sopkovič -> MENTIONS_TOPIC -> slovenčina", - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022" + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenčina", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26724,7 +29330,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Andrii Pervashov a Oleh Poiasnik spĺňa obe podmienky: jej dokument súvisí s témou speech-to-text a jej práca je uvedená v roku 2027?", + "question": "Ktorá z osôb Andrii Pervashov a Oleh Poiasnik spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo speech-to-text a jej práca je uvedená v roku 2027?", "expected_documents": [ "pages/students/2022/andrii_pervashov/README.md", "pages/students/2022/oleh_poiasnik/README.md" @@ -26759,7 +29365,7 @@ "value": "Andrii Pervashov" }, { - "type": "topic", + "type": "keyword", "value": "speech-to-text" }, { @@ -26768,12 +29374,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Andrii Pervashov -> MENTIONS_TOPIC -> speech-to-text", - "Andrii Pervashov -> HAS_WORK_YEAR -> 2027" + "Andrii Pervashov -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> speech-to-text", + "Andrii Pervashov -> (AUTHORED Thesis | HAS_WORK Work) [year=2027]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26786,7 +29402,7 @@ "split": "test", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Lukáš Pokrývka a Dárius Lindvai spĺňa obe podmienky: jej dokument súvisí s témou GPU a jej práca je uvedená v roku 2021?", + "question": "Ktorá z osôb Lukáš Pokrývka a Dárius Lindvai spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo GPU a jej práca je uvedená v roku 2021?", "expected_documents": [ "pages/students/2016/lukas_pokryvka/README.md", "pages/students/2016/darius_lindvai/README.md" @@ -26821,7 +29437,7 @@ "value": "Lukáš Pokrývka" }, { - "type": "topic", + "type": "keyword", "value": "GPU" }, { @@ -26830,12 +29446,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Lukáš Pokrývka -> MENTIONS_TOPIC -> GPU", - "Lukáš Pokrývka -> HAS_WORK_YEAR -> 2021" + "Lukáš Pokrývka -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> GPU", + "Lukáš Pokrývka -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26848,7 +29474,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Maroš Harahus a Artem Yatsenko spĺňa obe podmienky: jej dokument súvisí s témou Spacy a jej práca je uvedená v roku 2021?", + "question": "Ktorá z osôb Maroš Harahus a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2021?", "expected_documents": [ "pages/students/2016/maros_harahus/README.md", "pages/students/2019/artem_yatsenko/README.md" @@ -26883,7 +29509,7 @@ "value": "Maroš Harahus" }, { - "type": "topic", + "type": "keyword", "value": "Spacy" }, { @@ -26892,12 +29518,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Maroš Harahus -> MENTIONS_TOPIC -> Spacy", - "Maroš Harahus -> HAS_WORK_YEAR -> 2021" + "Maroš Harahus -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy", + "Maroš Harahus -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26910,7 +29546,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Ján Holp a Jakub Maruniak spĺňa obe podmienky: jej dokument súvisí s témou slovenský internet a jej práca je uvedená v roku 2021?", + "question": "Ktorá z osôb Ján Holp a Jakub Maruniak spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenský internet a jej práca je uvedená v roku 2021?", "expected_documents": [ "pages/students/2016/jan_holp/README.md", "pages/students/2016/jakub_maruniak/README.md" @@ -26945,7 +29581,7 @@ "value": "Ján Holp" }, { - "type": "topic", + "type": "keyword", "value": "slovenský internet" }, { @@ -26954,12 +29590,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Ján Holp -> MENTIONS_TOPIC -> slovenský internet", - "Ján Holp -> HAS_WORK_YEAR -> 2021" + "Ján Holp -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> slovenský internet", + "Ján Holp -> (AUTHORED Thesis | HAS_WORK Work) [year=2021]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ @@ -26972,7 +29618,7 @@ "split": "dev", "category": "conjunctive_disambiguation", "difficulty": "hard", - "question": "Ktorá z osôb Kristián Sopkovič a Dominik Nagy spĺňa obe podmienky: jej dokument súvisí s témou Spacy a jej práca je uvedená v roku 2022?", + "question": "Ktorá z osôb Kristián Sopkovič a Dominik Nagy spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2022?", "expected_documents": [ "pages/students/2019/kristian_sopkovic/README.md", "pages/students/2016/dominik_nagy/README.md" @@ -27007,7 +29653,7 @@ "value": "Kristián Sopkovič" }, { - "type": "topic", + "type": "keyword", "value": "Spacy" }, { @@ -27016,12 +29662,22 @@ } ], "expected_relations": [ - "MENTIONS_TOPIC", - "HAS_WORK_YEAR" + "HAS_DOCUMENT", + "HAS_KEYWORD" ], "expected_paths": [ - "Kristián Sopkovič -> MENTIONS_TOPIC -> Spacy", - "Kristián Sopkovič -> HAS_WORK_YEAR -> 2022" + "Kristián Sopkovič -> HAS_DOCUMENT -> Document -> HAS_KEYWORD -> Spacy", + "Kristián Sopkovič -> (AUTHORED Thesis | HAS_WORK Work) [year=2022]" + ], + "schema_version": 2, + "expected_properties": [ + "Thesis.year|Work.year" + ], + "expected_relation_choices": [ + [ + "AUTHORED", + "HAS_WORK" + ] ] }, "evidence_basis": [ diff --git a/tools/graphrag/evaluation/reproducibility.py b/tools/graphrag/evaluation/reproducibility.py new file mode 100644 index 0000000..1970004 --- /dev/null +++ b/tools/graphrag/evaluation/reproducibility.py @@ -0,0 +1,68 @@ +"""Content fingerprints used to freeze retrieval before holdout evaluation.""" +from __future__ import annotations + +import hashlib +import json +import platform +import subprocess +from datetime import datetime, timezone +from pathlib import Path +from typing import Any + +ROOT = Path(__file__).resolve().parents[3] + + +def sha256_file(path: Path) -> str: + return hashlib.sha256(path.read_bytes()).hexdigest() + + +def content_fingerprints(questions: Path, root: Path = ROOT) -> dict[str, Any]: + files = sorted((root / 'tools/graphrag').rglob('*.py')) + # requirements.txt and tools/ are present both in the checkout and image. + files.append(root / 'requirements.txt') + return { + 'implementation': {str(path.relative_to(root)): sha256_file(path) for path in files}, + 'dataset_sha256': sha256_file(questions), + 'inputs': {name: sha256_file(root / name) for name in ['data/documents.json', 'data/chunks.json']}, + } + + +def graph_fingerprint(session: Any) -> dict[str, Any]: + nodes = session.run( + 'MATCH (n) WHERE n.graph_scope = $scope ' + 'RETURN labels(n) AS labels, properties(n) AS properties', scope='zpwiki' + ).data() + edges = session.run( + 'MATCH (a)-[r]->(b) WHERE a.graph_scope = $scope AND b.graph_scope = $scope ' + 'RETURN labels(a) AS source_labels, coalesce(a.id, a.path, a.name) AS source, ' + 'type(r) AS type, properties(r) AS properties, labels(b) AS target_labels, ' + 'coalesce(b.id, b.path, b.name) AS target', scope='zpwiki' + ).data() + # elementId and row order are deliberately excluded: they change on rebuild. + canonical = lambda rows: sorted(json.dumps(row, sort_keys=True, ensure_ascii=False, default=str) for row in rows) + content = json.dumps({'nodes': canonical(nodes), 'relationships': canonical(edges)}, ensure_ascii=False) + return {'sha256': hashlib.sha256(content.encode()).hexdigest(), + 'nodes': len(nodes), 'relationships': len(edges)} + + +def run_metadata(questions: Path) -> dict[str, Any]: + def revision(path: Path) -> str | None: + result = subprocess.run(['git', '-C', str(path), 'rev-parse', 'HEAD'], + text=True, capture_output=True, check=False) + return result.stdout.strip() if result.returncode == 0 else None + return {'started_at_utc': datetime.now(timezone.utc).isoformat(), + 'python': platform.python_version(), 'git_head': revision(ROOT), + 'wiki_git_head': revision(ROOT.parent / 'zpwiki'), + 'fingerprints': content_fingerprints(questions)} + + +def verify_freeze(manifest: dict, metadata: dict, graph: dict, *, limit: int, max_entities: int, + audit: Path | None) -> None: + if manifest['fingerprints'] != metadata['fingerprints']: + raise RuntimeError('Frozen implementation, benchmark or inputs changed. TEST refused.') + if manifest['graph'] != graph: + raise RuntimeError('Neo4j graph changed since DEV freeze. TEST refused.') + if manifest['parameters'] != {'limit': limit, 'max_entities': max_entities}: + raise RuntimeError('Retrieval parameters differ from DEV freeze. TEST refused.') + if audit is None or sha256_file(audit) != manifest['audit_sha256']: + raise RuntimeError('Source audit differs from DEV freeze. TEST refused.') diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/REPORT.md b/tools/graphrag/evaluation/results/final_2026-10-24/REPORT.md new file mode 100644 index 0000000..b39fba9 --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/REPORT.md @@ -0,0 +1,68 @@ +# GraphRAG: finálna evaluácia v1 — 24. 10. 2026 + +Vyhľadávanie bolo ladené na DEV, potom zmrazené pomocou `../../frozen_v1.json` a až následne vyhodnotené na celom TESTe. Po finálnom TESTe sa implementácia, evaluator, benchmark ani audit nemenili. + +## Výsledky + +| Beh | Strict | Úspešnosť | Runtime chyby | Priemer | Medián | p95 | +|---|---:|---:|---:|---:|---:|---:| +| Pôvodné vyhľadávanie, aktuálny evaluator (DEV) | 106/286 | 37.06 % | 0 | 29.99 ms | 28.12 ms | 41.82 ms | +| Finálny DEV | 209/286 | 73.08 % | 0 | 32.79 ms | 32.21 ms | 41.83 ms | +| Finálny TEST | 152/214 | 71.03 % | 0 | 29.58 ms | 29.33 ms | 33.78 ms | + +Pôvodné vyhľadávanie pochádza z commitu `9f3483d`; jeho odtlačok je v `baseline_dev.json`. Porovnanie používa rovnaký benchmark, graf, parametre a aktuálny sprísnený evaluator. Historický baseline 127/286 = 44,41 % používal starší evaluator; priamo porovnateľný baseline je 106/286 = 37,06 %. + +Latencie merajú samotné grafové vyhľadávanie. Neobsahujú tvorbu odpovede LLM, volanie OpenWebUI ani úvodný odtlačok celého grafu. Nie sú porovnateľné s približne 19 sekundami celého klasického RAG toku. + +## Nesúlady benchmarku so zdrojmi + +Pred TESTom vznikol statický audit všetkých 500 otázok priamo proti vstupným dokumentom, tagom a deterministickému grafovému payloadu. Audit nepoužíva výstup vyhľadávania. Pôvodný benchmark zostal od začiatku tejto úpravy nezmenený bajt po bajte. Primárne skóre vyššie zahŕňa aj všetky problémové anotácie. + +| Zistený nesúlad | DEV | TEST | +|---|---:|---:| +| Očakávané kľúčové slovo nie je vo frontmatter katalógu | 66 | 46 | +| Tag existuje, ale nie je prepojený s očakávanou osobou | 5 | 11 | +| Presná očakávaná množina kategórií nezodpovedá aj poddokumentom | 6 | 3 | +| Spolu otázok so zisteným nesúladom | 77 | 60 | + +Textová zmienka o OpenWebUI alebo Elasticsearch v tele stránky sa podľa súčasného modelu nestáva uzlom `Keyword`. Rovnako sa automaticky nestotožňujú rôzne tagy alebo preklady. Vymyslenie grafového faktu na splnenie takýchto očakávaní by bolo nesprávne. + +Doplnkové výsledky pre podmnožinu bez zistených zdrojových nesúladov: + +| Sada | Strict | Úspešnosť | +|---|---:|---:| +| DEV | 209/209 | 100.00 % | +| TEST | 152/154 | 98.70 % | + +Toto je doplnková analýza, nie náhrada primárneho skóre ani dôkaz bezchybnosti všetkých ostatných anotácií. Pravidlá auditu a zoznam otázok boli uložené pred finálnym TESTom a overujú sa odtlačkom vo freeze manifeste. + +## Kategórie + +| Kategória | DEV strict | TEST strict | +|---|---:|---:| +| `candidate_set_aggregation` | 9/9 | 7/7 | +| `conjunctive_disambiguation` | 2/11 | 1/9 | +| `document_author_category_multi_hop` | 35/35 | 25/25 | +| `person_keyword_title` | 4/42 | 3/38 | +| `person_multiple_categories` | 15/21 | 6/9 | +| `person_title_year` | 44/44 | 36/36 | +| `same_academic_year_pair` | 56/56 | 42/44 | +| `same_start_year_pair` | 28/28 | 32/32 | +| `shared_keyword_pair` | 16/40 | 0/14 | + +Kompletné metriky hodnôt, typovaných entít, relácií, vlastností, množín, zdrojov, kategórií, obtiažností a latencií obsahujú JSON a CSV súbory. Document recall a source recall dosiahli v oboch finálnych behoch 1,0; recall kontextových zdrojov sám osebe neznamená správnu odpoveď. + +## Overenie a zostávajúce limity + +- Celá testovacia sada: **359 passed, 4 skipped**. Desiatich nových Neo4j integračných prípadov sa týka skutočné vykonanie Cypher dotazov v oddelených transakciách s rollbackom. +- Opravené sú skloňovanie názvu, otázky na spoločný rok bez číselného roku v otázke, spojenie názvu/tagu a roku/tagu pri tej istej osobe, autor/kategória pri tom istom dokumente a URL zdrojov vrátane zamietnutých kandidátov. +- Počítanie sa vykonáva pred prezentačným limitom. Orezaný výsledok nemôže prejsť strict hodnotením. +- Evaluator neuznáva názov ani inú hodnotu iba preto, že sa rozpoznala z otázky. Entity sa hodnotia podľa typu a pri agregácii sa kontroluje aj počet. +- Vo finálnom TESTe ostali **g0065 a g0129**, dve formulácie otázky na spoločný rok pri rovnakej dvojici osôb. Podklady obsahujú navyše dokument Martina Jančuru; pravdepodobnou príčinou je príliš široké fuzzy rozpoznávanie mena. Detaily sú v `holdout_failures.json`. Po tomto zistení sa kód neupravoval. +- V budúcej verzii treba túto nejednoznačnosť riešiť na samostatných vývojových prípadoch a pripraviť nový nezávislý holdout. Aktuálny TEST už nemá slúžiť ako nový nedotknutý test pre takto ladenú verziu. +- `expected_paths` sú opisné anotácie. Strict vyhodnocuje typované fakty, relácie a vlastnosti, nie doslovnú zhodu týchto textových reťazcov s cestou. +- Meria sa grafová retrieval vrstva, nie kvalita odpovede LLM. Otázky zdieľajú wiki a formulárové šablóny medzi DEV/TEST; výsledky nemožno vydávať za všeobecnú presnosť na ľubovoľných otázkach. + +## Rozhodnutie o stave + +Vývojový beh 3.3 je uzavretý pre v1, verzia 3.4 je obsahovo zmrazená, TEST 3.5 prebehol a metriky 3.6 sú uložené. Audit 3.1 odhalil 137 zdrojových nesúladov, ktoré sú explicitne zaznamenané. Finálny benchmark potrebuje novú zdrojovo overenú verziu pred formálnym porovnaním RAG a GraphRAG. Táto evaluácia ich nezakrýva úpravou otázok po TESTe. diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/baseline_dev.json b/tools/graphrag/evaluation/results/final_2026-10-24/baseline_dev.json new file mode 100644 index 0000000..3fba2d8 --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/baseline_dev.json @@ -0,0 +1,28460 @@ +{ + "description": "Original search, current strict evaluator, unchanged DEV benchmark; not a holdout run.", + "run_metadata": { + "started_at_utc": "2026-10-24T19:02:20.619615+00:00", + "python": "3.10.12", + "git_head": "9f3483d29017bee0d93ed4c225c9952c024d0029", + "wiki_git_head": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e", + "fingerprints": { + "implementation": { + "tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5", + "tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80", + "tools/graphrag/evaluation/evaluate_graphrag.py": "6bdf68307b6bb90731fe09a89955e96eee76fec13bdf82281a96715dd168680e", + "tools/graphrag/evaluation/freeze_graphrag.py": "32198eca7642f39a8ad33deefe0eea396d38fcc0f5bc5814cbb64ab6d3443b9e", + "tools/graphrag/evaluation/graphrag_evaluator.py": "267d4e9942b7767a78a3689e8f7c9d6ed49f025389b043b69449b2d225651160", + "tools/graphrag/evaluation/reproducibility.py": "5c28d8aa37ec6a973fa494f7e528c19af2f1326422ea7fd05912e01aa1af6725", + "tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2", + "tools/graphrag/graph_search.py": "20f466e8d9eef6a38e41860e9be9ebc719c93f38bcfa6f60aca0e1b56c7d6bca", + "tools/graphrag/graphrag.py": "bee2eb1f86d8df8e978495a61107edf723df2dc2e0468e3ecf844719ec635e1d", + "tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb", + "tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748", + "tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b", + "tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48", + "tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e", + "tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298", + "tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f", + "tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c", + "requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a" + }, + "dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e", + "inputs": { + "data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52", + "data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9" + } + }, + "baseline_search_sha256": "559f89ecaeb8bff7c3938df8c4091b0106936b3c611a104bb9d52eafac3b4f60", + "baseline_search_revision": "9f3483d", + "graph": { + "sha256": "0637d9ebb106c65d9aaa73d0634b28db81135e6a6c7503ea6b06c4a922e7e1e3", + "nodes": 422, + "relationships": 829 + } + }, + "summary": { + "questions": 286, + "strict_count": 106, + "strict_accuracy": 0.370629, + "error_count": 0, + "value_score": 0.772494, + "entity_score": 0.624126, + "relation_score": 0.853147, + "property_score": 0.793706, + "relation_choice_score": 0.870629, + "document_recall": 1.0, + "source_recall": 0.900058, + "latency_mean_seconds": 0.029989, + "latency_median_seconds": 0.028124, + "latency_p95_seconds": 0.041821 + }, + "source_consistent_summary": { + "questions": 209, + "strict_count": 106, + "strict_accuracy": 0.507177, + "error_count": 0, + "value_score": 0.801914, + "entity_score": 0.705742, + "relation_score": 0.838916, + "property_score": 0.717703, + "relation_choice_score": 0.822967, + "document_recall": 1.0, + "source_recall": 0.882376, + "latency_mean_seconds": 0.028891, + "latency_median_seconds": 0.027023, + "latency_p95_seconds": 0.036377 + }, + "by_category": { + "candidate_set_aggregation": { + "questions": 9, + "strict_count": 0, + "strict_accuracy": 0.0, + "error_count": 0, + "value_score": 0.955556, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.712963, + "latency_mean_seconds": 0.037933, + "latency_median_seconds": 0.034097, + "latency_p95_seconds": 0.051106 + }, + "conjunctive_disambiguation": { + "questions": 11, + "strict_count": 2, + "strict_accuracy": 0.181818, + "error_count": 0, + "value_score": 0.757576, + "entity_score": 0.727273, + "relation_score": 0.909091, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.046791, + "latency_median_seconds": 0.043334, + "latency_p95_seconds": 0.063605 + }, + "document_author_category_multi_hop": { + "questions": 35, + "strict_count": 0, + "strict_accuracy": 0.0, + "error_count": 0, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.025754, + "latency_median_seconds": 0.02551, + "latency_p95_seconds": 0.026803 + }, + "person_keyword_title": { + "questions": 42, + "strict_count": 4, + "strict_accuracy": 0.095238, + "error_count": 0, + "value_score": 0.753969, + "entity_score": 0.547619, + "relation_score": 0.920635, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.034614, + "latency_median_seconds": 0.033037, + "latency_p95_seconds": 0.041153 + }, + "person_multiple_categories": { + "questions": 21, + "strict_count": 15, + "strict_accuracy": 0.714286, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.025716, + "latency_median_seconds": 0.025642, + "latency_p95_seconds": 0.026465 + }, + "person_title_year": { + "questions": 44, + "strict_count": 22, + "strict_accuracy": 0.5, + "error_count": 0, + "value_score": 0.5, + "entity_score": 0.5, + "relation_score": 0.5, + "property_score": 0.5, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.5, + "latency_mean_seconds": 0.028318, + "latency_median_seconds": 0.028078, + "latency_p95_seconds": 0.031685 + }, + "same_academic_year_pair": { + "questions": 56, + "strict_count": 19, + "strict_accuracy": 0.339286, + "error_count": 0, + "value_score": 0.869048, + "entity_score": 0.607143, + "relation_score": 1.0, + "property_score": 0.339286, + "relation_choice_score": 0.339286, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.031571, + "latency_median_seconds": 0.030429, + "latency_p95_seconds": 0.036137 + }, + "same_start_year_pair": { + "questions": 28, + "strict_count": 28, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.026098, + "latency_median_seconds": 0.026113, + "latency_p95_seconds": 0.027236 + }, + "shared_keyword_pair": { + "questions": 40, + "strict_count": 16, + "strict_accuracy": 0.4, + "error_count": 0, + "value_score": 0.733333, + "entity_score": 0.4, + "relation_score": 0.9, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.9, + "latency_mean_seconds": 0.027022, + "latency_median_seconds": 0.026743, + "latency_p95_seconds": 0.028077 + } + }, + "questions": [ + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0001", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Maroš Harahus a Jakub Maruniak v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.027459, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0002", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Maroš Harahus a Jakub Maruniak cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.02663, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0003", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Maroš Harahus a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026976, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0004", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Maroš Harahus a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026687, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0005", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Maroš Harahus a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026956, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0006", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Maroš Harahus a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.02602, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0007", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Jakub Maruniak a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026366, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0008", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Jakub Maruniak a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.027089, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0009", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.02691, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0010", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.028072, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0011", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Kristián Sopkovič a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.027304, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0012", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Kristián Sopkovič a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.039569, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0013", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tomáš Kuchárik a Dávid Omasta v ZP Wiki prepojené cez kľúčové slovo Question Answering? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.025845, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dávid Omasta", + "Question Answering" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Question Answering" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0014", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tomáš Kuchárik a Dávid Omasta cez kľúčové slovo Question Answering a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.025311, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dávid Omasta", + "Question Answering" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Question Answering" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0015", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tomáš Kuchárik a Dominik Nagy v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.025997, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dominik Nagy", + "strojový preklad" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Dominik Nagy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0016", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tomáš Kuchárik a Dominik Nagy cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.027345, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dominik Nagy", + "strojový preklad" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Dominik Nagy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0017", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tomáš Kuchárik a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.027353, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0018", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tomáš Kuchárik a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026163, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0019", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Dominik Nagy a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026521, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [ + "Dominik Nagy", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0020", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Dominik Nagy a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026938, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [ + "Dominik Nagy", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0021", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo pomenované entity? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026379, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "pomenované entity" + ], + "matched_values": [ + "Jakub Maruniak", + "Artem Yatsenko" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "pomenované entity" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0022", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo pomenované entity a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026507, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "pomenované entity" + ], + "matched_values": [ + "Jakub Maruniak", + "Artem Yatsenko" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "pomenované entity" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0023", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Ondrej Megela a Matej Novotný v ZP Wiki prepojené cez kľúčové slovo jazykové modelovanie? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.02711, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Matej Novotný", + "jazykové modelovanie" + ], + "matched_values": [ + "Ondrej Megela", + "Matej Novotný" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "jazykové modelovanie" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0024", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Ondrej Megela a Matej Novotný cez kľúčové slovo jazykové modelovanie a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026951, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Matej Novotný", + "jazykové modelovanie" + ], + "matched_values": [ + "Ondrej Megela", + "Matej Novotný" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "jazykové modelovanie" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0025", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Dávid Omasta a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo slovenčina? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026836, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Dávid Omasta", + "Kristián Sopkovič", + "slovenčina" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenčina" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0026", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Dávid Omasta a Kristián Sopkovič cez kľúčové slovo slovenčina a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.025726, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Dávid Omasta", + "Kristián Sopkovič", + "slovenčina" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenčina" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0027", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Michal Stromko a Matej Ščišľak v ZP Wiki prepojené cez kľúčové slovo FAISS? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026567, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Matej Ščišľak", + "FAISS" + ], + "matched_values": [ + "Michal Stromko", + "Matej Ščišľak" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0028", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Michal Stromko a Matej Ščišľak cez kľúčové slovo FAISS a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026257, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Matej Ščišľak", + "FAISS" + ], + "matched_values": [ + "Michal Stromko", + "Matej Ščišľak" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0031", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Artem Yatsenko a Vladimír Ferko v ZP Wiki prepojené cez kľúčové slovo anotácia? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026799, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Vladimír Ferko", + "anotácia" + ], + "matched_values": [ + "Artem Yatsenko", + "Vladimír Ferko" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0032", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Artem Yatsenko a Vladimír Ferko cez kľúčové slovo anotácia a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.027182, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Vladimír Ferko", + "anotácia" + ], + "matched_values": [ + "Artem Yatsenko", + "Vladimír Ferko" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0035", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Matej Ščišľak a Valerii Kutsenko v ZP Wiki prepojené cez kľúčové slovo GraphRAG? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026171, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Valerii Kutsenko", + "GraphRAG" + ], + "matched_values": [ + "Matej Ščišľak", + "Valerii Kutsenko" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0036", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Matej Ščišľak a Valerii Kutsenko cez kľúčové slovo GraphRAG a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.025905, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Valerii Kutsenko", + "GraphRAG" + ], + "matched_values": [ + "Matej Ščišľak", + "Valerii Kutsenko" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0037", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Vladimír Ferko a Tetiana Mohorian v ZP Wiki prepojené cez kľúčové slovo hate speech? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.025798, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "Tetiana Mohorian", + "hate speech" + ], + "matched_values": [ + "Vladimír Ferko", + "Tetiana Mohorian" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0038", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Vladimír Ferko a Tetiana Mohorian cez kľúčové slovo hate speech a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026872, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "Tetiana Mohorian", + "hate speech" + ], + "matched_values": [ + "Vladimír Ferko", + "Tetiana Mohorian" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0041", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Valerii Kutsenko a Ján Pták v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026533, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "matched_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0042", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Valerii Kutsenko a Ján Pták cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026572, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "matched_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0049", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tetiana Mohorian a Rostyslav Rodzhuk v ZP Wiki prepojené cez kľúčové slovo LLM? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.028176, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Rostyslav Rodzhuk", + "LLM" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0050", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tetiana Mohorian a Rostyslav Rodzhuk cez kľúčové slovo LLM a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026824, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Rostyslav Rodzhuk", + "LLM" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0053", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Rostyslav Rodzhuk a Samuel Džurina v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.027676, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0054", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Rostyslav Rodzhuk a Samuel Džurina cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026542, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0058", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Samuel Džurina?", + "latency_seconds": 0.029425, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Samuel Džurina" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0060", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Novotný?", + "latency_seconds": 0.030422, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Matej Novotný", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Novotný" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0063", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.032236, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0064", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Samuel Džurina?", + "latency_seconds": 0.031066, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Samuel Džurina" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0066", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Samuel Džurina?", + "latency_seconds": 0.031231, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Samuel Džurina" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0068", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Kristián Sopkovič?", + "latency_seconds": 0.031977, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0071", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Simona Bobrovčanová?", + "latency_seconds": 0.030108, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0072", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Rostyslav Rodzhuk?", + "latency_seconds": 0.030455, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0074", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Holp a Maroš Harahus?", + "latency_seconds": 0.031777, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/jan_holp/timovy_projekt/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0075", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Tomáš Kuchárik?", + "latency_seconds": 0.029934, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0076", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dávid Omasta a Vladimír Ferko?", + "latency_seconds": 0.029005, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Vladimír Ferko" + ], + "expected_entities": [ + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0078", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Michal Stromko?", + "latency_seconds": 0.030429, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0079", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Michal Stromko?", + "latency_seconds": 0.030147, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0081", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Yevhenii Medushivskyi?", + "latency_seconds": 0.029875, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Yevhenii Medushivskyi" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0084", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Yevhenii Medushivskyi?", + "latency_seconds": 0.030172, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0086", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ondrej Megela a Patrik Pavlišin?", + "latency_seconds": 0.030118, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0087", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Maroš Harahus?", + "latency_seconds": 0.032462, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jakub_maruniak/timovy_projekt/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0088", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Simona Bobrovčanová?", + "latency_seconds": 0.029372, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Simona Bobrovčanová" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0089", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Kristián Sopkovič?", + "latency_seconds": 0.029663, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Kristián Sopkovič" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0091", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Simona Bobrovčanová?", + "latency_seconds": 0.029534, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0092", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Simona Bobrovčanová a Yevhenii Medushivskyi?", + "latency_seconds": 0.030408, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0093", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Tomáš Kuchárik?", + "latency_seconds": 0.029071, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Tomáš Kuchárik" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0095", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Michal Stromko?", + "latency_seconds": 0.029429, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Michal Stromko" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md", + "pages/students/2019/michal_stromko/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0097", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Dominik Nagy?", + "latency_seconds": 0.030283, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Dominik Nagy" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0098", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Michal Stromko a Tomáš Kuchárik?", + "latency_seconds": 0.029072, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Michal Stromko", + "Tomáš Kuchárik" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/michal_stromko/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0099", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Rostyslav Rodzhuk?", + "latency_seconds": 0.030093, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0100", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Yevhenii Medushivskyi?", + "latency_seconds": 0.03007, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0104", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Ščišľak?", + "latency_seconds": 0.029587, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Matej Ščišľak", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Ščišľak" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0105", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Tomáš Kuchárik?", + "latency_seconds": 0.030648, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Tomáš Kuchárik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md", + "pages/students/2016/tomas_kucharik/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0107", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Yevhenii Medushivskyi?", + "latency_seconds": 0.029348, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Yevhenii Medushivskyi" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0108", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Simona Bobrovčanová?", + "latency_seconds": 0.028264, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Simona Bobrovčanová" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0110", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Matej Ščišľak?", + "latency_seconds": 0.028935, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0111", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Ján Holp?", + "latency_seconds": 0.031349, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jakub_maruniak/timovy_projekt/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/jan_holp/timovy_projekt/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0114", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Simona Bobrovčanová?", + "latency_seconds": 0.028895, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Simona Bobrovčanová" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0115", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Rostyslav Rodzhuk?", + "latency_seconds": 0.029652, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0116", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Daniil Huzenko a Tetiana Mohorian?", + "latency_seconds": 0.030545, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2025" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2025" + ], + "expected_entities": [ + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0118", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Yevhenii Medushivskyi?", + "latency_seconds": 0.028572, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md", + "pages/topics/akopisat/README.md", + "pages/topics/faq/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi", + "https://zp.kemt.fei.tuke.sk/topics/akopisat", + "https://zp.kemt.fei.tuke.sk/topics/faq" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0122", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Samuel Džurina?", + "latency_seconds": 0.031764, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0124", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Matej Novotný?", + "latency_seconds": 0.031587, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Matej Novotný", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Novotný", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0127", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.031066, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0128", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Novotný a Samuel Džurina?", + "latency_seconds": 0.030481, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0130", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Ščišľak a Samuel Džurina?", + "latency_seconds": 0.052664, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0132", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Artem Yatsenko a Kristián Sopkovič?", + "latency_seconds": 0.034843, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0135", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Samuel Džurina a Simona Bobrovčanová?", + "latency_seconds": 0.030996, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0136", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Rostyslav Rodzhuk?", + "latency_seconds": 0.03043, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Rostyslav Rodzhuk", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0138", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Holp a Maroš Harahus?", + "latency_seconds": 0.035123, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/jan_holp/dp2021/README.md", + "pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md", + "pages/students/2016/jan_holp/timovy_projekt/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/dp2021", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/dp2021/zdrojove_subory", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0139", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Artem Yatsenko a Tomáš Kuchárik?", + "latency_seconds": 0.033529, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0140", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Dávid Omasta a Vladimír Ferko?", + "latency_seconds": 0.0318, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2024" + ], + "expected_entities": [ + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0142", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Kristián Sopkovič a Michal Stromko?", + "latency_seconds": 0.03555, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md", + "pages/students/2019/michal_stromko/vp2021/README.md", + "pages/students/2019/michal_stromko/vp2021/tutorials/README.md", + "pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021/tutorials", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021/tutorials/img" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0143", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Artem Yatsenko a Michal Stromko?", + "latency_seconds": 0.034544, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md", + "pages/students/2019/michal_stromko/vp2021/README.md", + "pages/students/2019/michal_stromko/vp2021/tutorials/README.md", + "pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021/tutorials", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021/tutorials/img" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0145", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Yevhenii Medushivskyi?", + "latency_seconds": 0.030344, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0148", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Ščišľak a Yevhenii Medushivskyi?", + "latency_seconds": 0.03158, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0150", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ondrej Megela a Patrik Pavlišin?", + "latency_seconds": 0.035658, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2020" + ], + "expected_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/patrik_pavlisin/dp21/README.md", + "pages/students/2016/patrik_pavlisin/dp22/README.md", + "pages/students/2016/patrik_pavlisin/tp20/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0151", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Jakub Maruniak a Maroš Harahus?", + "latency_seconds": 0.039915, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jakub_maruniak/dp2021/README.md", + "pages/students/2016/jakub_maruniak/dp2021/annotation/README.md", + "pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md", + "pages/students/2016/jakub_maruniak/timovy_projekt/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/train_experiments", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0152", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Novotný a Simona Bobrovčanová?", + "latency_seconds": 0.034907, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0153", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Dominik Nagy a Kristián Sopkovič?", + "latency_seconds": 0.037575, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "AUTHORED_DOCUMENT", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK", + "IN_CATEGORY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0155", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Tetiana Mohorian a Valerii Kutsenko?", + "latency_seconds": 0.027352, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0156", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Tetiana Mohorian?", + "latency_seconds": 0.026642, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0160", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Yevhenii Medushivskyi?", + "latency_seconds": 0.025851, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0162", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Valerii Kutsenko?", + "latency_seconds": 0.026151, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0163", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Simona Bobrovčanová?", + "latency_seconds": 0.025208, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0164", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Simona Bobrovčanová a Yevhenii Medushivskyi?", + "latency_seconds": 0.026197, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0165", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Matej Ščišľak?", + "latency_seconds": 0.026411, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "matched_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0167", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?", + "latency_seconds": 0.026126, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0168", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Jakub Maruniak a Ján Holp?", + "latency_seconds": 0.026099, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "expected_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0172", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.02643, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0174", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Tetiana Mohorian?", + "latency_seconds": 0.026553, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0177", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Ján Pták?", + "latency_seconds": 0.02735, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0182", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Valerii Kutsenko?", + "latency_seconds": 0.026099, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0185", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Vladimír Ferko?", + "latency_seconds": 0.026382, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Vladimír Ferko", + "2021" + ], + "matched_values": [ + "Matej Novotný", + "Vladimír Ferko", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0186", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Simona Bobrovčanová?", + "latency_seconds": 0.025379, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2023" + ], + "matched_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0188", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Ščišľak a Vladimír Ferko?", + "latency_seconds": 0.025368, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Vladimír Ferko", + "2021" + ], + "matched_values": [ + "Matej Ščišľak", + "Vladimír Ferko", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0189", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Tetiana Mohorian a Valerii Kutsenko?", + "latency_seconds": 0.026489, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0190", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Tetiana Mohorian?", + "latency_seconds": 0.026165, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0194", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Džurina a Yevhenii Medushivskyi?", + "latency_seconds": 0.025476, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0196", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Valerii Kutsenko?", + "latency_seconds": 0.025752, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0197", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Simona Bobrovčanová?", + "latency_seconds": 0.026359, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0198", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Simona Bobrovčanová a Yevhenii Medushivskyi?", + "latency_seconds": 0.025587, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0199", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Matej Novotný a Matej Ščišľak?", + "latency_seconds": 0.027023, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "matched_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0201", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?", + "latency_seconds": 0.025654, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0202", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Jakub Maruniak a Ján Holp?", + "latency_seconds": 0.025785, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "expected_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0206", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.0261, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0208", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Tetiana Mohorian?", + "latency_seconds": 0.024949, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0211", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Ján Pták?", + "latency_seconds": 0.025803, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0219", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Artem Yatsenko?", + "latency_seconds": 0.029408, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0220", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Artem Yatsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025718, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0221", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Daniil Huzenko?", + "latency_seconds": 0.028771, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", + "2025" + ], + "matched_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0222", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Daniil Huzenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025528, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", + "2025" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0227", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Dominik Nagy?", + "latency_seconds": 0.030826, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Neurónový strojový preklad pomocou knižnice Fairseq", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Neurónový strojový preklad pomocou knižnice Fairseq", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0228", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Dominik Nagy s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.026372, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Dominik Nagy", + "Neurónový strojový preklad pomocou knižnice Fairseq", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0231", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Dávid Omasta?", + "latency_seconds": 0.030327, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0232", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Dávid Omasta s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025692, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Dávid Omasta", + "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", + "2024" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0237", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Jakub Maruniak?", + "latency_seconds": 0.030385, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0238", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Jakub Maruniak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025662, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Jakub Maruniak", + "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2021" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0239", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ján Holp?", + "latency_seconds": 0.030324, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku", + "2021" + ], + "matched_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0240", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ján Holp s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025476, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku", + "2021" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0243", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ján Pták?", + "latency_seconds": 0.029743, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác", + "2026" + ], + "expected_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_WORK" + ], + "expected_properties": [ + "Work.title", + "Work.year" + ], + "matched_properties": [ + "Work.title", + "Work.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints" + ], + "fact_types": [ + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0244", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ján Pták s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025803, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_WORK" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Work.title", + "Work.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0245", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Kristián Sopkovič?", + "latency_seconds": 0.03172, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0246", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Kristián Sopkovič s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.027605, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0251", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Maroš Harahus?", + "latency_seconds": 0.031126, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka", + "2021" + ], + "matched_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0252", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Maroš Harahus s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025605, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka", + "2021" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0257", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Matej Novotný?", + "latency_seconds": 0.029159, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Klasifikácia webových dát pre lepšie jazykové modelovanie", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Klasifikácia webových dát pre lepšie jazykové modelovanie", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0258", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Matej Novotný s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.026612, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Matej Novotný", + "Klasifikácia webových dát pre lepšie jazykové modelovanie", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0259", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Matej Ščišľak?", + "latency_seconds": 0.03087, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0260", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Matej Ščišľak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025557, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0261", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Michal Stromko?", + "latency_seconds": 0.031489, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch", + "2022" + ], + "matched_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0262", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Michal Stromko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025408, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0269", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ondrej Megela?", + "latency_seconds": 0.030766, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Neurónové jazykové modelovanie typu BERT", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Neurónové jazykové modelovanie typu BERT", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0270", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ondrej Megela s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.026448, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Ondrej Megela", + "Neurónové jazykové modelovanie typu BERT", + "2020" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0271", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Patrik Pavlišin?", + "latency_seconds": 0.030734, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu", + "2020" + ], + "matched_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0272", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Patrik Pavlišin s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025404, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu", + "2020" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0275", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Rostyslav Rodzhuk?", + "latency_seconds": 0.03692, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0276", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Rostyslav Rodzhuk s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025417, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0277", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Džurina?", + "latency_seconds": 0.028552, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0278", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Samuel Džurina s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025496, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0281", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Simona Bobrovčanová?", + "latency_seconds": 0.029779, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu", + "2026" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0282", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Simona Bobrovčanová s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025126, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0283", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Tetiana Mohorian?", + "latency_seconds": 0.029788, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", + "2025" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0284", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Tetiana Mohorian s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025128, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", + "2025" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0285", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Tomáš Kuchárik?", + "latency_seconds": 0.031425, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", + "2022" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0286", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Tomáš Kuchárik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025138, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0287", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Valerii Kutsenko?", + "latency_seconds": 0.031445, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov", + "2027" + ], + "matched_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov", + "2027" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + }, + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0288", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Valerii Kutsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.026259, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov", + "2027" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0289", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Vladimír Ferko?", + "latency_seconds": 0.03428, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", + "2024" + ], + "matched_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0290", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Vladimír Ferko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.025226, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", + "2024" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0293", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Yevhenii Medushivskyi?", + "latency_seconds": 0.03141, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok", + "2026" + ], + "matched_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0294", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Yevhenii Medushivskyi s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.026072, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [], + "matched_source_urls": [], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0296", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo slovenský text?", + "latency_seconds": 0.032829, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "slovenský text", + "Automatická sumarizácia slovenského textu" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenský text" + }, + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0297", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Kristián Sopkovič, ak jej dokument zároveň obsahuje kľúčové slovo transformery?", + "latency_seconds": 0.034758, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "transformery", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + ], + "matched_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "transformery" + }, + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0298", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?", + "latency_seconds": 0.03072, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.333333, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "hate speech", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0299", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?", + "latency_seconds": 0.033767, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "FAISS", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "matched_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + }, + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0300", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?", + "latency_seconds": 0.03305, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "OpenWebUI", + "Agent pre manažment záverečných prác" + ], + "matched_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "OpenWebUI" + }, + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + } + ], + "matched_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "expected_properties": [ + "Work.title" + ], + "matched_properties": [ + "Work.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0301", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo Neo4J?", + "latency_seconds": 0.034873, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Neo4J", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "matched_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Neo4J" + }, + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0302", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo prompting?", + "latency_seconds": 0.038, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "prompting", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "prompting" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0303", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo morfologická anotácia?", + "latency_seconds": 0.038791, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "morfologická anotácia", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "matched_values": [ + "Maroš Harahus", + "morfologická anotácia", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "morfologická anotácia" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0304", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tomáš Kuchárik, ak jej dokument zároveň obsahuje kľúčové slovo SQuAD?", + "latency_seconds": 0.038008, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "SQuAD", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "SQuAD" + }, + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0305", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo Docker?", + "latency_seconds": 0.031918, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Docker", + "Agent pre manažment záverečných prác" + ], + "matched_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Docker" + }, + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + } + ], + "matched_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "expected_properties": [ + "Work.title" + ], + "matched_properties": [ + "Work.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0309", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo automatický preklad?", + "latency_seconds": 0.032675, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "automatický preklad", + "Metódy automatického prekladu" + ], + "matched_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "automatický preklad" + }, + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0314", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Samuel Džurina, ak jej dokument zároveň obsahuje kľúčové slovo zásielková spoločnosť?", + "latency_seconds": 0.030712, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.333333, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "zásielková spoločnosť", + "Dialógový systém pre podporu firemných procesov" + ], + "matched_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "zásielková spoločnosť" + }, + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0316", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo znalostný graf?", + "latency_seconds": 0.032779, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "znalostný graf", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "matched_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0319", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo grafové neurónové siete?", + "latency_seconds": 0.035086, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "grafové neurónové siete", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "matched_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "grafové neurónové siete" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0322", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?", + "latency_seconds": 0.032689, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "anotácia", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + ], + "matched_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0323", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo sumarizácia?", + "latency_seconds": 0.031545, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "sumarizácia", + "Automatická sumarizácia slovenského textu" + ], + "matched_values": [ + "Simona Bobrovčanová", + "sumarizácia", + "Automatická sumarizácia slovenského textu" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "sumarizácia" + }, + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0324", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?", + "latency_seconds": 0.034784, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "strojový preklad", + "Metódy automatického prekladu" + ], + "matched_values": [ + "Patrik Pavlišin", + "strojový preklad", + "Metódy automatického prekladu" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + }, + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0327", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo získavanie informácií?", + "latency_seconds": 0.034428, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "získavanie informácií", + "Systém získavania informácií v slovenskom jazyku" + ], + "matched_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "získavanie informácií" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0328", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo špeciálny pedagóg?", + "latency_seconds": 0.030974, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "špeciálny pedagóg", + "Inteligentný agent pre podporu práce špeciálneho pedagóga" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "špeciálny pedagóg" + }, + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0329", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?", + "latency_seconds": 0.03673, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "GraphRAG", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "matched_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0330", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo LLM?", + "latency_seconds": 0.044139, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.333333, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "LLM", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0331", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo deduplikácia?", + "latency_seconds": 0.041277, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "deduplikácia", + "Získavanie textu z webových stránok" + ], + "matched_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "deduplikácia" + }, + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0333", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo LLM?", + "latency_seconds": 0.032274, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.333333, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "LLM", + "Inteligentný agent pre podporu práce špeciálneho pedagóga" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + }, + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0336", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo pomenované entity?", + "latency_seconds": 0.032832, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "pomenované entity", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + ], + "matched_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "pomenované entity" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0337", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo slovenský internet?", + "latency_seconds": 0.033722, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "slovenský internet", + "Systém získavania informácií v slovenskom jazyku" + ], + "matched_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenský internet" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0340", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?", + "latency_seconds": 0.033024, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "GraphRAG", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "matched_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + }, + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0341", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo Elasticsearch?", + "latency_seconds": 0.034721, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Elasticsearch", + "Indexovanie slovenského textu pomocou Elasticsearch" + ], + "matched_values": [ + "Michal Stromko", + "Elasticsearch", + "Indexovanie slovenského textu pomocou Elasticsearch" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Elasticsearch" + }, + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0343", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo crawler?", + "latency_seconds": 0.03299, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "crawler", + "Získavanie textu z webových stránok" + ], + "matched_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "crawler" + }, + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0344", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?", + "latency_seconds": 0.03297, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.333333, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "hate speech", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "matched_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + }, + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0345", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?", + "latency_seconds": 0.036856, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Spacy", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "matched_values": [ + "Maroš Harahus", + "Spacy", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0346", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo RAG?", + "latency_seconds": 0.033544, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "RAG", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "matched_values": [ + "Valerii Kutsenko", + "RAG", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "RAG" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0347", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo paralelný korpus?", + "latency_seconds": 0.034021, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "paralelný korpus", + "Metódy automatického prekladu" + ], + "matched_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "paralelný korpus" + }, + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0348", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo SlovakBERT?", + "latency_seconds": 0.031957, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "SlovakBERT", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "matched_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "SlovakBERT" + }, + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0349", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?", + "latency_seconds": 0.030962, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "anotácia", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "matched_values": [ + "Vladimír Ferko", + "anotácia", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + }, + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0353", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Dominik Nagy, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?", + "latency_seconds": 0.034527, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "strojový preklad", + "Neurónový strojový preklad pomocou knižnice Fairseq" + ], + "matched_values": [ + "Dominik Nagy", + "strojový preklad", + "Neurónový strojový preklad pomocou knižnice Fairseq" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + }, + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0354", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo BERT?", + "latency_seconds": 0.034834, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "BERT", + "Neurónové jazykové modelovanie typu BERT" + ], + "matched_values": [ + "Ondrej Megela", + "BERT", + "Neurónové jazykové modelovanie typu BERT" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "BERT" + }, + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "BERT" + }, + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0355", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo PageRank?", + "latency_seconds": 0.032861, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "PageRank", + "Systém získavania informácií v slovenskom jazyku" + ], + "matched_values": [ + "Ján Holp", + "PageRank", + "Systém získavania informácií v slovenskom jazyku" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "PageRank" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "PageRank" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0359", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo právne dokumenty?", + "latency_seconds": 0.030909, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "právne dokumenty", + "Automatická sumarizácia slovenského textu" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "právne dokumenty" + }, + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0361", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?", + "latency_seconds": 0.03251, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "FAISS", + "Indexovanie slovenského textu pomocou Elasticsearch" + ], + "matched_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + }, + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0364", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Kubernetes?", + "latency_seconds": 0.032602, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Kubernetes", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + ], + "matched_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Kubernetes" + }, + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0366", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo jazykové modelovanie?", + "latency_seconds": 0.058894, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "jazykové modelovanie", + "Neurónové jazykové modelovanie typu BERT" + ], + "matched_values": [ + "Ondrej Megela", + "jazykové modelovanie", + "Neurónové jazykové modelovanie typu BERT" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "jazykové modelovanie" + }, + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0368", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Raspberry Pi?", + "latency_seconds": 0.032233, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Raspberry Pi", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + ], + "matched_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Raspberry Pi" + }, + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0375", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou bp2022?", + "latency_seconds": 0.025147, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Michal Stromko" + ], + "matched_values": [ + "bp2022", + "Michal Stromko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0376", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Yevhenii Medushivskyi spojený s kategóriou bp2026?", + "latency_seconds": 0.025215, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Yevhenii Medushivskyi" + ], + "matched_values": [ + "bp2026", + "Yevhenii Medushivskyi" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0379", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou bp2022?", + "latency_seconds": 0.026441, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Kristián Sopkovič" + ], + "matched_values": [ + "bp2022", + "Kristián Sopkovič" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0380", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou dp2024?", + "latency_seconds": 0.024993, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2024", + "Michal Stromko" + ], + "matched_values": [ + "dp2024", + "Michal Stromko" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0381", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou bp2019?", + "latency_seconds": 0.026127, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Dominik Nagy" + ], + "matched_values": [ + "bp2019", + "Dominik Nagy" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0382", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou vp2025?", + "latency_seconds": 0.025569, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "vp2025", + "Rostyslav Rodzhuk" + ], + "matched_values": [ + "vp2025", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "category", + "value": "vp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "vp2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0385", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Oliver Pejic spojený s kategóriou iaeste?", + "latency_seconds": 0.025302, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "iaeste", + "Oliver Pejic" + ], + "matched_values": [ + "iaeste", + "Oliver Pejic" + ], + "expected_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "iaeste" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/oliver_pejic/README.md" + ], + "actual_documents": [ + "pages/interns/oliver_pejic/README.md" + ], + "matched_documents": [ + "pages/interns/oliver_pejic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0386", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Vladimír Ferko spojený s kategóriou bp2024?", + "latency_seconds": 0.025402, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2024", + "Vladimír Ferko" + ], + "matched_values": [ + "bp2024", + "Vladimír Ferko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0387", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Jakub Maruniak spojený s kategóriou bp2019?", + "latency_seconds": 0.025292, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Jakub Maruniak" + ], + "matched_values": [ + "bp2019", + "Jakub Maruniak" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0388", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou dp2023?", + "latency_seconds": 0.024768, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2023", + "Ondrej Megela" + ], + "matched_values": [ + "dp2023", + "Ondrej Megela" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2023" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0389", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2024?", + "latency_seconds": 0.02551, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2024", + "Dávid Omasta" + ], + "matched_values": [ + "dp2024", + "Dávid Omasta" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0390", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2021?", + "latency_seconds": 0.025801, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2021", + "Tomáš Kuchárik" + ], + "matched_values": [ + "dp2021", + "Tomáš Kuchárik" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0392", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou dp2022?", + "latency_seconds": 0.025151, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2022", + "Dominik Nagy" + ], + "matched_values": [ + "dp2022", + "Dominik Nagy" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0393", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Matej Novotný spojený s kategóriou dp2026?", + "latency_seconds": 0.025, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2026", + "Matej Novotný" + ], + "matched_values": [ + "dp2026", + "Matej Novotný" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0394", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Simona Bobrovčanová spojený s kategóriou bp2026?", + "latency_seconds": 0.025719, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Simona Bobrovčanová" + ], + "matched_values": [ + "bp2026", + "Simona Bobrovčanová" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0396", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou bp2019?", + "latency_seconds": 0.025487, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Maroš Harahus" + ], + "matched_values": [ + "bp2019", + "Maroš Harahus" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0397", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou bp2025?", + "latency_seconds": 0.026321, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2025", + "Valerii Kutsenko" + ], + "matched_values": [ + "bp2025", + "Valerii Kutsenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0398", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou bp2020?", + "latency_seconds": 0.026144, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2020", + "Patrik Pavlišin" + ], + "matched_values": [ + "bp2020", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2020" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0400", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou bp2019?", + "latency_seconds": 0.025873, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Ján Holp" + ], + "matched_values": [ + "bp2019", + "Ján Holp" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0405", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou bp2024?", + "latency_seconds": 0.025515, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2024", + "Matej Ščišľak" + ], + "matched_values": [ + "bp2024", + "Matej Ščišľak" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0407", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Samuel Džurina spojený s kategóriou bp2026?", + "latency_seconds": 0.025488, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Samuel Džurina" + ], + "matched_values": [ + "bp2026", + "Samuel Džurina" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0408", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou dp2022?", + "latency_seconds": 0.024898, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2022", + "Patrik Pavlišin" + ], + "matched_values": [ + "dp2022", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0410", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Bogdan Paul Chiș spojený s kategóriou erasmus?", + "latency_seconds": 0.025237, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "erasmus", + "Bogdan Paul Chiș" + ], + "matched_values": [ + "erasmus", + "Bogdan Paul Chiș" + ], + "expected_entities": [ + { + "type": "category", + "value": "erasmus" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "erasmus" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/bogdan_paul_chis/README.md" + ], + "actual_documents": [ + "pages/interns/bogdan_paul_chis/README.md" + ], + "matched_documents": [ + "pages/interns/bogdan_paul_chis/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0411", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou dp2021?", + "latency_seconds": 0.025409, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2021", + "Ján Holp" + ], + "matched_values": [ + "dp2021", + "Ján Holp" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0412", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ján Pták spojený s kategóriou dp2027?", + "latency_seconds": 0.025554, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2027", + "Ján Pták" + ], + "matched_values": [ + "dp2027", + "Ján Pták" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2027" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2027" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0415", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Cesar Abascal Gutierrez spojený s kategóriou iaeste?", + "latency_seconds": 0.026692, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "iaeste", + "Cesar Abascal Gutierrez" + ], + "matched_values": [ + "iaeste", + "Cesar Abascal Gutierrez" + ], + "expected_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "iaeste" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/cesar_gutierrez/README.md" + ], + "actual_documents": [ + "pages/interns/cesar_gutierrez/README.md" + ], + "matched_documents": [ + "pages/interns/cesar_gutierrez/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0416", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou bp2021?", + "latency_seconds": 0.027061, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2021", + "Ondrej Megela" + ], + "matched_values": [ + "bp2021", + "Ondrej Megela" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0417", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2022?", + "latency_seconds": 0.028831, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2022", + "Tomáš Kuchárik" + ], + "matched_values": [ + "dp2022", + "Tomáš Kuchárik" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0420", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou vp2021?", + "latency_seconds": 0.026629, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "vp2021", + "Michal Stromko" + ], + "matched_values": [ + "vp2021", + "Michal Stromko" + ], + "expected_entities": [ + { + "type": "category", + "value": "vp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "vp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0422", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou bp2026?", + "latency_seconds": 0.026499, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Rostyslav Rodzhuk" + ], + "matched_values": [ + "bp2026", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0424", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou vp2024?", + "latency_seconds": 0.025404, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "vp2024", + "Valerii Kutsenko" + ], + "matched_values": [ + "vp2024", + "Valerii Kutsenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "vp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "vp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0425", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou dp2024?", + "latency_seconds": 0.02588, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2024", + "Kristián Sopkovič" + ], + "matched_values": [ + "dp2024", + "Kristián Sopkovič" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0426", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Artem Yatsenko spojený s kategóriou bp2022?", + "latency_seconds": 0.02621, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Artem Yatsenko" + ], + "matched_values": [ + "bp2022", + "Artem Yatsenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0427", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou dp2021?", + "latency_seconds": 0.025359, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2021", + "Maroš Harahus" + ], + "matched_values": [ + "dp2021", + "Maroš Harahus" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0433", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Daniil Huzenko spojený s kategóriou bp2025?", + "latency_seconds": 0.025453, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.5, + "relation_score": 0.666667, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2025", + "Daniil Huzenko" + ], + "matched_values": [ + "bp2025", + "Daniil Huzenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0435", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?", + "latency_seconds": 0.026788, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "matched_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [ + "dp2023", + "dp2024" + ], + "entity_set_actual": [ + "dp2023", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0436", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?", + "latency_seconds": 0.025725, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "matched_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [ + "bp2021", + "dp2023" + ], + "entity_set_actual": [ + "bp2021", + "dp2023" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0438", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?", + "latency_seconds": 0.025511, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "matched_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [ + "bp2019", + "dp2022" + ], + "entity_set_actual": [ + "bp2019", + "dp2022", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0439", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?", + "latency_seconds": 0.026074, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0440", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?", + "latency_seconds": 0.025504, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "matched_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_actual": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0442", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?", + "latency_seconds": 0.026161, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "matched_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_actual": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0443", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?", + "latency_seconds": 0.025228, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "matched_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [ + "bp2022", + "dp2024" + ], + "entity_set_actual": [ + "bp2022", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0445", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?", + "latency_seconds": 0.025159, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "matched_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [ + "dp2021", + "dp2022" + ], + "entity_set_actual": [ + "dp2021", + "dp2022" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0447", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ján Holp?", + "latency_seconds": 0.025498, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Ján Holp", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/jan_holp/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0449", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Jakub Maruniak?", + "latency_seconds": 0.026307, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Jakub Maruniak", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jakub_maruniak/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0450", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Michal Stromko?", + "latency_seconds": 0.026242, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "bp2022", + "dp2024", + "vp2021" + ], + "matched_values": [ + "Michal Stromko", + "bp2022", + "dp2024", + "vp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "vp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "vp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [ + "bp2022", + "dp2024", + "vp2021" + ], + "entity_set_actual": [ + "bp2022", + "dp2024", + "vp2021" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0452", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Matej Ščišľak?", + "latency_seconds": 0.025165, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "bp2024", + "dp2026" + ], + "matched_values": [ + "Matej Ščišľak", + "bp2024", + "dp2026" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "category", + "value": "dp2026" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "category", + "value": "dp2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [ + "bp2024", + "dp2026" + ], + "entity_set_actual": [ + "bp2024", + "dp2026" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0453", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Rostyslav Rodzhuk?", + "latency_seconds": 0.025642, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "bp2026", + "vp2025" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "bp2026", + "vp2025" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "category", + "value": "vp2025" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "category", + "value": "vp2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [ + "bp2026", + "vp2025" + ], + "entity_set_actual": [ + "bp2026", + "vp2025" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0454", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?", + "latency_seconds": 0.025248, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "matched_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [ + "dp2023", + "dp2024" + ], + "entity_set_actual": [ + "dp2023", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0455", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?", + "latency_seconds": 0.025762, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "matched_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [ + "bp2021", + "dp2023" + ], + "entity_set_actual": [ + "bp2021", + "dp2023" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0457", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?", + "latency_seconds": 0.02557, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "matched_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [ + "bp2019", + "dp2022" + ], + "entity_set_actual": [ + "bp2019", + "dp2022", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0458", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?", + "latency_seconds": 0.025487, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0459", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?", + "latency_seconds": 0.025682, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "matched_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_actual": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0461", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?", + "latency_seconds": 0.026465, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "matched_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_actual": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0462", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?", + "latency_seconds": 0.025662, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "matched_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [ + "bp2022", + "dp2024" + ], + "entity_set_actual": [ + "bp2022", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0464", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?", + "latency_seconds": 0.025161, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "matched_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [ + "dp2021", + "dp2022" + ], + "entity_set_actual": [ + "dp2021", + "dp2022" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": false, + "expected_count": 3, + "actual_count": null, + "complete": true, + "id": "g0465", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?", + "latency_seconds": 0.03441, + "error": null, + "strict": false, + "value_score": 0.8, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.75, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "3", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_actual": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": false, + "expected_count": 3, + "actual_count": null, + "complete": true, + "id": "g0466", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?", + "latency_seconds": 0.031747, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.75, + "expected_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_actual": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": false, + "expected_count": 2, + "actual_count": null, + "complete": true, + "id": "g0469", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Ondrej Megela, Patrik Pavlišin, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?", + "latency_seconds": 0.032619, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.666667, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_actual": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": false, + "expected_count": 2, + "actual_count": null, + "complete": true, + "id": "g0471", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Dávid Omasta, Vladimír Ferko, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2024. Koľko ich je?", + "latency_seconds": 0.034097, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.666667, + "expected_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2", + "2024" + ], + "expected_entities": [ + { + "type": "person", + "value": "Dávid Omasta" + }, + { + "type": "person", + "value": "Vladimír Ferko" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Dávid Omasta" + }, + { + "type": "person", + "value": "Vladimír Ferko" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [ + "david omasta", + "vladimir ferko" + ], + "entity_set_actual": [ + "david omasta", + "vladimir ferko" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": false, + "expected_count": 3, + "actual_count": null, + "complete": true, + "id": "g0473", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Ján Pták, Matej Novotný, Matej Ščišľak, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?", + "latency_seconds": 0.032323, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.75, + "expected_values": [ + "Ján Pták", + "Matej Novotný", + "Matej Ščišľak", + "3", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Novotný", + "Matej Ščišľak", + "3", + "2026" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ján Pták" + }, + { + "type": "person", + "value": "Matej Novotný" + }, + { + "type": "person", + "value": "Matej Ščišľak" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ján Pták" + }, + { + "type": "person", + "value": "Matej Novotný" + }, + { + "type": "person", + "value": "Matej Ščišľak" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [ + "jan ptak", + "matej novotny", + "matej scislak" + ], + "entity_set_actual": [ + "jan ptak", + "matej novotny", + "matej scislak" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": false, + "expected_count": 2, + "actual_count": null, + "complete": true, + "id": "g0475", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Daniil Huzenko, Tetiana Mohorian, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2025. Koľko ich je?", + "latency_seconds": 0.033666, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.666667, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2", + "2025" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2", + "2025" + ], + "expected_entities": [ + { + "type": "person", + "value": "Daniil Huzenko" + }, + { + "type": "person", + "value": "Tetiana Mohorian" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Daniil Huzenko" + }, + { + "type": "person", + "value": "Tetiana Mohorian" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [ + "daniil huzenko", + "tetiana mohorian" + ], + "entity_set_actual": [ + "daniil huzenko", + "tetiana mohorian" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": false, + "expected_count": 3, + "actual_count": null, + "complete": true, + "id": "g0476", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko zdieľajú rok práce 2021? Uveď aj ich počet.", + "latency_seconds": 0.055723, + "error": null, + "strict": false, + "value_score": 0.8, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.75, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "3", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_actual": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": false, + "expected_count": 3, + "actual_count": null, + "complete": true, + "id": "g0477", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko zdieľajú rok práce 2022? Uveď aj ich počet.", + "latency_seconds": 0.04418, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.75, + "expected_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_actual": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": false, + "expected_count": 2, + "actual_count": null, + "complete": true, + "id": "g0480", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Ondrej Megela, Patrik Pavlišin, Artem Yatsenko zdieľajú rok práce 2020? Uveď aj ich počet.", + "latency_seconds": 0.042632, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 0.666667, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_actual": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0484", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Ján Pták a Matej Novotný spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo OpenWebUI a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.042791, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "OpenWebUI", + "2026" + ], + "matched_values": [ + "Ján Pták", + "2026" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ján Pták" + }, + { + "type": "keyword", + "value": "OpenWebUI" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ján Pták" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0485", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Elasticsearch a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.043568, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Elasticsearch", + "2022" + ], + "matched_values": [ + "Michal Stromko", + "Elasticsearch", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Michal Stromko" + }, + { + "type": "keyword", + "value": "Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Michal Stromko" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0486", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo LLM a jej práca je uvedená v roku 2025?", + "latency_seconds": 0.038977, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "LLM", + "2025" + ], + "matched_values": [ + "Tetiana Mohorian", + "2025" + ], + "expected_entities": [ + { + "type": "person", + "value": "Tetiana Mohorian" + }, + { + "type": "keyword", + "value": "LLM" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Tetiana Mohorian" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0488", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo FAISS a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.043052, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "FAISS", + "2022" + ], + "matched_values": [ + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Michal Stromko" + }, + { + "type": "keyword", + "value": "FAISS" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Michal Stromko" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0490", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo prompting a jej práca je uvedená v roku 2025?", + "latency_seconds": 0.050142, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "prompting", + "2025" + ], + "matched_values": [ + "Tetiana Mohorian", + "2025" + ], + "expected_entities": [ + { + "type": "person", + "value": "Tetiana Mohorian" + }, + { + "type": "keyword", + "value": "prompting" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Tetiana Mohorian" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0492", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Yevhenii Medushivskyi a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo webový korpus a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.064509, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "webový korpus", + "2026" + ], + "matched_values": [ + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "person", + "value": "Yevhenii Medushivskyi" + }, + { + "type": "keyword", + "value": "webový korpus" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Yevhenii Medushivskyi" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0493", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Simona Bobrovčanová a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo právne dokumenty a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.043334, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "právne dokumenty", + "2026" + ], + "matched_values": [ + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "person", + "value": "Simona Bobrovčanová" + }, + { + "type": "keyword", + "value": "právne dokumenty" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Simona Bobrovčanová" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0495", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Kristián Sopkovič a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenčina a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.042003, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "slovenčina", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Kristián Sopkovič" + }, + { + "type": "keyword", + "value": "slovenčina" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Kristián Sopkovič" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0498", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Maroš Harahus a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2021?", + "latency_seconds": 0.039319, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Spacy", + "2021" + ], + "matched_values": [ + "Maroš Harahus", + "Spacy", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Maroš Harahus" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Maroš Harahus" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0499", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Ján Holp a Jakub Maruniak spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenský internet a jej práca je uvedená v roku 2021?", + "latency_seconds": 0.0627, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.666667, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "slovenský internet", + "2021" + ], + "matched_values": [ + "Ján Holp", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "keyword", + "value": "slovenský internet" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0500", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Kristián Sopkovič a Dominik Nagy spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.044306, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Spacy", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Spacy", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Kristián Sopkovič" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Kristián Sopkovič" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + } + ] +} diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.csv b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.csv new file mode 100644 index 0000000..2ee8a50 --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.csv @@ -0,0 +1,287 @@ +complete,count_ok,expected_count,actual_count,id,split,category,difficulty,strict,value_score,entity_score,relation_score,property_score,relation_choice_score,document_recall,source_recall,entity_set_ok,latency_seconds,error,question,expected_values,matched_values,expected_relations,actual_relations,expected_documents,actual_documents,expected_source_urls,actual_source_urls,fact_types,strategies +True,True,,,g0001,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037433,,Sú osoby Maroš Harahus a Jakub Maruniak v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0002,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035416,,Over prepojenie osôb Maroš Harahus a Jakub Maruniak cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0003,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031317,,Sú osoby Maroš Harahus a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0004,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029606,,Over prepojenie osôb Maroš Harahus a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0005,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031042,,Sú osoby Maroš Harahus a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0006,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029576,,Over prepojenie osôb Maroš Harahus a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0007,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028865,,Sú osoby Jakub Maruniak a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0008,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029412,,Over prepojenie osôb Jakub Maruniak a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0009,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028867,,Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0010,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029123,,Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0011,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029002,,Sú osoby Kristián Sopkovič a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0012,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027919,,Over prepojenie osôb Kristián Sopkovič a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0013,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027892,,Sú osoby Tomáš Kuchárik a Dávid Omasta v ZP Wiki prepojené cez kľúčové slovo Question Answering? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]",[],"[""entity_resolution""]" +True,True,,,g0014,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029358,,Over prepojenie osôb Tomáš Kuchárik a Dávid Omasta cez kľúčové slovo Question Answering a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]",[],"[""entity_resolution""]" +True,True,,,g0015,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.02587,,Sú osoby Tomáš Kuchárik a Dominik Nagy v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]" +True,True,,,g0016,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028411,,Over prepojenie osôb Tomáš Kuchárik a Dominik Nagy cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]" +True,True,,,g0017,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027256,,Sú osoby Tomáš Kuchárik a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]" +True,True,,,g0018,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.026018,,Over prepojenie osôb Tomáš Kuchárik a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]" +True,True,,,g0019,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028044,,Sú osoby Dominik Nagy a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]" +True,True,,,g0020,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.030635,,Over prepojenie osôb Dominik Nagy a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]" +True,True,,,g0021,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.030589,,Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo pomenované entity? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]" +True,True,,,g0022,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.034683,,Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo pomenované entity a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]" +True,True,,,g0023,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.02886,,Sú osoby Ondrej Megela a Matej Novotný v ZP Wiki prepojené cez kľúčové slovo jazykové modelovanie? Uveď spoločné kľúčové slovo.,"[""Ondrej Megela"", ""Matej Novotný"", ""jazykové modelovanie""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]",[],"[""entity_resolution""]" +True,True,,,g0024,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.031182,,Over prepojenie osôb Ondrej Megela a Matej Novotný cez kľúčové slovo jazykové modelovanie a pomenuj spoločné kľúčové slovo.,"[""Ondrej Megela"", ""Matej Novotný"", ""jazykové modelovanie""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]",[],"[""entity_resolution""]" +True,True,,,g0025,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.038696,,Sú osoby Dávid Omasta a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo slovenčina? Uveď spoločné kľúčové slovo.,"[""Dávid Omasta"", ""Kristián Sopkovič"", ""slovenčina""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]" +True,True,,,g0026,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.041906,,Over prepojenie osôb Dávid Omasta a Kristián Sopkovič cez kľúčové slovo slovenčina a pomenuj spoločné kľúčové slovo.,"[""Dávid Omasta"", ""Kristián Sopkovič"", ""slovenčina""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]" +True,True,,,g0027,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.031662,,Sú osoby Michal Stromko a Matej Ščišľak v ZP Wiki prepojené cez kľúčové slovo FAISS? Uveď spoločné kľúčové slovo.,"[""Michal Stromko"", ""Matej Ščišľak"", ""FAISS""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]" +True,True,,,g0028,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029943,,Over prepojenie osôb Michal Stromko a Matej Ščišľak cez kľúčové slovo FAISS a pomenuj spoločné kľúčové slovo.,"[""Michal Stromko"", ""Matej Ščišľak"", ""FAISS""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]" +True,True,,,g0031,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.031258,,Sú osoby Artem Yatsenko a Vladimír Ferko v ZP Wiki prepojené cez kľúčové slovo anotácia? Uveď spoločné kľúčové slovo.,"[""Artem Yatsenko"", ""Vladimír Ferko"", ""anotácia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]" +True,True,,,g0032,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.034636,,Over prepojenie osôb Artem Yatsenko a Vladimír Ferko cez kľúčové slovo anotácia a pomenuj spoločné kľúčové slovo.,"[""Artem Yatsenko"", ""Vladimír Ferko"", ""anotácia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]" +True,True,,,g0035,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029476,,Sú osoby Matej Ščišľak a Valerii Kutsenko v ZP Wiki prepojené cez kľúčové slovo GraphRAG? Uveď spoločné kľúčové slovo.,"[""Matej Ščišľak"", ""Valerii Kutsenko"", ""GraphRAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]" +True,True,,,g0036,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.042411,,Over prepojenie osôb Matej Ščišľak a Valerii Kutsenko cez kľúčové slovo GraphRAG a pomenuj spoločné kľúčové slovo.,"[""Matej Ščišľak"", ""Valerii Kutsenko"", ""GraphRAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]" +True,True,,,g0037,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.036859,,Sú osoby Vladimír Ferko a Tetiana Mohorian v ZP Wiki prepojené cez kľúčové slovo hate speech? Uveď spoločné kľúčové slovo.,"[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]" +True,True,,,g0038,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029953,,Over prepojenie osôb Vladimír Ferko a Tetiana Mohorian cez kľúčové slovo hate speech a pomenuj spoločné kľúčové slovo.,"[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]" +True,True,,,g0041,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033878,,Sú osoby Valerii Kutsenko a Ján Pták v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.,"[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0042,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034934,,Over prepojenie osôb Valerii Kutsenko a Ján Pták cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.,"[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0049,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.03198,,Sú osoby Tetiana Mohorian a Rostyslav Rodzhuk v ZP Wiki prepojené cez kľúčové slovo LLM? Uveď spoločné kľúčové slovo.,"[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]" +True,True,,,g0050,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029189,,Over prepojenie osôb Tetiana Mohorian a Rostyslav Rodzhuk cez kľúčové slovo LLM a pomenuj spoločné kľúčové slovo.,"[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]" +True,True,,,g0053,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03007,,Sú osoby Rostyslav Rodzhuk a Samuel Džurina v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0054,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030627,,Over prepojenie osôb Rostyslav Rodzhuk a Samuel Džurina cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]" +True,True,,,g0058,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040538,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Samuel Džurina?,"[""Ján Pták"", ""Samuel Džurina"", ""2026""]","[""Ján Pták"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0060,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035129,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Novotný?,"[""Ján Pták"", ""Matej Novotný"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0063,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033403,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0064,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033754,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Samuel Džurina?,"[""Matej Novotný"", ""Samuel Džurina"", ""2026""]","[""Matej Novotný"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0066,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03164,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Samuel Džurina?,"[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]","[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0068,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03323,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Kristián Sopkovič?,"[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]","[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0071,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034048,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0072,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.051306,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Rostyslav Rodzhuk?,"[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]","[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0074,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041968,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Holp a Maroš Harahus?,"[""Ján Holp"", ""Maroš Harahus"", ""2021""]","[""Ján Holp"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0075,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039645,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Tomáš Kuchárik?,"[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]","[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0076,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037461,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dávid Omasta a Vladimír Ferko?,"[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0078,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040354,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Michal Stromko?,"[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]","[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0079,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037006,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Michal Stromko?,"[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]","[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0081,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034235,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Yevhenii Medushivskyi?,"[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]","[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0084,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03649,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Yevhenii Medushivskyi?,"[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0086,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034878,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ondrej Megela a Patrik Pavlišin?,"[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0087,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03767,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Maroš Harahus?,"[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]","[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0088,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03211,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Simona Bobrovčanová?,"[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0089,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033544,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Kristián Sopkovič?,"[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]","[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0091,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033013,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2026""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0092,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033095,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2026""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0093,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038339,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Tomáš Kuchárik?,"[""Kristián Sopkovič"", ""Tomáš Kuchárik"", ""2022""]","[""Kristián Sopkovič"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0095,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036387,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Michal Stromko?,"[""Dominik Nagy"", ""Michal Stromko"", ""2022""]","[""Dominik Nagy"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0097,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033982,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Dominik Nagy?,"[""Artem Yatsenko"", ""Dominik Nagy"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0098,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035164,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Michal Stromko a Tomáš Kuchárik?,"[""Michal Stromko"", ""Tomáš Kuchárik"", ""2022""]","[""Michal Stromko"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0099,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033515,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Rostyslav Rodzhuk?,"[""Matej Ščišľak"", ""Rostyslav Rodzhuk"", ""2026""]","[""Matej Ščišľak"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0100,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031868,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2026""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0104,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033453,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Ščišľak?,"[""Ján Pták"", ""Matej Ščišľak"", ""2026""]","[""Ján Pták"", ""Matej Ščišľak"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0105,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033682,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Tomáš Kuchárik?,"[""Dominik Nagy"", ""Tomáš Kuchárik"", ""2022""]","[""Dominik Nagy"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0107,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03179,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Yevhenii Medushivskyi?,"[""Matej Novotný"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Novotný"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0108,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031776,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Simona Bobrovčanová?,"[""Ján Pták"", ""Simona Bobrovčanová"", ""2026""]","[""Ján Pták"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0110,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03159,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2026""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0111,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034509,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0114,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033169,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Simona Bobrovčanová?,"[""Matej Ščišľak"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Ščišľak"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0115,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035052,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Rostyslav Rodzhuk?,"[""Matej Novotný"", ""Rostyslav Rodzhuk"", ""2026""]","[""Matej Novotný"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0116,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032058,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2025""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2025""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0118,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034542,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2026""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0122,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032246,,Aký rok práce spája osoby Ján Pták a Samuel Džurina?,"[""Ján Pták"", ""Samuel Džurina"", ""2026""]","[""Ján Pták"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0124,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035132,,Aký rok práce spája osoby Ján Pták a Matej Novotný?,"[""Ján Pták"", ""Matej Novotný"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0127,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040031,,Aký rok práce spája osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0128,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041605,,Aký rok práce spája osoby Matej Novotný a Samuel Džurina?,"[""Matej Novotný"", ""Samuel Džurina"", ""2026""]","[""Matej Novotný"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0130,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039519,,Aký rok práce spája osoby Matej Ščišľak a Samuel Džurina?,"[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]","[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0132,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035394,,Aký rok práce spája osoby Artem Yatsenko a Kristián Sopkovič?,"[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]","[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0135,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032907,,Aký rok práce spája osoby Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0136,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032575,,Aký rok práce spája osoby Ján Pták a Rostyslav Rodzhuk?,"[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]","[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0138,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035918,,Aký rok práce spája osoby Ján Holp a Maroš Harahus?,"[""Ján Holp"", ""Maroš Harahus"", ""2021""]","[""Ján Holp"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0139,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035493,,Aký rok práce spája osoby Artem Yatsenko a Tomáš Kuchárik?,"[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]","[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0140,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033322,,Aký rok práce spája osoby Dávid Omasta a Vladimír Ferko?,"[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0142,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036853,,Aký rok práce spája osoby Kristián Sopkovič a Michal Stromko?,"[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]","[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0143,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033705,,Aký rok práce spája osoby Artem Yatsenko a Michal Stromko?,"[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]","[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0145,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033962,,Aký rok práce spája osoby Ján Pták a Yevhenii Medushivskyi?,"[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]","[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0148,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037038,,Aký rok práce spája osoby Matej Ščišľak a Yevhenii Medushivskyi?,"[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0150,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034444,,Aký rok práce spája osoby Ondrej Megela a Patrik Pavlišin?,"[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0151,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03399,,Aký rok práce spája osoby Jakub Maruniak a Maroš Harahus?,"[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]","[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0152,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032451,,Aký rok práce spája osoby Matej Novotný a Simona Bobrovčanová?,"[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0153,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035207,,Aký rok práce spája osoby Dominik Nagy a Kristián Sopkovič?,"[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]","[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0155,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029885,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Tetiana Mohorian a Valerii Kutsenko?,"[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]","[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0156,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027903,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Tetiana Mohorian?,"[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]","[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0160,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027823,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0162,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028935,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Valerii Kutsenko?,"[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]","[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0163,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029787,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0164,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02925,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0165,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027829,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0167,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028969,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0168,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028057,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2016""]","[""Jakub Maruniak"", ""Ján Holp"", ""2016""]",[],[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0172,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036591,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0174,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027785,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0177,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030561,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Ján Pták?,"[""Daniil Huzenko"", ""Ján Pták"", ""2022""]","[""Daniil Huzenko"", ""Ján Pták"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0182,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031452,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Valerii Kutsenko?,"[""Daniil Huzenko"", ""Valerii Kutsenko"", ""2022""]","[""Daniil Huzenko"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0185,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028827,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Vladimír Ferko?,"[""Matej Novotný"", ""Vladimír Ferko"", ""2021""]","[""Matej Novotný"", ""Vladimír Ferko"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0186,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028735,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2023""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0188,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028802,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Ščišľak a Vladimír Ferko?,"[""Matej Ščišľak"", ""Vladimír Ferko"", ""2021""]","[""Matej Ščišľak"", ""Vladimír Ferko"", ""2021""]",[],[],"[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0189,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027861,,Cez ktorý rok začiatku štúdia sú prepojené osoby Tetiana Mohorian a Valerii Kutsenko?,"[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]","[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0190,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02697,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Tetiana Mohorian?,"[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]","[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0194,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026874,,Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0196,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026984,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Valerii Kutsenko?,"[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]","[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0197,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026571,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0198,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027659,,Cez ktorý rok začiatku štúdia sú prepojené osoby Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0199,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028289,,Cez ktorý rok začiatku štúdia sú prepojené osoby Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0201,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027168,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0202,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028239,,Cez ktorý rok začiatku štúdia sú prepojené osoby Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2016""]","[""Jakub Maruniak"", ""Ján Holp"", ""2016""]",[],[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0206,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027256,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0208,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027307,,Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0211,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027177,,Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Ján Pták?,"[""Daniil Huzenko"", ""Ján Pták"", ""2022""]","[""Daniil Huzenko"", ""Ján Pták"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0219,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031291,,Aký názov práce a aký rok práce sú uvedené pri osobe Artem Yatsenko?,"[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0220,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032369,,"Prepoj osobu Artem Yatsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0221,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031417,,Aký názov práce a aký rok práce sú uvedené pri osobe Daniil Huzenko?,"[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0222,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032088,,"Prepoj osobu Daniil Huzenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0227,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036523,,Aký názov práce a aký rok práce sú uvedené pri osobe Dominik Nagy?,"[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0228,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038864,,"Prepoj osobu Dominik Nagy s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0231,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031716,,Aký názov práce a aký rok práce sú uvedené pri osobe Dávid Omasta?,"[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0232,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030937,,"Prepoj osobu Dávid Omasta s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0237,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031819,,Aký názov práce a aký rok práce sú uvedené pri osobe Jakub Maruniak?,"[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0238,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032217,,"Prepoj osobu Jakub Maruniak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0239,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032698,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Holp?,"[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0240,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034307,,"Prepoj osobu Ján Holp s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0243,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031937,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Pták?,"[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]" +True,True,,,g0244,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03133,,"Prepoj osobu Ján Pták s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]" +True,True,,,g0245,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035096,,Aký názov práce a aký rok práce sú uvedené pri osobe Kristián Sopkovič?,"[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0246,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036623,,"Prepoj osobu Kristián Sopkovič s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0251,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033342,,Aký názov práce a aký rok práce sú uvedené pri osobe Maroš Harahus?,"[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0252,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032007,,"Prepoj osobu Maroš Harahus s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0257,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031346,,Aký názov práce a aký rok práce sú uvedené pri osobe Matej Novotný?,"[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0258,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030631,,"Prepoj osobu Matej Novotný s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0259,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031052,,Aký názov práce a aký rok práce sú uvedené pri osobe Matej Ščišľak?,"[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0260,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031513,,"Prepoj osobu Matej Ščišľak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0261,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034855,,Aký názov práce a aký rok práce sú uvedené pri osobe Michal Stromko?,"[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0262,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.054187,,"Prepoj osobu Michal Stromko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0269,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035496,,Aký názov práce a aký rok práce sú uvedené pri osobe Ondrej Megela?,"[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0270,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032554,,"Prepoj osobu Ondrej Megela s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0271,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032514,,Aký názov práce a aký rok práce sú uvedené pri osobe Patrik Pavlišin?,"[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0272,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03513,,"Prepoj osobu Patrik Pavlišin s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0275,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033359,,Aký názov práce a aký rok práce sú uvedené pri osobe Rostyslav Rodzhuk?,"[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0276,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036935,,"Prepoj osobu Rostyslav Rodzhuk s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0277,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031543,,Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Džurina?,"[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0278,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031702,,"Prepoj osobu Samuel Džurina s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0281,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031534,,Aký názov práce a aký rok práce sú uvedené pri osobe Simona Bobrovčanová?,"[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0282,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030841,,"Prepoj osobu Simona Bobrovčanová s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0283,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031343,,Aký názov práce a aký rok práce sú uvedené pri osobe Tetiana Mohorian?,"[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0284,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033305,,"Prepoj osobu Tetiana Mohorian s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0285,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032355,,Aký názov práce a aký rok práce sú uvedené pri osobe Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0286,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034518,,"Prepoj osobu Tomáš Kuchárik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0287,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032253,,Aký názov práce a aký rok práce sú uvedené pri osobe Valerii Kutsenko?,"[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0288,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032937,,"Prepoj osobu Valerii Kutsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0289,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030801,,Aký názov práce a aký rok práce sú uvedené pri osobe Vladimír Ferko?,"[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0290,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032264,,"Prepoj osobu Vladimír Ferko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0293,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039898,,Aký názov práce a aký rok práce sú uvedené pri osobe Yevhenii Medushivskyi?,"[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0294,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.046916,,"Prepoj osobu Yevhenii Medushivskyi s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0296,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.028569,,"Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo slovenský text?","[""Simona Bobrovčanová"", ""slovenský text"", ""Automatická sumarizácia slovenského textu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]" +True,True,,,g0297,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026116,,"Aký je názov práce osoby Kristián Sopkovič, ak jej dokument zároveň obsahuje kľúčové slovo transformery?","[""Kristián Sopkovič"", ""transformery"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]" +True,True,,,g0298,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032601,,"Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?","[""Tetiana Mohorian"", ""hate speech"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]" +True,True,,,g0299,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025679,,"Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?","[""Matej Ščišľak"", ""FAISS"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]" +True,True,,,g0300,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025524,,"Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?","[""Ján Pták"", ""OpenWebUI"", ""Agent pre manažment záverečných prác""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]",[],"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]",[],"[""entity_resolution""]" +True,True,,,g0301,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026537,,"Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo Neo4J?","[""Matej Ščišľak"", ""Neo4J"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]" +True,True,,,g0302,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026121,,"Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo prompting?","[""Tetiana Mohorian"", ""prompting"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]" +True,True,,,g0303,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026,,"Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo morfologická anotácia?","[""Maroš Harahus"", ""morfologická anotácia"", ""Neurónová morfologická anotácia slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]",[],"[""entity_resolution""]" +True,True,,,g0304,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025574,,"Aký je názov práce osoby Tomáš Kuchárik, ak jej dokument zároveň obsahuje kľúčové slovo SQuAD?","[""Tomáš Kuchárik"", ""SQuAD"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]" +True,True,,,g0305,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025864,,"Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo Docker?","[""Ján Pták"", ""Docker"", ""Agent pre manažment záverečných prác""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]",[],"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]",[],"[""entity_resolution""]" +True,True,,,g0309,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026547,,"Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo automatický preklad?","[""Patrik Pavlišin"", ""automatický preklad"", ""Metódy automatického prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]" +True,True,,,g0314,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026596,,"Aký je názov práce osoby Samuel Džurina, ak jej dokument zároveň obsahuje kľúčové slovo zásielková spoločnosť?","[""Samuel Džurina"", ""zásielková spoločnosť"", ""Dialógový systém pre podporu firemných procesov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]",[],"[""entity_resolution""]" +True,True,,,g0316,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027153,,"Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo znalostný graf?","[""Valerii Kutsenko"", ""znalostný graf"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]" +True,True,,,g0319,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030794,,"Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo grafové neurónové siete?","[""Maroš Harahus"", ""grafové neurónové siete"", ""Neurónová morfologická anotácia slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]",[],"[""entity_resolution""]" +True,True,,,g0322,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026689,,"Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?","[""Artem Yatsenko"", ""anotácia"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]" +True,True,,,g0323,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.028413,,"Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo sumarizácia?","[""Simona Bobrovčanová"", ""sumarizácia"", ""Automatická sumarizácia slovenského textu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]" +True,True,,,g0324,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.029888,,"Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?","[""Patrik Pavlišin"", ""strojový preklad"", ""Metódy automatického prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]" +True,True,,,g0327,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03118,,"Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo získavanie informácií?","[""Ján Holp"", ""získavanie informácií"", ""Systém získavania informácií v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]",[],"[""entity_resolution""]" +True,True,,,g0328,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027693,,"Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo špeciálny pedagóg?","[""Rostyslav Rodzhuk"", ""špeciálny pedagóg"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]" +True,True,,,g0329,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.028028,,"Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?","[""Valerii Kutsenko"", ""GraphRAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]" +True,True,,,g0330,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.036581,,"Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo LLM?","[""Tetiana Mohorian"", ""LLM"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]" +True,True,,,g0331,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032202,,"Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo deduplikácia?","[""Yevhenii Medushivskyi"", ""deduplikácia"", ""Získavanie textu z webových stránok""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]",[],"[""entity_resolution""]" +True,True,,,g0333,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.04347,,"Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo LLM?","[""Rostyslav Rodzhuk"", ""LLM"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]" +True,True,,,g0336,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03309,,"Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo pomenované entity?","[""Artem Yatsenko"", ""pomenované entity"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]" +True,True,,,g0337,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.043464,,"Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo slovenský internet?","[""Ján Holp"", ""slovenský internet"", ""Systém získavania informácií v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]",[],"[""entity_resolution""]" +True,True,,,g0340,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03595,,"Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?","[""Matej Ščišľak"", ""GraphRAG"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]" +True,True,,,g0341,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.034697,,"Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo Elasticsearch?","[""Michal Stromko"", ""Elasticsearch"", ""Indexovanie slovenského textu pomocou Elasticsearch""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]" +True,True,,,g0343,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.040288,,"Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo crawler?","[""Yevhenii Medushivskyi"", ""crawler"", ""Získavanie textu z webových stránok""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]",[],"[""entity_resolution""]" +True,True,,,g0344,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.047147,,"Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?","[""Vladimír Ferko"", ""hate speech"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]" +True,True,,,g0345,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.046342,,"Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?","[""Maroš Harahus"", ""Spacy"", ""Neurónová morfologická anotácia slovenského jazyka""]","[""Maroš Harahus"", ""Spacy"", ""Neurónová morfologická anotácia slovenského jazyka""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]" +True,True,,,g0346,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.053478,,"Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo RAG?","[""Valerii Kutsenko"", ""RAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]","[""Valerii Kutsenko"", ""RAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]" +True,True,,,g0347,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030495,,"Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo paralelný korpus?","[""Patrik Pavlišin"", ""paralelný korpus"", ""Metódy automatického prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]" +True,True,,,g0348,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030233,,"Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo SlovakBERT?","[""Vladimír Ferko"", ""SlovakBERT"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]" +True,True,,,g0349,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.029778,,"Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?","[""Vladimír Ferko"", ""anotácia"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]" +True,True,,,g0353,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030976,,"Aký je názov práce osoby Dominik Nagy, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?","[""Dominik Nagy"", ""strojový preklad"", ""Neurónový strojový preklad pomocou knižnice Fairseq""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]",[],"[""entity_resolution""]" +True,True,,,g0354,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.042909,,"Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo BERT?","[""Ondrej Megela"", ""BERT"", ""Neurónové jazykové modelovanie typu BERT""]","[""Ondrej Megela"", ""BERT"", ""Neurónové jazykové modelovanie typu BERT""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]" +True,True,,,g0355,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043609,,"Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo PageRank?","[""Ján Holp"", ""PageRank"", ""Systém získavania informácií v slovenskom jazyku""]","[""Ján Holp"", ""PageRank"", ""Systém získavania informácií v slovenskom jazyku""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]" +True,True,,,g0359,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032191,,"Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo právne dokumenty?","[""Simona Bobrovčanová"", ""právne dokumenty"", ""Automatická sumarizácia slovenského textu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]" +True,True,,,g0361,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032137,,"Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?","[""Michal Stromko"", ""FAISS"", ""Indexovanie slovenského textu pomocou Elasticsearch""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]" +True,True,,,g0364,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032332,,"Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Kubernetes?","[""Daniil Huzenko"", ""Kubernetes"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]",[],"[""entity_resolution""]" +True,True,,,g0366,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.033855,,"Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo jazykové modelovanie?","[""Ondrej Megela"", ""jazykové modelovanie"", ""Neurónové jazykové modelovanie typu BERT""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]",[],"[""entity_resolution""]" +True,True,,,g0368,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.035037,,"Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Raspberry Pi?","[""Daniil Huzenko"", ""Raspberry Pi"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]",[],"[""entity_resolution""]" +True,True,,,g0375,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037333,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Michal Stromko""]","[""Daniel Hladek"", ""bp2022"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0376,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038901,,Ktorý autor dokumentu je pri osobe Yevhenii Medushivskyi spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Yevhenii Medushivskyi""]","[""Daniel Hladek"", ""bp2026"", ""Yevhenii Medushivskyi""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0379,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043376,,Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Kristián Sopkovič""]","[""Daniel Hladek"", ""bp2022"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0380,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039161,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Michal Stromko""]","[""Daniel Hladek"", ""dp2024"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0381,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038159,,Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Dominik Nagy""]","[""Daniel Hladek"", ""bp2019"", ""Dominik Nagy""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0382,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036021,,Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou vp2025?,"[""Daniel Hladek"", ""vp2025"", ""Rostyslav Rodzhuk""]","[""Daniel Hladek"", ""vp2025"", ""Rostyslav Rodzhuk""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0385,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035788,,Ktorý autor dokumentu je pri osobe Oliver Pejic spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Oliver Pejic""]","[""Daniel Hladek"", ""iaeste"", ""Oliver Pejic""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0386,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034071,,Ktorý autor dokumentu je pri osobe Vladimír Ferko spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Vladimír Ferko""]","[""Daniel Hladek"", ""bp2024"", ""Vladimír Ferko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0387,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034173,,Ktorý autor dokumentu je pri osobe Jakub Maruniak spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Jakub Maruniak""]","[""Daniel Hladek"", ""bp2019"", ""Jakub Maruniak""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0388,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030977,,Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou dp2023?,"[""Daniel Hladek"", ""dp2023"", ""Ondrej Megela""]","[""Daniel Hladek"", ""dp2023"", ""Ondrej Megela""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0389,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032516,,Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Dávid Omasta""]","[""Daniel Hladek"", ""dp2024"", ""Dávid Omasta""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0390,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038375,,Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Tomáš Kuchárik""]","[""Daniel Hladek"", ""dp2021"", ""Tomáš Kuchárik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0392,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037009,,Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Dominik Nagy""]","[""Daniel Hladek"", ""dp2022"", ""Dominik Nagy""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0393,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035342,,Ktorý autor dokumentu je pri osobe Matej Novotný spojený s kategóriou dp2026?,"[""Daniel Hladek"", ""dp2026"", ""Matej Novotný""]","[""Daniel Hladek"", ""dp2026"", ""Matej Novotný""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0394,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035975,,Ktorý autor dokumentu je pri osobe Simona Bobrovčanová spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Simona Bobrovčanová""]","[""Daniel Hladek"", ""bp2026"", ""Simona Bobrovčanová""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0396,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036146,,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Maroš Harahus""]","[""Daniel Hladek"", ""bp2019"", ""Maroš Harahus""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0397,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035641,,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Valerii Kutsenko""]","[""Daniel Hladek"", ""bp2025"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0398,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034506,,Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou bp2020?,"[""Daniel Hladek"", ""bp2020"", ""Patrik Pavlišin""]","[""Daniel Hladek"", ""bp2020"", ""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0400,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.045822,,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Ján Holp""]","[""Daniel Hladek"", ""bp2019"", ""Ján Holp""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0405,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03357,,Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Matej Ščišľak""]","[""Daniel Hladek"", ""bp2024"", ""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0407,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032658,,Ktorý autor dokumentu je pri osobe Samuel Džurina spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Samuel Džurina""]","[""Daniel Hladek"", ""bp2026"", ""Samuel Džurina""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0408,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033924,,Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Patrik Pavlišin""]","[""Daniel Hladek"", ""dp2022"", ""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0410,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03467,,Ktorý autor dokumentu je pri osobe Bogdan Paul Chiș spojený s kategóriou erasmus?,"[""Daniel Hladek"", ""erasmus"", ""Bogdan Paul Chiș""]","[""Daniel Hladek"", ""erasmus"", ""Bogdan Paul Chiș""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/interns/bogdan_paul_chis/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0411,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033171,,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Ján Holp""]","[""Daniel Hladek"", ""dp2021"", ""Ján Holp""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0412,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039501,,Ktorý autor dokumentu je pri osobe Ján Pták spojený s kategóriou dp2027?,"[""Daniel Hladek"", ""dp2027"", ""Ján Pták""]","[""Daniel Hladek"", ""dp2027"", ""Ján Pták""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0415,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040915,,Ktorý autor dokumentu je pri osobe Cesar Abascal Gutierrez spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Cesar Abascal Gutierrez""]","[""Daniel Hladek"", ""iaeste"", ""Cesar Abascal Gutierrez""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/cesar_gutierrez/README.md""]","[""pages/interns/cesar_gutierrez/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0416,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040674,,Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou bp2021?,"[""Daniel Hladek"", ""bp2021"", ""Ondrej Megela""]","[""Daniel Hladek"", ""bp2021"", ""Ondrej Megela""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0417,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032794,,Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Tomáš Kuchárik""]","[""Daniel Hladek"", ""dp2022"", ""Tomáš Kuchárik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0420,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037246,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou vp2021?,"[""Daniel Hladek"", ""vp2021"", ""Michal Stromko""]","[""Daniel Hladek"", ""vp2021"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0422,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040183,,Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Rostyslav Rodzhuk""]","[""Daniel Hladek"", ""bp2026"", ""Rostyslav Rodzhuk""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0424,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038684,,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou vp2024?,"[""Daniel Hladek"", ""vp2024"", ""Valerii Kutsenko""]","[""Daniel Hladek"", ""vp2024"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0425,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041273,,Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Kristián Sopkovič""]","[""Daniel Hladek"", ""dp2024"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0426,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03494,,Ktorý autor dokumentu je pri osobe Artem Yatsenko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Artem Yatsenko""]","[""Daniel Hladek"", ""bp2022"", ""Artem Yatsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0427,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033772,,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Maroš Harahus""]","[""Daniel Hladek"", ""dp2021"", ""Maroš Harahus""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0433,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033384,,Ktorý autor dokumentu je pri osobe Daniil Huzenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Daniil Huzenko""]","[""Daniel Hladek"", ""bp2025"", ""Daniil Huzenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0435,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030176,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?,"[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0436,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027677,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?,"[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0438,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.027802,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?,"[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0439,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.031714,,V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?,"[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0440,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.0319,,V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?,"[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0442,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029485,,V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?,"[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0443,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027084,,V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?,"[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0445,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027547,,V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0447,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.028774,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ján Holp?,"[""Ján Holp"", ""bp2019"", ""dp2021""]","[""Ján Holp"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0449,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.02964,,V ktorých kategóriách sa nachádzajú dokumenty osoby Jakub Maruniak?,"[""Jakub Maruniak"", ""bp2019"", ""dp2021""]","[""Jakub Maruniak"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0450,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028497,,V ktorých kategóriách sa nachádzajú dokumenty osoby Michal Stromko?,"[""Michal Stromko"", ""bp2022"", ""dp2024"", ""vp2021""]","[""Michal Stromko"", ""bp2022"", ""dp2024"", ""vp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0452,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027432,,V ktorých kategóriách sa nachádzajú dokumenty osoby Matej Ščišľak?,"[""Matej Ščišľak"", ""bp2024"", ""dp2026""]","[""Matej Ščišľak"", ""bp2024"", ""dp2026""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0453,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027458,,V ktorých kategóriách sa nachádzajú dokumenty osoby Rostyslav Rodzhuk?,"[""Rostyslav Rodzhuk"", ""bp2026"", ""vp2025""]","[""Rostyslav Rodzhuk"", ""bp2026"", ""vp2025""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0454,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026824,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?,"[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0455,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026821,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?,"[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0457,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.028557,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?,"[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0458,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.027045,,V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?,"[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0459,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02714,,V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?,"[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0461,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027403,,V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?,"[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0462,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027458,,V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?,"[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0464,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027554,,V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,3,3,g0465,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033718,,"Z kandidátov Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,3,3,g0466,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034614,,"Z kandidátov Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,2,2,g0469,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03287,,"Z kandidátov Ondrej Megela, Patrik Pavlišin, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,2,2,g0471,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033216,,"Z kandidátov Dávid Omasta, Vladimír Ferko, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2024. Koľko ich je?","[""Dávid Omasta"", ""Vladimír Ferko"", ""2"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2"", ""2024""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,3,3,g0473,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034866,,"Z kandidátov Ján Pták, Matej Novotný, Matej Ščišľak, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?","[""Ján Pták"", ""Matej Novotný"", ""Matej Ščišľak"", ""3"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""Matej Ščišľak"", ""3"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,2,2,g0475,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032192,,"Z kandidátov Daniil Huzenko, Tetiana Mohorian, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2025. Koľko ich je?","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2"", ""2025""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2"", ""2025""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,3,3,g0476,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031572,,"Ktoré osoby zo zoznamu Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko zdieľajú rok práce 2021? Uveď aj ich počet.","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,3,3,g0477,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031041,,"Ktoré osoby zo zoznamu Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko zdieľajú rok práce 2022? Uveď aj ich počet.","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,2,2,g0480,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03146,,"Ktoré osoby zo zoznamu Ondrej Megela, Patrik Pavlišin, Artem Yatsenko zdieľajú rok práce 2020? Uveď aj ich počet.","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0484,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.027179,,Ktorá z osôb Ján Pták a Matej Novotný spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo OpenWebUI a jej práca je uvedená v roku 2026?,"[""Ján Pták"", ""OpenWebUI"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]",[],"[""entity_resolution""]" +True,True,,,g0485,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02593,,Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Elasticsearch a jej práca je uvedená v roku 2022?,"[""Michal Stromko"", ""Elasticsearch"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]" +True,True,,,g0486,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.033938,,Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo LLM a jej práca je uvedená v roku 2025?,"[""Tetiana Mohorian"", ""LLM"", ""2025""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]" +True,True,,,g0488,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02822,,Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo FAISS a jej práca je uvedená v roku 2022?,"[""Michal Stromko"", ""FAISS"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]" +True,True,,,g0490,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.027184,,Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo prompting a jej práca je uvedená v roku 2025?,"[""Tetiana Mohorian"", ""prompting"", ""2025""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]" +True,True,,,g0492,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026557,,Ktorá z osôb Yevhenii Medushivskyi a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo webový korpus a jej práca je uvedená v roku 2026?,"[""Yevhenii Medushivskyi"", ""webový korpus"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]",[],"[""entity_resolution""]" +True,True,,,g0493,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026611,,Ktorá z osôb Simona Bobrovčanová a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo právne dokumenty a jej práca je uvedená v roku 2026?,"[""Simona Bobrovčanová"", ""právne dokumenty"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]" +True,True,,,g0495,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.025809,,Ktorá z osôb Kristián Sopkovič a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenčina a jej práca je uvedená v roku 2022?,"[""Kristián Sopkovič"", ""slovenčina"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]" +True,True,,,g0498,dev,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03328,,Ktorá z osôb Maroš Harahus a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2021?,"[""Maroš Harahus"", ""Spacy"", ""2021""]","[""Maroš Harahus"", ""Spacy"", ""2021""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]" +True,True,,,g0499,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02629,,Ktorá z osôb Ján Holp a Jakub Maruniak spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenský internet a jej práca je uvedená v roku 2021?,"[""Ján Holp"", ""slovenský internet"", ""2021""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]",[],"[""entity_resolution""]" +True,True,,,g0500,dev,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034901,,Ktorá z osôb Kristián Sopkovič a Dominik Nagy spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2022?,"[""Kristián Sopkovič"", ""Spacy"", ""2022""]","[""Kristián Sopkovič"", ""Spacy"", ""2022""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]" diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.json b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.json new file mode 100644 index 0000000..805caa7 --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.json @@ -0,0 +1,28414 @@ +{ + "evaluation_schema_version": 3, + "run_metadata": { + "started_at_utc": "2026-10-24T19:02:47.572839+00:00", + "python": "3.10.12", + "git_head": "9f3483d29017bee0d93ed4c225c9952c024d0029", + "wiki_git_head": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e", + "fingerprints": { + "implementation": { + "tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5", + "tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80", + "tools/graphrag/evaluation/evaluate_graphrag.py": "6bdf68307b6bb90731fe09a89955e96eee76fec13bdf82281a96715dd168680e", + "tools/graphrag/evaluation/freeze_graphrag.py": "32198eca7642f39a8ad33deefe0eea396d38fcc0f5bc5814cbb64ab6d3443b9e", + "tools/graphrag/evaluation/graphrag_evaluator.py": "267d4e9942b7767a78a3689e8f7c9d6ed49f025389b043b69449b2d225651160", + "tools/graphrag/evaluation/reproducibility.py": "5c28d8aa37ec6a973fa494f7e528c19af2f1326422ea7fd05912e01aa1af6725", + "tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2", + "tools/graphrag/graph_search.py": "20f466e8d9eef6a38e41860e9be9ebc719c93f38bcfa6f60aca0e1b56c7d6bca", + "tools/graphrag/graphrag.py": "bee2eb1f86d8df8e978495a61107edf723df2dc2e0468e3ecf844719ec635e1d", + "tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb", + "tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748", + "tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b", + "tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48", + "tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e", + "tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298", + "tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f", + "tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c", + "requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a" + }, + "dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e", + "inputs": { + "data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52", + "data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9" + } + }, + "graph": { + "sha256": "0637d9ebb106c65d9aaa73d0634b28db81135e6a6c7503ea6b06c4a922e7e1e3", + "nodes": 422, + "relationships": 829 + }, + "completed_at_utc": "2026-10-24T19:02:57.590137+00:00", + "audit_sha256": "4fbc8ea8090caaf275cac384e3c3c8ed7c3743b49523086bee3f0970e11d9276" + }, + "configuration": { + "questions_file": "/home/janko/DP/zp-agent/tools/graphrag/evaluation/graphrag_questions.json", + "split": "dev", + "dataset_question_count": 500, + "selected_question_count": 286, + "limit": 40, + "max_entities": 8, + "ids": [], + "max_questions": null + }, + "summary": { + "questions": 286, + "strict_count": 209, + "strict_accuracy": 0.730769, + "error_count": 0, + "value_score": 0.751748, + "entity_score": 0.751748, + "relation_score": 0.751748, + "property_score": 0.835664, + "relation_choice_score": 0.968531, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032786, + "latency_median_seconds": 0.03221, + "latency_p95_seconds": 0.041831 + }, + "by_category": { + "candidate_set_aggregation": { + "questions": 9, + "strict_count": 9, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032839, + "latency_median_seconds": 0.03287, + "latency_p95_seconds": 0.034765 + }, + "conjunctive_disambiguation": { + "questions": 11, + "strict_count": 2, + "strict_accuracy": 0.181818, + "error_count": 0, + "value_score": 0.181818, + "entity_score": 0.181818, + "relation_score": 0.181818, + "property_score": 0.181818, + "relation_choice_score": 0.181818, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.028718, + "latency_median_seconds": 0.027179, + "latency_p95_seconds": 0.03442 + }, + "document_author_category_multi_hop": { + "questions": 35, + "strict_count": 35, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.03659, + "latency_median_seconds": 0.035975, + "latency_p95_seconds": 0.041904 + }, + "person_keyword_title": { + "questions": 42, + "strict_count": 4, + "strict_accuracy": 0.095238, + "error_count": 0, + "value_score": 0.095238, + "entity_score": 0.095238, + "relation_score": 0.095238, + "property_score": 0.095238, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032663, + "latency_median_seconds": 0.030885, + "latency_p95_seconds": 0.046205 + }, + "person_multiple_categories": { + "questions": 21, + "strict_count": 15, + "strict_accuracy": 0.714286, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.028285, + "latency_median_seconds": 0.027554, + "latency_p95_seconds": 0.031714 + }, + "person_title_year": { + "questions": 44, + "strict_count": 44, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.033826, + "latency_median_seconds": 0.03231, + "latency_p95_seconds": 0.039743 + }, + "same_academic_year_pair": { + "questions": 56, + "strict_count": 56, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.035307, + "latency_median_seconds": 0.03434, + "latency_p95_seconds": 0.040805 + }, + "same_start_year_pair": { + "questions": 28, + "strict_count": 28, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.028555, + "latency_median_seconds": 0.02798, + "latency_p95_seconds": 0.03114 + }, + "shared_keyword_pair": { + "questions": 40, + "strict_count": 16, + "strict_accuracy": 0.4, + "error_count": 0, + "value_score": 0.4, + "entity_score": 0.4, + "relation_score": 0.4, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.031346, + "latency_median_seconds": 0.030011, + "latency_p95_seconds": 0.038856 + } + }, + "by_difficulty": { + "hard": { + "questions": 242, + "strict_count": 165, + "strict_accuracy": 0.681818, + "error_count": 0, + "value_score": 0.706612, + "entity_score": 0.706612, + "relation_score": 0.706612, + "property_score": 0.805785, + "relation_choice_score": 0.96281, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032597, + "latency_median_seconds": 0.032164, + "latency_p95_seconds": 0.041891 + }, + "medium": { + "questions": 44, + "strict_count": 44, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.033826, + "latency_median_seconds": 0.03231, + "latency_p95_seconds": 0.039743 + } + }, + "questions": [ + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0001", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Maroš Harahus a Jakub Maruniak v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.037433, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0002", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Maroš Harahus a Jakub Maruniak cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.035416, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Jakub Maruniak", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0003", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Maroš Harahus a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.031317, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0004", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Maroš Harahus a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029606, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0005", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Maroš Harahus a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.031042, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0006", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Maroš Harahus a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029576, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Maroš Harahus", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0007", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Jakub Maruniak a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.028865, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0008", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Jakub Maruniak a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029412, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Kristián Sopkovič", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0009", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.028867, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0010", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029123, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0011", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Kristián Sopkovič a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.029002, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0012", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Kristián Sopkovič a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.027919, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "matched_values": [ + "Kristián Sopkovič", + "Artem Yatsenko", + "Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0013", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tomáš Kuchárik a Dávid Omasta v ZP Wiki prepojené cez kľúčové slovo Question Answering? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.027892, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dávid Omasta", + "Question Answering" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Question Answering" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0014", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tomáš Kuchárik a Dávid Omasta cez kľúčové slovo Question Answering a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029358, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dávid Omasta", + "Question Answering" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Question Answering" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0015", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tomáš Kuchárik a Dominik Nagy v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.02587, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dominik Nagy", + "strojový preklad" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0016", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tomáš Kuchárik a Dominik Nagy cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.028411, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Dominik Nagy", + "strojový preklad" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0017", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tomáš Kuchárik a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.027256, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0018", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tomáš Kuchárik a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026018, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0019", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Dominik Nagy a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.028044, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0020", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Dominik Nagy a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.030635, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Patrik Pavlišin", + "strojový preklad" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0021", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo pomenované entity? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.030589, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "pomenované entity" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "pomenované entity" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0022", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo pomenované entity a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.034683, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Artem Yatsenko", + "pomenované entity" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "pomenované entity" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0023", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Ondrej Megela a Matej Novotný v ZP Wiki prepojené cez kľúčové slovo jazykové modelovanie? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.02886, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Matej Novotný", + "jazykové modelovanie" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "jazykové modelovanie" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0024", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Ondrej Megela a Matej Novotný cez kľúčové slovo jazykové modelovanie a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.031182, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Matej Novotný", + "jazykové modelovanie" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "jazykové modelovanie" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0025", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Dávid Omasta a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo slovenčina? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.038696, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Kristián Sopkovič", + "slovenčina" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenčina" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0026", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Dávid Omasta a Kristián Sopkovič cez kľúčové slovo slovenčina a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.041906, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Kristián Sopkovič", + "slovenčina" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenčina" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0027", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Michal Stromko a Matej Ščišľak v ZP Wiki prepojené cez kľúčové slovo FAISS? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.031662, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Matej Ščišľak", + "FAISS" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0028", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Michal Stromko a Matej Ščišľak cez kľúčové slovo FAISS a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029943, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Matej Ščišľak", + "FAISS" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0031", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Artem Yatsenko a Vladimír Ferko v ZP Wiki prepojené cez kľúčové slovo anotácia? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.031258, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Vladimír Ferko", + "anotácia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0032", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Artem Yatsenko a Vladimír Ferko cez kľúčové slovo anotácia a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.034636, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Vladimír Ferko", + "anotácia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0035", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Matej Ščišľak a Valerii Kutsenko v ZP Wiki prepojené cez kľúčové slovo GraphRAG? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.029476, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Valerii Kutsenko", + "GraphRAG" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0036", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Matej Ščišľak a Valerii Kutsenko cez kľúčové slovo GraphRAG a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.042411, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Valerii Kutsenko", + "GraphRAG" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0037", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Vladimír Ferko a Tetiana Mohorian v ZP Wiki prepojené cez kľúčové slovo hate speech? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.036859, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "Tetiana Mohorian", + "hate speech" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0038", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Vladimír Ferko a Tetiana Mohorian cez kľúčové slovo hate speech a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029953, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "Tetiana Mohorian", + "hate speech" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0041", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Valerii Kutsenko a Ján Pták v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.033878, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "matched_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0042", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Valerii Kutsenko a Ján Pták cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.034934, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "matched_values": [ + "Valerii Kutsenko", + "Ján Pták", + "RAG" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0049", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Tetiana Mohorian a Rostyslav Rodzhuk v ZP Wiki prepojené cez kľúčové slovo LLM? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.03198, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Rostyslav Rodzhuk", + "LLM" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0050", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Tetiana Mohorian a Rostyslav Rodzhuk cez kľúčové slovo LLM a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.029189, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Rostyslav Rodzhuk", + "LLM" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0053", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Rostyslav Rodzhuk a Samuel Džurina v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.03007, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0054", + "split": "dev", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Rostyslav Rodzhuk a Samuel Džurina cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.030627, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "agent" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "shared_keyword_constraints" + ], + "fact_types": [ + "shared_keyword" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0058", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Samuel Džurina?", + "latency_seconds": 0.040538, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0060", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Novotný?", + "latency_seconds": 0.035129, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Matej Novotný", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Novotný", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0063", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.033403, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0064", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Samuel Džurina?", + "latency_seconds": 0.033754, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0066", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Samuel Džurina?", + "latency_seconds": 0.03164, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0068", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Kristián Sopkovič?", + "latency_seconds": 0.03323, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0071", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Simona Bobrovčanová?", + "latency_seconds": 0.034048, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0072", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Rostyslav Rodzhuk?", + "latency_seconds": 0.051306, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Rostyslav Rodzhuk", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0074", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Holp a Maroš Harahus?", + "latency_seconds": 0.041968, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0075", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Tomáš Kuchárik?", + "latency_seconds": 0.039645, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0076", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dávid Omasta a Vladimír Ferko?", + "latency_seconds": 0.037461, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2024" + ], + "expected_entities": [ + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0078", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Michal Stromko?", + "latency_seconds": 0.040354, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0079", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Michal Stromko?", + "latency_seconds": 0.037006, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0081", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Yevhenii Medushivskyi?", + "latency_seconds": 0.034235, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0084", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Yevhenii Medushivskyi?", + "latency_seconds": 0.03649, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0086", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ondrej Megela a Patrik Pavlišin?", + "latency_seconds": 0.034878, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2020" + ], + "expected_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0087", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Maroš Harahus?", + "latency_seconds": 0.03767, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0088", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Simona Bobrovčanová?", + "latency_seconds": 0.03211, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0089", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Kristián Sopkovič?", + "latency_seconds": 0.033544, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0091", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Simona Bobrovčanová?", + "latency_seconds": 0.033013, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0092", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Simona Bobrovčanová a Yevhenii Medushivskyi?", + "latency_seconds": 0.033095, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0093", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Tomáš Kuchárik?", + "latency_seconds": 0.038339, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Tomáš Kuchárik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0095", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Michal Stromko?", + "latency_seconds": 0.036387, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0097", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Dominik Nagy?", + "latency_seconds": 0.033982, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0098", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Michal Stromko a Tomáš Kuchárik?", + "latency_seconds": 0.035164, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Michal Stromko", + "Tomáš Kuchárik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0099", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Rostyslav Rodzhuk?", + "latency_seconds": 0.033515, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Rostyslav Rodzhuk", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0100", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Yevhenii Medushivskyi?", + "latency_seconds": 0.031868, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0104", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Ščišľak?", + "latency_seconds": 0.033453, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Matej Ščišľak", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Ščišľak", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0105", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Tomáš Kuchárik?", + "latency_seconds": 0.033682, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Tomáš Kuchárik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0107", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Yevhenii Medushivskyi?", + "latency_seconds": 0.03179, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0108", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Simona Bobrovčanová?", + "latency_seconds": 0.031776, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0110", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Matej Ščišľak?", + "latency_seconds": 0.03159, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0111", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Ján Holp?", + "latency_seconds": 0.034509, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0114", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Simona Bobrovčanová?", + "latency_seconds": 0.033169, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0115", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Rostyslav Rodzhuk?", + "latency_seconds": 0.035052, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Rostyslav Rodzhuk", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0116", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Daniil Huzenko a Tetiana Mohorian?", + "latency_seconds": 0.032058, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2025" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2025" + ], + "expected_entities": [ + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0118", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Yevhenii Medushivskyi?", + "latency_seconds": 0.034542, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0122", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Samuel Džurina?", + "latency_seconds": 0.032246, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0124", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Matej Novotný?", + "latency_seconds": 0.035132, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Matej Novotný", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Novotný", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0127", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.040031, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0128", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Novotný a Samuel Džurina?", + "latency_seconds": 0.041605, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0130", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Ščišľak a Samuel Džurina?", + "latency_seconds": 0.039519, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Samuel Džurina", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Samuel Džurina", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0132", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Artem Yatsenko a Kristián Sopkovič?", + "latency_seconds": 0.035394, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0135", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Samuel Džurina a Simona Bobrovčanová?", + "latency_seconds": 0.032907, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0136", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Rostyslav Rodzhuk?", + "latency_seconds": 0.032575, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Rostyslav Rodzhuk", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Rostyslav Rodzhuk", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0138", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Holp a Maroš Harahus?", + "latency_seconds": 0.035918, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Ján Holp", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0139", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Artem Yatsenko a Tomáš Kuchárik?", + "latency_seconds": 0.035493, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Tomáš Kuchárik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0140", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Dávid Omasta a Vladimír Ferko?", + "latency_seconds": 0.033322, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2024" + ], + "expected_entities": [ + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0142", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Kristián Sopkovič a Michal Stromko?", + "latency_seconds": 0.036853, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0143", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Artem Yatsenko a Michal Stromko?", + "latency_seconds": 0.033705, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Michal Stromko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0145", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Pták a Yevhenii Medushivskyi?", + "latency_seconds": 0.033962, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0148", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Ščišľak a Yevhenii Medushivskyi?", + "latency_seconds": 0.037038, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Yevhenii Medushivskyi", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0150", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ondrej Megela a Patrik Pavlišin?", + "latency_seconds": 0.034444, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2020" + ], + "expected_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0151", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Jakub Maruniak a Maroš Harahus?", + "latency_seconds": 0.03399, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Maroš Harahus", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0152", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Matej Novotný a Simona Bobrovčanová?", + "latency_seconds": 0.032451, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Simona Bobrovčanová", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Simona Bobrovčanová", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0153", + "split": "dev", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Dominik Nagy a Kristián Sopkovič?", + "latency_seconds": 0.035207, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Kristián Sopkovič", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Kristián Sopkovič", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0155", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Tetiana Mohorian a Valerii Kutsenko?", + "latency_seconds": 0.029885, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0156", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Tetiana Mohorian?", + "latency_seconds": 0.027903, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0160", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Yevhenii Medushivskyi?", + "latency_seconds": 0.027823, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0162", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Valerii Kutsenko?", + "latency_seconds": 0.028935, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0163", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Simona Bobrovčanová?", + "latency_seconds": 0.029787, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0164", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Simona Bobrovčanová a Yevhenii Medushivskyi?", + "latency_seconds": 0.02925, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0165", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Matej Ščišľak?", + "latency_seconds": 0.027829, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "matched_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0167", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?", + "latency_seconds": 0.028969, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0168", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Jakub Maruniak a Ján Holp?", + "latency_seconds": 0.028057, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "expected_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0172", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.036591, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0174", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Tetiana Mohorian?", + "latency_seconds": 0.027785, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0177", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Ján Pták?", + "latency_seconds": 0.030561, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0182", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Valerii Kutsenko?", + "latency_seconds": 0.031452, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0185", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Vladimír Ferko?", + "latency_seconds": 0.028827, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Vladimír Ferko", + "2021" + ], + "matched_values": [ + "Matej Novotný", + "Vladimír Ferko", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0186", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Simona Bobrovčanová?", + "latency_seconds": 0.028735, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2023" + ], + "matched_values": [ + "Samuel Džurina", + "Simona Bobrovčanová", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0188", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Ščišľak a Vladimír Ferko?", + "latency_seconds": 0.028802, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Vladimír Ferko", + "2021" + ], + "matched_values": [ + "Matej Ščišľak", + "Vladimír Ferko", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0189", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Tetiana Mohorian a Valerii Kutsenko?", + "latency_seconds": 0.027861, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Tetiana Mohorian", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0190", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Tetiana Mohorian?", + "latency_seconds": 0.02697, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0194", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Džurina a Yevhenii Medushivskyi?", + "latency_seconds": 0.026874, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Samuel Džurina", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0196", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Valerii Kutsenko?", + "latency_seconds": 0.026984, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "matched_values": [ + "Ján Pták", + "Valerii Kutsenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0197", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Simona Bobrovčanová?", + "latency_seconds": 0.026571, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Simona Bobrovčanová", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0198", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Simona Bobrovčanová a Yevhenii Medushivskyi?", + "latency_seconds": 0.027659, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0199", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Matej Novotný a Matej Ščišľak?", + "latency_seconds": 0.028289, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "matched_values": [ + "Matej Novotný", + "Matej Ščišľak", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0201", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?", + "latency_seconds": 0.027168, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Yevhenii Medushivskyi", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0202", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Jakub Maruniak a Ján Holp?", + "latency_seconds": 0.028239, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "2016" + ], + "expected_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0206", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Samuel Džurina?", + "latency_seconds": 0.027256, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Samuel Džurina", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md", + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk", + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0208", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Tetiana Mohorian?", + "latency_seconds": 0.027307, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0211", + "split": "dev", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Ján Pták?", + "latency_seconds": 0.027177, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "matched_values": [ + "Daniil Huzenko", + "Ján Pták", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0219", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Artem Yatsenko?", + "latency_seconds": 0.031291, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0220", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Artem Yatsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032369, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0221", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Daniil Huzenko?", + "latency_seconds": 0.031417, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", + "2025" + ], + "matched_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0222", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Daniil Huzenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032088, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", + "2025" + ], + "matched_values": [ + "Daniil Huzenko", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0227", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Dominik Nagy?", + "latency_seconds": 0.036523, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Neurónový strojový preklad pomocou knižnice Fairseq", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Neurónový strojový preklad pomocou knižnice Fairseq", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0228", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Dominik Nagy s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.038864, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "Neurónový strojový preklad pomocou knižnice Fairseq", + "2022" + ], + "matched_values": [ + "Dominik Nagy", + "Neurónový strojový preklad pomocou knižnice Fairseq", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0231", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Dávid Omasta?", + "latency_seconds": 0.031716, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0232", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Dávid Omasta s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.030937, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0237", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Jakub Maruniak?", + "latency_seconds": 0.031819, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0238", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Jakub Maruniak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032217, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0239", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ján Holp?", + "latency_seconds": 0.032698, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku", + "2021" + ], + "matched_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0240", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ján Holp s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.034307, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku", + "2021" + ], + "matched_values": [ + "Ján Holp", + "Systém získavania informácií v slovenskom jazyku", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0243", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ján Pták?", + "latency_seconds": 0.031937, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác", + "2026" + ], + "expected_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_WORK" + ], + "expected_properties": [ + "Work.title", + "Work.year" + ], + "matched_properties": [ + "Work.title", + "Work.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints" + ], + "fact_types": [ + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0244", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ján Pták s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.03133, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Agent pre manažment záverečných prác", + "2026" + ], + "expected_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_WORK" + ], + "expected_properties": [ + "Work.title", + "Work.year" + ], + "matched_properties": [ + "Work.title", + "Work.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints" + ], + "fact_types": [ + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0245", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Kristián Sopkovič?", + "latency_seconds": 0.035096, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0246", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Kristián Sopkovič s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.036623, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0251", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Maroš Harahus?", + "latency_seconds": 0.033342, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka", + "2021" + ], + "matched_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0252", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Maroš Harahus s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032007, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka", + "2021" + ], + "matched_values": [ + "Maroš Harahus", + "Neurónová morfologická anotácia slovenského jazyka", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0257", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Matej Novotný?", + "latency_seconds": 0.031346, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Klasifikácia webových dát pre lepšie jazykové modelovanie", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Klasifikácia webových dát pre lepšie jazykové modelovanie", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0258", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Matej Novotný s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.030631, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Novotný", + "Klasifikácia webových dát pre lepšie jazykové modelovanie", + "2026" + ], + "matched_values": [ + "Matej Novotný", + "Klasifikácia webových dát pre lepšie jazykové modelovanie", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia webových dát pre lepšie jazykové modelovanie" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0259", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Matej Ščišľak?", + "latency_seconds": 0.031052, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0260", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Matej Ščišľak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.031513, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", + "2026" + ], + "matched_values": [ + "Matej Ščišľak", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0261", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Michal Stromko?", + "latency_seconds": 0.034855, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch", + "2022" + ], + "matched_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0262", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Michal Stromko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.054187, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch", + "2022" + ], + "matched_values": [ + "Michal Stromko", + "Indexovanie slovenského textu pomocou Elasticsearch", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0269", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ondrej Megela?", + "latency_seconds": 0.035496, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Neurónové jazykové modelovanie typu BERT", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Neurónové jazykové modelovanie typu BERT", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0270", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ondrej Megela s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032554, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Neurónové jazykové modelovanie typu BERT", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Neurónové jazykové modelovanie typu BERT", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0271", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Patrik Pavlišin?", + "latency_seconds": 0.032514, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu", + "2020" + ], + "matched_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0272", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Patrik Pavlišin s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.03513, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu", + "2020" + ], + "matched_values": [ + "Patrik Pavlišin", + "Metódy automatického prekladu", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0275", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Rostyslav Rodzhuk?", + "latency_seconds": 0.033359, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0276", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Rostyslav Rodzhuk s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.036935, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga", + "2026" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "Inteligentný agent pre podporu práce špeciálneho pedagóga", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0277", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Džurina?", + "latency_seconds": 0.031543, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0278", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Samuel Džurina s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.031702, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov", + "2026" + ], + "matched_values": [ + "Samuel Džurina", + "Dialógový systém pre podporu firemných procesov", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0281", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Simona Bobrovčanová?", + "latency_seconds": 0.031534, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu", + "2026" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0282", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Simona Bobrovčanová s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.030841, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu", + "2026" + ], + "matched_values": [ + "Simona Bobrovčanová", + "Automatická sumarizácia slovenského textu", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0283", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Tetiana Mohorian?", + "latency_seconds": 0.031343, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", + "2025" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0284", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Tetiana Mohorian s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.033305, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", + "2025" + ], + "matched_values": [ + "Tetiana Mohorian", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0285", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Tomáš Kuchárik?", + "latency_seconds": 0.032355, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", + "2022" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0286", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Tomáš Kuchárik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.034518, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", + "2022" + ], + "matched_values": [ + "Tomáš Kuchárik", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0287", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Valerii Kutsenko?", + "latency_seconds": 0.032253, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov", + "2027" + ], + "matched_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov", + "2027" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + }, + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0288", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Valerii Kutsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032937, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov", + "2027" + ], + "matched_values": [ + "Valerii Kutsenko", + "Zlepšenie vyhľadávania pomocou znalostných grafov", + "2027" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + }, + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0289", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Vladimír Ferko?", + "latency_seconds": 0.030801, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", + "2024" + ], + "matched_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0290", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Vladimír Ferko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032264, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", + "2024" + ], + "matched_values": [ + "Vladimír Ferko", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0293", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Yevhenii Medushivskyi?", + "latency_seconds": 0.039898, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok", + "2026" + ], + "matched_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0294", + "split": "dev", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Yevhenii Medushivskyi s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.046916, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok", + "2026" + ], + "matched_values": [ + "Yevhenii Medushivskyi", + "Získavanie textu z webových stránok", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0296", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo slovenský text?", + "latency_seconds": 0.028569, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "slovenský text", + "Automatická sumarizácia slovenského textu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenský text" + }, + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0297", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Kristián Sopkovič, ak jej dokument zároveň obsahuje kľúčové slovo transformery?", + "latency_seconds": 0.026116, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "transformery", + "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "transformery" + }, + { + "type": "thesis_title", + "value": "Model Spacy pre spracovanie prirodzeného jazyka v slovenčine" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0298", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?", + "latency_seconds": 0.032601, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "hate speech", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0299", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?", + "latency_seconds": 0.025679, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "FAISS", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + }, + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0300", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?", + "latency_seconds": 0.025524, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "OpenWebUI", + "Agent pre manažment záverečných prác" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "OpenWebUI" + }, + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Work.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0301", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo Neo4J?", + "latency_seconds": 0.026537, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "Neo4J", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Neo4J" + }, + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0302", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo prompting?", + "latency_seconds": 0.026121, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "prompting", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "prompting" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0303", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo morfologická anotácia?", + "latency_seconds": 0.026, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "morfologická anotácia", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "morfologická anotácia" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0304", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tomáš Kuchárik, ak jej dokument zároveň obsahuje kľúčové slovo SQuAD?", + "latency_seconds": 0.025574, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "SQuAD", + "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "SQuAD" + }, + { + "type": "thesis_title", + "value": "Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0305", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo Docker?", + "latency_seconds": 0.025864, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Docker", + "Agent pre manažment záverečných prác" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Docker" + }, + { + "type": "work_title", + "value": "Agent pre manažment záverečných prác" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Work.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0309", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo automatický preklad?", + "latency_seconds": 0.026547, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "automatický preklad", + "Metódy automatického prekladu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "automatický preklad" + }, + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0314", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Samuel Džurina, ak jej dokument zároveň obsahuje kľúčové slovo zásielková spoločnosť?", + "latency_seconds": 0.026596, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Džurina", + "zásielková spoločnosť", + "Dialógový systém pre podporu firemných procesov" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "zásielková spoločnosť" + }, + { + "type": "thesis_title", + "value": "Dialógový systém pre podporu firemných procesov" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0316", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo znalostný graf?", + "latency_seconds": 0.027153, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "znalostný graf", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0319", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo grafové neurónové siete?", + "latency_seconds": 0.030794, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "grafové neurónové siete", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "grafové neurónové siete" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0322", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?", + "latency_seconds": 0.026689, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "anotácia", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0323", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo sumarizácia?", + "latency_seconds": 0.028413, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "sumarizácia", + "Automatická sumarizácia slovenského textu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "sumarizácia" + }, + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0324", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?", + "latency_seconds": 0.029888, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "strojový preklad", + "Metódy automatického prekladu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + }, + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0327", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo získavanie informácií?", + "latency_seconds": 0.03118, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "získavanie informácií", + "Systém získavania informácií v slovenskom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "získavanie informácií" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0328", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo špeciálny pedagóg?", + "latency_seconds": 0.027693, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "špeciálny pedagóg", + "Inteligentný agent pre podporu práce špeciálneho pedagóga" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "špeciálny pedagóg" + }, + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0329", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?", + "latency_seconds": 0.028028, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "GraphRAG", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0330", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo LLM?", + "latency_seconds": 0.036581, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "LLM", + "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0331", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo deduplikácia?", + "latency_seconds": 0.032202, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "deduplikácia", + "Získavanie textu z webových stránok" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "deduplikácia" + }, + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0333", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo LLM?", + "latency_seconds": 0.04347, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "LLM", + "Inteligentný agent pre podporu práce špeciálneho pedagóga" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "LLM" + }, + { + "type": "thesis_title", + "value": "Inteligentný agent pre podporu práce špeciálneho pedagóga" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0336", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo pomenované entity?", + "latency_seconds": 0.03309, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "pomenované entity", + "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "pomenované entity" + }, + { + "type": "thesis_title", + "value": "Rozpoznávanie pomenovaných entít v slovenskom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0337", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo slovenský internet?", + "latency_seconds": 0.043464, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "slovenský internet", + "Systém získavania informácií v slovenskom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenský internet" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0340", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?", + "latency_seconds": 0.03595, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "GraphRAG", + "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "GraphRAG" + }, + { + "type": "thesis_title", + "value": "Znalostné grafy pre zlepšenie vyhľadávania právnych informácií" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0341", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo Elasticsearch?", + "latency_seconds": 0.034697, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Elasticsearch", + "Indexovanie slovenského textu pomocou Elasticsearch" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Elasticsearch" + }, + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0343", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo crawler?", + "latency_seconds": 0.040288, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "crawler", + "Získavanie textu z webových stránok" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "crawler" + }, + { + "type": "thesis_title", + "value": "Získavanie textu z webových stránok" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0344", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?", + "latency_seconds": 0.047147, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "hate speech", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "hate speech" + }, + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0345", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?", + "latency_seconds": 0.046342, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Spacy", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "matched_values": [ + "Maroš Harahus", + "Spacy", + "Neurónová morfologická anotácia slovenského jazyka" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "thesis_title", + "value": "Neurónová morfologická anotácia slovenského jazyka" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0346", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo RAG?", + "latency_seconds": 0.053478, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "RAG", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "matched_values": [ + "Valerii Kutsenko", + "RAG", + "Zlepšenie vyhľadávania pomocou znalostných grafov" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "RAG" + }, + { + "type": "thesis_title", + "value": "Zlepšenie vyhľadávania pomocou znalostných grafov" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0347", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo paralelný korpus?", + "latency_seconds": 0.030495, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "paralelný korpus", + "Metódy automatického prekladu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "paralelný korpus" + }, + { + "type": "thesis_title", + "value": "Metódy automatického prekladu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0348", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo SlovakBERT?", + "latency_seconds": 0.030233, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "SlovakBERT", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "SlovakBERT" + }, + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0349", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?", + "latency_seconds": 0.029778, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladimír Ferko", + "anotácia", + "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "anotácia" + }, + { + "type": "thesis_title", + "value": "Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0353", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Dominik Nagy, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?", + "latency_seconds": 0.030976, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "strojový preklad", + "Neurónový strojový preklad pomocou knižnice Fairseq" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "strojový preklad" + }, + { + "type": "thesis_title", + "value": "Neurónový strojový preklad pomocou knižnice Fairseq" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0354", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo BERT?", + "latency_seconds": 0.042909, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "BERT", + "Neurónové jazykové modelovanie typu BERT" + ], + "matched_values": [ + "Ondrej Megela", + "BERT", + "Neurónové jazykové modelovanie typu BERT" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "BERT" + }, + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "BERT" + }, + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0355", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo PageRank?", + "latency_seconds": 0.043609, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "PageRank", + "Systém získavania informácií v slovenskom jazyku" + ], + "matched_values": [ + "Ján Holp", + "PageRank", + "Systém získavania informácií v slovenskom jazyku" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "PageRank" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "PageRank" + }, + { + "type": "thesis_title", + "value": "Systém získavania informácií v slovenskom jazyku" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0359", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo právne dokumenty?", + "latency_seconds": 0.032191, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "právne dokumenty", + "Automatická sumarizácia slovenského textu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "právne dokumenty" + }, + { + "type": "thesis_title", + "value": "Automatická sumarizácia slovenského textu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0361", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?", + "latency_seconds": 0.032137, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "FAISS", + "Indexovanie slovenského textu pomocou Elasticsearch" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "FAISS" + }, + { + "type": "thesis_title", + "value": "Indexovanie slovenského textu pomocou Elasticsearch" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0364", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Kubernetes?", + "latency_seconds": 0.032332, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Kubernetes", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Kubernetes" + }, + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0366", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo jazykové modelovanie?", + "latency_seconds": 0.033855, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "jazykové modelovanie", + "Neurónové jazykové modelovanie typu BERT" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "jazykové modelovanie" + }, + { + "type": "thesis_title", + "value": "Neurónové jazykové modelovanie typu BERT" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0368", + "split": "dev", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Raspberry Pi?", + "latency_seconds": 0.035037, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Raspberry Pi", + "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Raspberry Pi" + }, + { + "type": "thesis_title", + "value": "Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0375", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou bp2022?", + "latency_seconds": 0.037333, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Michal Stromko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2022", + "Michal Stromko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0376", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Yevhenii Medushivskyi spojený s kategóriou bp2026?", + "latency_seconds": 0.038901, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Yevhenii Medushivskyi" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Yevhenii Medushivskyi" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0379", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou bp2022?", + "latency_seconds": 0.043376, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Kristián Sopkovič" + ], + "matched_values": [ + "Daniel Hladek", + "bp2022", + "Kristián Sopkovič" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0380", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou dp2024?", + "latency_seconds": 0.039161, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2024", + "Michal Stromko" + ], + "matched_values": [ + "Daniel Hladek", + "dp2024", + "Michal Stromko" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0381", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou bp2019?", + "latency_seconds": 0.038159, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Dominik Nagy" + ], + "matched_values": [ + "Daniel Hladek", + "bp2019", + "Dominik Nagy" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0382", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou vp2025?", + "latency_seconds": 0.036021, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "vp2025", + "Rostyslav Rodzhuk" + ], + "matched_values": [ + "Daniel Hladek", + "vp2025", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "category", + "value": "vp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "vp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0385", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Oliver Pejic spojený s kategóriou iaeste?", + "latency_seconds": 0.035788, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "iaeste", + "Oliver Pejic" + ], + "matched_values": [ + "Daniel Hladek", + "iaeste", + "Oliver Pejic" + ], + "expected_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/oliver_pejic/README.md" + ], + "actual_documents": [ + "pages/interns/oliver_pejic/README.md" + ], + "matched_documents": [ + "pages/interns/oliver_pejic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/oliver_pejic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0386", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Vladimír Ferko spojený s kategóriou bp2024?", + "latency_seconds": 0.034071, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2024", + "Vladimír Ferko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2024", + "Vladimír Ferko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0387", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Jakub Maruniak spojený s kategóriou bp2019?", + "latency_seconds": 0.034173, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Jakub Maruniak" + ], + "matched_values": [ + "Daniel Hladek", + "bp2019", + "Jakub Maruniak" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0388", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou dp2023?", + "latency_seconds": 0.030977, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2023", + "Ondrej Megela" + ], + "matched_values": [ + "Daniel Hladek", + "dp2023", + "Ondrej Megela" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0389", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2024?", + "latency_seconds": 0.032516, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2024", + "Dávid Omasta" + ], + "matched_values": [ + "Daniel Hladek", + "dp2024", + "Dávid Omasta" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0390", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2021?", + "latency_seconds": 0.038375, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2021", + "Tomáš Kuchárik" + ], + "matched_values": [ + "Daniel Hladek", + "dp2021", + "Tomáš Kuchárik" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0392", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou dp2022?", + "latency_seconds": 0.037009, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2022", + "Dominik Nagy" + ], + "matched_values": [ + "Daniel Hladek", + "dp2022", + "Dominik Nagy" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0393", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Matej Novotný spojený s kategóriou dp2026?", + "latency_seconds": 0.035342, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2026", + "Matej Novotný" + ], + "matched_values": [ + "Daniel Hladek", + "dp2026", + "Matej Novotný" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0394", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Simona Bobrovčanová spojený s kategóriou bp2026?", + "latency_seconds": 0.035975, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Simona Bobrovčanová" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Simona Bobrovčanová" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0396", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou bp2019?", + "latency_seconds": 0.036146, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Maroš Harahus" + ], + "matched_values": [ + "Daniel Hladek", + "bp2019", + "Maroš Harahus" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0397", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou bp2025?", + "latency_seconds": 0.035641, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2025", + "Valerii Kutsenko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2025", + "Valerii Kutsenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0398", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou bp2020?", + "latency_seconds": 0.034506, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2020", + "Patrik Pavlišin" + ], + "matched_values": [ + "Daniel Hladek", + "bp2020", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0400", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou bp2019?", + "latency_seconds": 0.045822, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Ján Holp" + ], + "matched_values": [ + "Daniel Hladek", + "bp2019", + "Ján Holp" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0405", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou bp2024?", + "latency_seconds": 0.03357, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2024", + "Matej Ščišľak" + ], + "matched_values": [ + "Daniel Hladek", + "bp2024", + "Matej Ščišľak" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0407", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Samuel Džurina spojený s kategóriou bp2026?", + "latency_seconds": 0.032658, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Samuel Džurina" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Samuel Džurina" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "actual_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "matched_documents": [ + "pages/students/2023/samuel_dzurina/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0408", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou dp2022?", + "latency_seconds": 0.033924, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2022", + "Patrik Pavlišin" + ], + "matched_values": [ + "Daniel Hladek", + "dp2022", + "Patrik Pavlišin" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0410", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Bogdan Paul Chiș spojený s kategóriou erasmus?", + "latency_seconds": 0.03467, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "erasmus", + "Bogdan Paul Chiș" + ], + "matched_values": [ + "Daniel Hladek", + "erasmus", + "Bogdan Paul Chiș" + ], + "expected_entities": [ + { + "type": "category", + "value": "erasmus" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "erasmus" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/bogdan_paul_chis/README.md" + ], + "actual_documents": [ + "pages/interns/bogdan_paul_chis/README.md" + ], + "matched_documents": [ + "pages/interns/bogdan_paul_chis/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0411", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou dp2021?", + "latency_seconds": 0.033171, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2021", + "Ján Holp" + ], + "matched_values": [ + "Daniel Hladek", + "dp2021", + "Ján Holp" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0412", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ján Pták spojený s kategóriou dp2027?", + "latency_seconds": 0.039501, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2027", + "Ján Pták" + ], + "matched_values": [ + "Daniel Hladek", + "dp2027", + "Ján Pták" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2027" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2027" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0415", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Cesar Abascal Gutierrez spojený s kategóriou iaeste?", + "latency_seconds": 0.040915, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "iaeste", + "Cesar Abascal Gutierrez" + ], + "matched_values": [ + "Daniel Hladek", + "iaeste", + "Cesar Abascal Gutierrez" + ], + "expected_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/cesar_gutierrez/README.md" + ], + "actual_documents": [ + "pages/interns/cesar_gutierrez/README.md" + ], + "matched_documents": [ + "pages/interns/cesar_gutierrez/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0416", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou bp2021?", + "latency_seconds": 0.040674, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2021", + "Ondrej Megela" + ], + "matched_values": [ + "Daniel Hladek", + "bp2021", + "Ondrej Megela" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0417", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2022?", + "latency_seconds": 0.032794, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2022", + "Tomáš Kuchárik" + ], + "matched_values": [ + "Daniel Hladek", + "dp2022", + "Tomáš Kuchárik" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0420", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou vp2021?", + "latency_seconds": 0.037246, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "vp2021", + "Michal Stromko" + ], + "matched_values": [ + "Daniel Hladek", + "vp2021", + "Michal Stromko" + ], + "expected_entities": [ + { + "type": "category", + "value": "vp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "vp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0422", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou bp2026?", + "latency_seconds": 0.040183, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Rostyslav Rodzhuk" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Rostyslav Rodzhuk" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0424", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou vp2024?", + "latency_seconds": 0.038684, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "vp2024", + "Valerii Kutsenko" + ], + "matched_values": [ + "Daniel Hladek", + "vp2024", + "Valerii Kutsenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "vp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "vp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0425", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou dp2024?", + "latency_seconds": 0.041273, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2024", + "Kristián Sopkovič" + ], + "matched_values": [ + "Daniel Hladek", + "dp2024", + "Kristián Sopkovič" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0426", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Artem Yatsenko spojený s kategóriou bp2022?", + "latency_seconds": 0.03494, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Artem Yatsenko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2022", + "Artem Yatsenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0427", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou dp2021?", + "latency_seconds": 0.033772, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2021", + "Maroš Harahus" + ], + "matched_values": [ + "Daniel Hladek", + "dp2021", + "Maroš Harahus" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0433", + "split": "dev", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Daniil Huzenko spojený s kategóriou bp2025?", + "latency_seconds": 0.033384, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2025", + "Daniil Huzenko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2025", + "Daniil Huzenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0435", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?", + "latency_seconds": 0.030176, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "matched_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [ + "dp2023", + "dp2024" + ], + "entity_set_actual": [ + "dp2023", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0436", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?", + "latency_seconds": 0.027677, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "matched_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [ + "bp2021", + "dp2023" + ], + "entity_set_actual": [ + "bp2021", + "dp2023" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0438", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?", + "latency_seconds": 0.027802, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "matched_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [ + "bp2019", + "dp2022" + ], + "entity_set_actual": [ + "bp2019", + "dp2022", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0439", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?", + "latency_seconds": 0.031714, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0440", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?", + "latency_seconds": 0.0319, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "matched_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_actual": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0442", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?", + "latency_seconds": 0.029485, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "matched_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_actual": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0443", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?", + "latency_seconds": 0.027084, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "matched_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [ + "bp2022", + "dp2024" + ], + "entity_set_actual": [ + "bp2022", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0445", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?", + "latency_seconds": 0.027547, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "matched_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [ + "dp2021", + "dp2022" + ], + "entity_set_actual": [ + "dp2021", + "dp2022" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0447", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ján Holp?", + "latency_seconds": 0.028774, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Ján Holp", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/jan_holp/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0449", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Jakub Maruniak?", + "latency_seconds": 0.02964, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Jakub Maruniak", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jakub_maruniak/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0450", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Michal Stromko?", + "latency_seconds": 0.028497, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "bp2022", + "dp2024", + "vp2021" + ], + "matched_values": [ + "Michal Stromko", + "bp2022", + "dp2024", + "vp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "vp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "vp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [ + "bp2022", + "dp2024", + "vp2021" + ], + "entity_set_actual": [ + "bp2022", + "dp2024", + "vp2021" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0452", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Matej Ščišľak?", + "latency_seconds": 0.027432, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Matej Ščišľak", + "bp2024", + "dp2026" + ], + "matched_values": [ + "Matej Ščišľak", + "bp2024", + "dp2026" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "category", + "value": "dp2026" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "category", + "value": "dp2026" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_scislak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak" + ], + "entity_set_expected": [ + "bp2024", + "dp2026" + ], + "entity_set_actual": [ + "bp2024", + "dp2026" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0453", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Rostyslav Rodzhuk?", + "latency_seconds": 0.027458, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Rostyslav Rodzhuk", + "bp2026", + "vp2025" + ], + "matched_values": [ + "Rostyslav Rodzhuk", + "bp2026", + "vp2025" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "category", + "value": "vp2025" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "category", + "value": "vp2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "actual_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "matched_documents": [ + "pages/students/2023/rostyslav_rodzhuk/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk" + ], + "entity_set_expected": [ + "bp2026", + "vp2025" + ], + "entity_set_actual": [ + "bp2026", + "vp2025" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0454", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?", + "latency_seconds": 0.026824, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "matched_values": [ + "Dávid Omasta", + "dp2023", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2023" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta" + ], + "entity_set_expected": [ + "dp2023", + "dp2024" + ], + "entity_set_actual": [ + "dp2023", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0455", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?", + "latency_seconds": 0.026821, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "matched_values": [ + "Ondrej Megela", + "bp2021", + "dp2023" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "category", + "value": "dp2023" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "actual_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "matched_documents": [ + "pages/students/2018/ondrej_megela/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela" + ], + "entity_set_expected": [ + "bp2021", + "dp2023" + ], + "entity_set_actual": [ + "bp2021", + "dp2023" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0457", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?", + "latency_seconds": 0.028557, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "matched_values": [ + "Dominik Nagy", + "bp2019", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2016/dominik_nagy/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy" + ], + "entity_set_expected": [ + "bp2019", + "dp2022" + ], + "entity_set_actual": [ + "bp2019", + "dp2022", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0458", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?", + "latency_seconds": 0.027045, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Maroš Harahus", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2016/maros_harahus/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0459", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?", + "latency_seconds": 0.02714, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "matched_values": [ + "Valerii Kutsenko", + "bp2025", + "dp2027", + "vp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + }, + { + "type": "category", + "value": "vp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/valerii_kutsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko" + ], + "entity_set_expected": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_actual": [ + "bp2025", + "dp2027", + "vp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0461", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?", + "latency_seconds": 0.027403, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "matched_values": [ + "Patrik Pavlišin", + "bp2020", + "dp2022", + "tp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "category", + "value": "dp2022" + }, + { + "type": "category", + "value": "tp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin" + ], + "entity_set_expected": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_actual": [ + "bp2020", + "dp2022", + "tp2021" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0462", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?", + "latency_seconds": 0.027458, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "matched_values": [ + "Kristián Sopkovič", + "bp2022", + "dp2024" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [ + "bp2022", + "dp2024" + ], + "entity_set_actual": [ + "bp2022", + "dp2024" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0464", + "split": "dev", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?", + "latency_seconds": 0.027554, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "matched_values": [ + "Tomáš Kuchárik", + "dp2021", + "dp2022" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "category", + "value": "dp2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "actual_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "matched_documents": [ + "pages/students/2016/tomas_kucharik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik" + ], + "entity_set_expected": [ + "dp2021", + "dp2022" + ], + "entity_set_actual": [ + "dp2021", + "dp2022" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0465", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?", + "latency_seconds": 0.033718, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "3", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "3", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_actual": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0466", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?", + "latency_seconds": 0.034614, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_actual": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0469", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Ondrej Megela, Patrik Pavlišin, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?", + "latency_seconds": 0.03287, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_actual": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0471", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Dávid Omasta, Vladimír Ferko, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2024. Koľko ich je?", + "latency_seconds": 0.033216, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2", + "2024" + ], + "matched_values": [ + "Dávid Omasta", + "Vladimír Ferko", + "2", + "2024" + ], + "expected_entities": [ + { + "type": "person", + "value": "Dávid Omasta" + }, + { + "type": "person", + "value": "Vladimír Ferko" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Dávid Omasta" + }, + { + "type": "person", + "value": "Vladimír Ferko" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "actual_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "matched_documents": [ + "pages/students/2018/david_omasta/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/vladimir_ferko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/david_omasta", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko" + ], + "entity_set_expected": [ + "david omasta", + "vladimir ferko" + ], + "entity_set_actual": [ + "david omasta", + "vladimir ferko" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0473", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Ján Pták, Matej Novotný, Matej Ščišľak, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?", + "latency_seconds": 0.034866, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "Matej Novotný", + "Matej Ščišľak", + "3", + "2026" + ], + "matched_values": [ + "Ján Pták", + "Matej Novotný", + "Matej Ščišľak", + "3", + "2026" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ján Pták" + }, + { + "type": "person", + "value": "Matej Novotný" + }, + { + "type": "person", + "value": "Matej Ščišľak" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ján Pták" + }, + { + "type": "person", + "value": "Matej Novotný" + }, + { + "type": "person", + "value": "Matej Ščišľak" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2021/matej_novotny/README.md", + "pages/students/2021/matej_scislak/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [ + "jan ptak", + "matej novotny", + "matej scislak" + ], + "entity_set_actual": [ + "jan ptak", + "matej novotny", + "matej scislak" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0475", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Daniil Huzenko, Tetiana Mohorian, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2025. Koľko ich je?", + "latency_seconds": 0.032192, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2", + "2025" + ], + "matched_values": [ + "Daniil Huzenko", + "Tetiana Mohorian", + "2", + "2025" + ], + "expected_entities": [ + { + "type": "person", + "value": "Daniil Huzenko" + }, + { + "type": "person", + "value": "Tetiana Mohorian" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Daniil Huzenko" + }, + { + "type": "person", + "value": "Tetiana Mohorian" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [ + "daniil huzenko", + "tetiana mohorian" + ], + "entity_set_actual": [ + "daniil huzenko", + "tetiana mohorian" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0476", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko zdieľajú rok práce 2021? Uveď aj ich počet.", + "latency_seconds": 0.031572, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "3", + "2021" + ], + "matched_values": [ + "Jakub Maruniak", + "Ján Holp", + "Maroš Harahus", + "3", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Jakub Maruniak" + }, + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "person", + "value": "Maroš Harahus" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md", + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp", + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_actual": [ + "jakub maruniak", + "jan holp", + "maros harahus" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0477", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko zdieľajú rok práce 2022? Uveď aj ich počet.", + "latency_seconds": 0.031041, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "matched_values": [ + "Artem Yatsenko", + "Dominik Nagy", + "Kristián Sopkovič", + "3", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Artem Yatsenko" + }, + { + "type": "person", + "value": "Dominik Nagy" + }, + { + "type": "person", + "value": "Kristián Sopkovič" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md", + "pages/students/2022/daniil_huzenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic", + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko" + ], + "entity_set_expected": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_actual": [ + "artem yatsenko", + "dominik nagy", + "kristian sopkovic" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0480", + "split": "dev", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Ondrej Megela, Patrik Pavlišin, Artem Yatsenko zdieľajú rok práce 2020? Uveď aj ich počet.", + "latency_seconds": 0.03146, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "matched_values": [ + "Ondrej Megela", + "Patrik Pavlišin", + "2", + "2020" + ], + "expected_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Ondrej Megela" + }, + { + "type": "person", + "value": "Patrik Pavlišin" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/patrik_pavlisin/README.md", + "pages/students/2018/ondrej_megela/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin", + "https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_actual": [ + "ondrej megela", + "patrik pavlisin" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0484", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Ján Pták a Matej Novotný spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo OpenWebUI a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.027179, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Pták", + "OpenWebUI", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Ján Pták" + }, + { + "type": "keyword", + "value": "OpenWebUI" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "actual_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "matched_documents": [ + "pages/students/2021/matej_novotny/README.md", + "pages/students/2022/jan_ptak/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0485", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Elasticsearch a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.02593, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "Elasticsearch", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Michal Stromko" + }, + { + "type": "keyword", + "value": "Elasticsearch" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0486", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo LLM a jej práca je uvedená v roku 2025?", + "latency_seconds": 0.033938, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "LLM", + "2025" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Tetiana Mohorian" + }, + { + "type": "keyword", + "value": "LLM" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0488", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo FAISS a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.02822, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Michal Stromko", + "FAISS", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Michal Stromko" + }, + { + "type": "keyword", + "value": "FAISS" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/michal_stromko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0490", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo prompting a jej práca je uvedená v roku 2025?", + "latency_seconds": 0.027184, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Tetiana Mohorian", + "prompting", + "2025" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Tetiana Mohorian" + }, + { + "type": "keyword", + "value": "prompting" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "actual_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "matched_documents": [ + "pages/students/2022/daniil_huzenko/README.md", + "pages/students/2022/tetiana_mohorian/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko", + "https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0492", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Yevhenii Medushivskyi a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo webový korpus a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.026557, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Yevhenii Medushivskyi", + "webový korpus", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Yevhenii Medushivskyi" + }, + { + "type": "keyword", + "value": "webový korpus" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/yevhenii_medushivskyi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0493", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Simona Bobrovčanová a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo právne dokumenty a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.026611, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Simona Bobrovčanová", + "právne dokumenty", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Simona Bobrovčanová" + }, + { + "type": "keyword", + "value": "právne dokumenty" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_ptak/README.md", + "pages/students/2023/simona_bobrovcanova/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak", + "https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0495", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Kristián Sopkovič a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenčina a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.025809, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "slovenčina", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Kristián Sopkovič" + }, + { + "type": "keyword", + "value": "slovenčina" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2019/artem_yatsenko/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0498", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Maroš Harahus a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2021?", + "latency_seconds": 0.03328, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maroš Harahus", + "Spacy", + "2021" + ], + "matched_values": [ + "Maroš Harahus", + "Spacy", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Maroš Harahus" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Maroš Harahus" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "actual_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "matched_documents": [ + "pages/students/2016/maros_harahus/README.md", + "pages/students/2019/artem_yatsenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus", + "https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0499", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Ján Holp a Jakub Maruniak spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenský internet a jej práca je uvedená v roku 2021?", + "latency_seconds": 0.02629, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Holp", + "slovenský internet", + "2021" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Ján Holp" + }, + { + "type": "keyword", + "value": "slovenský internet" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "actual_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "matched_documents": [ + "pages/students/2016/jakub_maruniak/README.md", + "pages/students/2016/jan_holp/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak", + "https://zp.kemt.fei.tuke.sk/students/2016/jan_holp" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0500", + "split": "dev", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Kristián Sopkovič a Dominik Nagy spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.034901, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Kristián Sopkovič", + "Spacy", + "2022" + ], + "matched_values": [ + "Kristián Sopkovič", + "Spacy", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Kristián Sopkovič" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Kristián Sopkovič" + }, + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "actual_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "matched_documents": [ + "pages/students/2016/dominik_nagy/README.md", + "pages/students/2019/kristian_sopkovic/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy", + "https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + } + ], + "source_consistent_summary": { + "questions": 209, + "strict_count": 209, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.033557, + "latency_median_seconds": 0.033169, + "latency_p95_seconds": 0.041472 + }, + "source_consistent_by_category": { + "candidate_set_aggregation": { + "questions": 9, + "strict_count": 9, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032839, + "latency_median_seconds": 0.03287, + "latency_p95_seconds": 0.034765 + }, + "conjunctive_disambiguation": { + "questions": 2, + "strict_count": 2, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.03409, + "latency_median_seconds": 0.03409, + "latency_p95_seconds": 0.03482 + }, + "document_author_category_multi_hop": { + "questions": 35, + "strict_count": 35, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.03659, + "latency_median_seconds": 0.035975, + "latency_p95_seconds": 0.041904 + }, + "person_keyword_title": { + "questions": 4, + "strict_count": 4, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.046585, + "latency_median_seconds": 0.044976, + "latency_p95_seconds": 0.052408 + }, + "person_multiple_categories": { + "questions": 15, + "strict_count": 15, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.02803, + "latency_median_seconds": 0.027458, + "latency_p95_seconds": 0.030693 + }, + "person_title_year": { + "questions": 44, + "strict_count": 44, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.033826, + "latency_median_seconds": 0.03231, + "latency_p95_seconds": 0.039743 + }, + "same_academic_year_pair": { + "questions": 56, + "strict_count": 56, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.035307, + "latency_median_seconds": 0.03434, + "latency_p95_seconds": 0.040805 + }, + "same_start_year_pair": { + "questions": 28, + "strict_count": 28, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.028555, + "latency_median_seconds": 0.02798, + "latency_p95_seconds": 0.03114 + }, + "shared_keyword_pair": { + "questions": 16, + "strict_count": 16, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.031068, + "latency_median_seconds": 0.029838, + "latency_p95_seconds": 0.03592 + } + }, + "source_inconsistent_ids": [ + "g0013", + "g0014", + "g0015", + "g0016", + "g0017", + "g0018", + "g0019", + "g0020", + "g0021", + "g0022", + "g0023", + "g0024", + "g0025", + "g0026", + "g0027", + "g0028", + "g0031", + "g0032", + "g0035", + "g0036", + "g0037", + "g0038", + "g0049", + "g0050", + "g0296", + "g0297", + "g0298", + "g0299", + "g0300", + "g0301", + "g0302", + "g0303", + "g0304", + "g0305", + "g0309", + "g0314", + "g0316", + "g0319", + "g0322", + "g0323", + "g0324", + "g0327", + "g0328", + "g0329", + "g0330", + "g0331", + "g0333", + "g0336", + "g0337", + "g0340", + "g0341", + "g0343", + "g0344", + "g0347", + "g0348", + "g0349", + "g0353", + "g0359", + "g0361", + "g0364", + "g0366", + "g0368", + "g0438", + "g0439", + "g0447", + "g0449", + "g0457", + "g0458", + "g0484", + "g0485", + "g0486", + "g0488", + "g0490", + "g0492", + "g0493", + "g0495", + "g0499" + ] +} diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.csv b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.csv new file mode 100644 index 0000000..6dc0eaf --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.csv @@ -0,0 +1,215 @@ +complete,count_ok,expected_count,actual_count,id,split,category,difficulty,strict,value_score,entity_score,relation_score,property_score,relation_choice_score,document_recall,source_recall,entity_set_ok,latency_seconds,error,question,expected_values,matched_values,expected_relations,actual_relations,expected_documents,actual_documents,expected_source_urls,actual_source_urls,fact_types,strategies +True,True,,,g0029,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.02863,,Sú osoby Alina Vitko a Ronald Zalacko v ZP Wiki prepojené cez kľúčové slovo Docker? Uveď spoločné kľúčové slovo.,"[""Alina Vitko"", ""Ronald Zalacko"", ""Docker""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]" +True,True,,,g0030,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025681,,Over prepojenie osôb Alina Vitko a Ronald Zalacko cez kľúčové slovo Docker a pomenuj spoločné kľúčové slovo.,"[""Alina Vitko"", ""Ronald Zalacko"", ""Docker""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]" +True,True,,,g0033,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028839,,Sú osoby Martin Šarišský a Oleksandr Dorybohov v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""agent""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]",[],"[""entity_resolution""]" +True,True,,,g0034,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027412,,Over prepojenie osôb Martin Šarišský a Oleksandr Dorybohov cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""agent""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]",[],"[""entity_resolution""]" +True,True,,,g0039,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029397,,Sú osoby Andrii Pervashov a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo OpenWebUI? Uveď spoločné kľúčové slovo.,"[""Andrii Pervashov"", ""Samuel Vasiľ"", ""OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]" +True,True,,,g0040,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025237,,Over prepojenie osôb Andrii Pervashov a Samuel Vasiľ cez kľúčové slovo OpenWebUI a pomenuj spoločné kľúčové slovo.,"[""Andrii Pervashov"", ""Samuel Vasiľ"", ""OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]" +True,True,,,g0043,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025173,,Sú osoby Oleh Poiasnik a Ján Malinovský v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Ján Malinovský"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]" +True,True,,,g0044,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.026392,,Over prepojenie osôb Oleh Poiasnik a Ján Malinovský cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Ján Malinovský"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]" +True,True,,,g0045,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025938,,Sú osoby Oleh Poiasnik a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]" +True,True,,,g0046,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.0252,,Over prepojenie osôb Oleh Poiasnik a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]" +True,True,,,g0047,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.026373,,Sú osoby Ján Malinovský a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]" +True,True,,,g0048,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025873,,Over prepojenie osôb Ján Malinovský a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]" +True,True,,,g0051,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027964,,Sú osoby Ján Malinovský a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""RAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]" +True,True,,,g0052,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028319,,Over prepojenie osôb Ján Malinovský a Samuel Vasiľ cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""RAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]" +True,True,,,g0055,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033795,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Ronald Zalacko?,"[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]","[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0056,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032272,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Samuel Vasiľ?,"[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]","[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0057,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032439,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Filip Tomáš a Márk Fehér?,"[""Filip Tomáš"", ""Márk Fehér"", ""2022""]","[""Filip Tomáš"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0059,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031066,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0061,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033916,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dárius Lindvai a Lukáš Pokrývka?,"[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0062,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036186,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0065,test,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.034872,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Martin Šarišský?,"[""Ján Malinovský"", ""Martin Šarišský"", ""2026""]","[""Ján Malinovský"", ""Martin Šarišský""]",[],[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""academic_year_comparison""]","[""entity_resolution""]" +True,True,,,g0067,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032398,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ronald Zalacko a Samuel Vasiľ?,"[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]","[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0069,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.0308,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Márk Fehér?,"[""Alina Vitko"", ""Márk Fehér"", ""2022""]","[""Alina Vitko"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0070,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030749,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Oleksandr Dorybohov?,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]","[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0073,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033775,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Samuel Vasiľ?,"[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]","[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0077,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032121,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Oleksandr Dorybohov?,"[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]","[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0080,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03028,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0082,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029731,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Samuel Vasiľ?,"[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]","[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0083,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031184,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0085,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030696,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0090,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030473,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Maksym Zatirka?,"[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]","[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0094,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030979,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ronald Zalacko?,"[""Denis Le Thanh"", ""Ronald Zalacko"", ""2026""]","[""Denis Le Thanh"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0096,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032781,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Filip Tomáš?,"[""Alina Vitko"", ""Filip Tomáš"", ""2022""]","[""Alina Vitko"", ""Filip Tomáš"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0101,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031393,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ján Malinovský?,"[""Denis Le Thanh"", ""Ján Malinovský"", ""2026""]","[""Denis Le Thanh"", ""Ján Malinovský"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0102,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031656,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Martin Šarišský?,"[""Maksym Zatirka"", ""Martin Šarišský"", ""2026""]","[""Maksym Zatirka"", ""Martin Šarišský"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0103,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031534,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Andrii Pervashov a Oleh Poiasnik?,"[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2027""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2027""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0106,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030663,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Samuel Vasiľ?,"[""Denis Le Thanh"", ""Samuel Vasiľ"", ""2026""]","[""Denis Le Thanh"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0109,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031207,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Oleksandr Dorybohov?,"[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2026""]","[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0112,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030988,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dmytro Ushatenko a Martin Wencel?,"[""Dmytro Ushatenko"", ""Martin Wencel"", ""2020""]","[""Dmytro Ushatenko"", ""Martin Wencel"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0113,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030088,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Ronald Zalacko?,"[""Ján Malinovský"", ""Ronald Zalacko"", ""2026""]","[""Ján Malinovský"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0117,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03159,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Martin Šarišský?,"[""Denis Le Thanh"", ""Martin Šarišský"", ""2026""]","[""Denis Le Thanh"", ""Martin Šarišský"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0119,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03127,,Aký rok práce spája osoby Martin Šarišský a Ronald Zalacko?,"[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]","[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0120,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030895,,Aký rok práce spája osoby Maksym Zatirka a Samuel Vasiľ?,"[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]","[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0121,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032381,,Aký rok práce spája osoby Filip Tomáš a Márk Fehér?,"[""Filip Tomáš"", ""Márk Fehér"", ""2022""]","[""Filip Tomáš"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0123,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030853,,Aký rok práce spája osoby Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0125,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032875,,Aký rok práce spája osoby Dárius Lindvai a Lukáš Pokrývka?,"[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0126,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03045,,Aký rok práce spája osoby Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0129,test,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.032707,,Aký rok práce spája osoby Ján Malinovský a Martin Šarišský?,"[""Ján Malinovský"", ""Martin Šarišský"", ""2026""]","[""Ján Malinovský"", ""Martin Šarišský""]",[],[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""academic_year_comparison""]","[""entity_resolution""]" +True,True,,,g0131,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.0308,,Aký rok práce spája osoby Ronald Zalacko a Samuel Vasiľ?,"[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]","[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0133,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034011,,Aký rok práce spája osoby Alina Vitko a Márk Fehér?,"[""Alina Vitko"", ""Márk Fehér"", ""2022""]","[""Alina Vitko"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0134,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030999,,Aký rok práce spája osoby Martin Šarišský a Oleksandr Dorybohov?,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]","[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0137,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030742,,Aký rok práce spája osoby Martin Šarišský a Samuel Vasiľ?,"[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]","[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0141,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030214,,Aký rok práce spája osoby Ján Malinovský a Oleksandr Dorybohov?,"[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]","[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0144,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030026,,Aký rok práce spája osoby Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0146,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030005,,Aký rok práce spája osoby Oleksandr Dorybohov a Samuel Vasiľ?,"[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]","[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0147,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030108,,Aký rok práce spája osoby Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0149,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029898,,Aký rok práce spája osoby Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0154,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031309,,Aký rok práce spája osoby Ján Malinovský a Maksym Zatirka?,"[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]","[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0157,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028997,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Ronald Zalacko?,"[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]","[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0158,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028138,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Oleh Poiasnik?,"[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]","[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0159,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02848,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleh Poiasnik a Samuel Vasiľ?,"[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]","[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0161,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027429,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0166,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032411,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Vladyslav Yanchenko?,"[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]","[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0169,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.051023,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleh Poiasnik a Vladyslav Yanchenko?,"[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]","[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0170,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02952,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0171,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028049,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0173,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028715,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0175,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027294,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0176,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027561,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Oleksandr Dorybohov?,"[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]","[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0178,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027137,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Oleh Poiasnik?,"[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0179,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027344,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Vladyslav Yanchenko?,"[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]","[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0180,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02776,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Vasiľ a Vladyslav Yanchenko?,"[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]","[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0181,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028278,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Ján Malinovský?,"[""Andrii Pervashov"", ""Ján Malinovský"", ""2022""]","[""Andrii Pervashov"", ""Ján Malinovský"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0183,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029056,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Dárius Lindvai a Lukáš Pokrývka?,"[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2016""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2016""]",[],[],"[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0184,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027888,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Eduard Matovka a Martin Šarišský?,"[""Eduard Matovka"", ""Martin Šarišský"", ""2021""]","[""Eduard Matovka"", ""Martin Šarišský"", ""2021""]",[],[],"[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0187,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02739,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Samuel Vasiľ?,"[""Andrii Pervashov"", ""Samuel Vasiľ"", ""2022""]","[""Andrii Pervashov"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0191,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027939,,Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Ronald Zalacko?,"[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]","[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0192,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027064,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Oleh Poiasnik?,"[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]","[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0193,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027957,,Cez ktorý rok začiatku štúdia sú prepojené osoby Oleh Poiasnik a Samuel Vasiľ?,"[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]","[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0195,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027162,,Cez ktorý rok začiatku štúdia sú prepojené osoby Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0200,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026257,,Cez ktorý rok začiatku štúdia sú prepojené osoby Andrii Pervashov a Vladyslav Yanchenko?,"[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]","[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0203,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026844,,Cez ktorý rok začiatku štúdia sú prepojené osoby Oleh Poiasnik a Vladyslav Yanchenko?,"[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]","[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0204,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02753,,Cez ktorý rok začiatku štúdia sú prepojené osoby Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0205,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028417,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0207,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026652,,Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0209,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026911,,Cez ktorý rok začiatku štúdia sú prepojené osoby Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0210,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026253,,Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Oleksandr Dorybohov?,"[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]","[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0212,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026634,,Cez ktorý rok začiatku štúdia sú prepojené osoby Andrii Pervashov a Oleh Poiasnik?,"[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0213,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026713,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Vladyslav Yanchenko?,"[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]","[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0214,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026558,,Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Vasiľ a Vladyslav Yanchenko?,"[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]","[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]" +True,True,,,g0215,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031693,,Aký názov práce a aký rok práce sú uvedené pri osobe Alina Vitko?,"[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0216,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031474,,"Prepoj osobu Alina Vitko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0217,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033513,,Aký názov práce a aký rok práce sú uvedené pri osobe Andrii Pervashov?,"[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0218,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032751,,"Prepoj osobu Andrii Pervashov s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0223,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031669,,Aký názov práce a aký rok práce sú uvedené pri osobe Denis Le Thanh?,"[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0224,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031798,,"Prepoj osobu Denis Le Thanh s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0225,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030322,,Aký názov práce a aký rok práce sú uvedené pri osobe Dmytro Ushatenko?,"[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0226,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030611,,"Prepoj osobu Dmytro Ushatenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0229,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031376,,Aký názov práce a aký rok práce sú uvedené pri osobe Dárius Lindvai?,"[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0230,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033436,,"Prepoj osobu Dárius Lindvai s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0233,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031967,,Aký názov práce a aký rok práce sú uvedené pri osobe Eduard Matovka?,"[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0234,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031886,,"Prepoj osobu Eduard Matovka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0235,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032539,,Aký názov práce a aký rok práce sú uvedené pri osobe Filip Tomáš?,"[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0236,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03197,,"Prepoj osobu Filip Tomáš s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0241,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030517,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Malinovský?,"[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]" +True,True,,,g0242,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032665,,"Prepoj osobu Ján Malinovský s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]" +True,True,,,g0247,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033034,,Aký názov práce a aký rok práce sú uvedené pri osobe Lukáš Pokrývka?,"[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0248,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031437,,"Prepoj osobu Lukáš Pokrývka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0249,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031002,,Aký názov práce a aký rok práce sú uvedené pri osobe Maksym Zatirka?,"[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0250,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03164,,"Prepoj osobu Maksym Zatirka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0253,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03014,,Aký názov práce a aký rok práce sú uvedené pri osobe Martin Wencel?,"[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0254,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03106,,"Prepoj osobu Martin Wencel s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0255,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031488,,Aký názov práce a aký rok práce sú uvedené pri osobe Martin Šarišský?,"[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0256,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033026,,"Prepoj osobu Martin Šarišský s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0263,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032823,,Aký názov práce a aký rok práce sú uvedené pri osobe Márk Fehér?,"[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0264,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036111,,"Prepoj osobu Márk Fehér s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,,,g0265,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041553,,Aký názov práce a aký rok práce sú uvedené pri osobe Oleh Poiasnik?,"[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0266,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035405,,"Prepoj osobu Oleh Poiasnik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0267,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032375,,Aký názov práce a aký rok práce sú uvedené pri osobe Oleksandr Dorybohov?,"[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0268,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030871,,"Prepoj osobu Oleksandr Dorybohov s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0273,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03133,,Aký názov práce a aký rok práce sú uvedené pri osobe Ronald Zalacko?,"[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0274,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029625,,"Prepoj osobu Ronald Zalacko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0279,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030054,,Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Vasiľ?,"[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0280,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033345,,"Prepoj osobu Samuel Vasiľ s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0291,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029265,,Aký názov práce a aký rok práce sú uvedené pri osobe Vladyslav Yanchenko?,"[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0292,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030024,,"Prepoj osobu Vladyslav Yanchenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0295,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032062,,"Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo cloud?","[""Vladyslav Yanchenko"", ""cloud"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]",[],"[""entity_resolution""]" +True,True,,,g0306,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02586,,"Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo inštrukcie?","[""Denis Le Thanh"", ""inštrukcie"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]" +True,True,,,g0307,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02625,,"Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo právne informácie?","[""Martin Šarišský"", ""právne informácie"", ""Agentové systémy pomocou veľkého jazykového modelu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]",[],"[""entity_resolution""]" +True,True,,,g0308,test,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031762,,"Aký je názov práce osoby Ján Malinovský, ak jej dokument zároveň obsahuje kľúčové slovo RAG?","[""Ján Malinovský"", ""RAG"", ""Grafové vyhľadávanie pre podporu vzdelávania""]","[""Ján Malinovský"", ""RAG"", ""Grafové vyhľadávanie pre podporu vzdelávania""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_keyword"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints"", ""person_keyword_constraints""]" +True,True,,,g0310,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02632,,"Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo SlovakAlpaca?","[""Eduard Matovka"", ""SlovakAlpaca"", ""Slovenská konverzačná umelá inteligencia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]",[],"[""entity_resolution""]" +True,True,,,g0311,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025225,,"Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo BiLSTM?","[""Dárius Lindvai"", ""BiLSTM"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]",[],"[""entity_resolution""]" +True,True,,,g0312,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025966,,"Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo NCCL?","[""Lukáš Pokrývka"", ""NCCL"", ""Paralelné trénovanie neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]",[],"[""entity_resolution""]" +True,True,,,g0313,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025838,,"Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo Docker?","[""Ronald Zalacko"", ""Docker"", ""Skórovací online systém pre robotické súťaže""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]" +True,True,,,g0315,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.033392,,"Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo RAG?","[""Samuel Vasiľ"", ""RAG"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]" +True,True,,,g0317,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025363,,"Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo lekáreň?","[""Oleh Poiasnik"", ""lekáreň"", ""Expertný agentový systém na podporu rozhodovania v lekárni""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]" +True,True,,,g0318,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03166,,"Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo chatbot?","[""Dmytro Ushatenko"", ""chatbot"", ""Jednoduchý chatbot v jazyku Python""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]",[],"[""entity_resolution""]" +True,True,,,g0320,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030603,,"Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo Python?","[""Dmytro Ushatenko"", ""Python"", ""Jednoduchý chatbot v jazyku Python""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]",[],"[""entity_resolution""]" +True,True,,,g0321,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.024745,,"Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo morfologická analýza?","[""Martin Wencel"", ""morfologická analýza"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]",[],"[""entity_resolution""]" +True,True,,,g0325,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025801,,"Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo speech-to-text?","[""Andrii Pervashov"", ""speech-to-text"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]",[],"[""entity_resolution""]" +True,True,,,g0326,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026016,,"Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo robotické súťaže?","[""Ronald Zalacko"", ""robotické súťaže"", ""Skórovací online systém pre robotické súťaže""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]" +True,True,,,g0332,test,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043224,,"Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?","[""Martin Wencel"", ""Spacy"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy""]","[""Martin Wencel"", ""Spacy"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]" +True,True,,,g0334,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025889,,"Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo CI/CD?","[""Filip Tomáš"", ""CI/CD"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]",[],"[""entity_resolution""]" +True,True,,,g0335,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026231,,"Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo slovenský jazykový model?","[""Eduard Matovka"", ""slovenský jazykový model"", ""Slovenská konverzačná umelá inteligencia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]",[],"[""entity_resolution""]" +True,True,,,g0338,test,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031166,,"Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo agent?","[""Oleksandr Dorybohov"", ""agent"", ""Automatické odpovede na otázky v právnej oblasti""]","[""Oleksandr Dorybohov"", ""agent"", ""Automatické odpovede na otázky v právnej oblasti""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]" +True,True,,,g0339,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02561,,"Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo MCP?","[""Samuel Vasiľ"", ""MCP"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]" +True,True,,,g0342,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.033742,,"Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo agent?","[""Martin Šarišský"", ""agent"", ""Agentové systémy pomocou veľkého jazykového modelu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]",[],"[""entity_resolution""]" +True,True,,,g0350,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032128,,"Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo PyTorch?","[""Lukáš Pokrývka"", ""PyTorch"", ""Paralelné trénovanie neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]",[],"[""entity_resolution""]" +True,True,,,g0351,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025346,,"Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo Docker Compose?","[""Filip Tomáš"", ""Docker Compose"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]",[],"[""entity_resolution""]" +True,True,,,g0352,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025389,,"Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Streamlit?","[""Alina Vitko"", ""Streamlit"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]",[],"[""entity_resolution""]" +True,True,,,g0356,test,person_keyword_title,hard,False,1.0,0.5,1.0,1.0,1.0,1.0,1.0,True,0.033839,,"Aký je názov práce osoby Márk Fehér, ak jej dokument zároveň obsahuje kľúčové slovo klasifikácia textu?","[""Márk Fehér"", ""klasifikácia textu"", ""Klasifikácia textu metódami strojového učenia""]","[""Márk Fehér"", ""klasifikácia textu"", ""Klasifikácia textu metódami strojového učenia""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]" +True,True,,,g0357,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025957,,"Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo Slovak Mistral?","[""Denis Le Thanh"", ""Slovak Mistral"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]" +True,True,,,g0358,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025629,,"Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo kyberbezpečnosť?","[""Denis Le Thanh"", ""kyberbezpečnosť"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]" +True,True,,,g0360,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025783,,"Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo slovenské právo?","[""Maksym Zatirka"", ""slovenské právo"", ""Grafová databáza pre podporu generovania slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]" +True,True,,,g0362,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.031582,,"Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Question Answering?","[""Alina Vitko"", ""Question Answering"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]",[],"[""entity_resolution""]" +True,True,,,g0363,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025125,,"Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo LightRAG?","[""Oleh Poiasnik"", ""LightRAG"", ""Expertný agentový systém na podporu rozhodovania v lekárni""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]" +True,True,,,g0365,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025655,,"Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?","[""Andrii Pervashov"", ""OpenWebUI"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]",[],"[""entity_resolution""]" +True,True,,,g0367,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026591,,"Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo grafová databáza?","[""Maksym Zatirka"", ""grafová databáza"", ""Grafová databáza pre podporu generovania slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]" +True,True,,,g0369,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025261,,"Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo API?","[""Oleksandr Dorybohov"", ""API"", ""Automatické odpovede na otázky v právnej oblasti""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]",[],"[""entity_resolution""]" +True,True,,,g0370,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02565,,"Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?","[""Samuel Vasiľ"", ""OpenWebUI"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]" +True,True,,,g0371,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025979,,"Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo Azure?","[""Vladyslav Yanchenko"", ""Azure"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]",[],"[""entity_resolution""]" +True,True,,,g0372,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027264,,"Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo dialógový systém?","[""Dmytro Ushatenko"", ""dialógový systém"", ""Jednoduchý chatbot v jazyku Python""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]",[],"[""entity_resolution""]" +True,True,,,g0373,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027055,,"Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo CRF?","[""Dárius Lindvai"", ""CRF"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]",[],"[""entity_resolution""]" +True,True,,,g0374,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025773,,"Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo DeepEval?","[""Martin Šarišský"", ""DeepEval"", ""Agentové systémy pomocou veľkého jazykového modelu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]",[],"[""entity_resolution""]" +True,True,,,g0377,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028582,,Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou dp2027?,"[""Daniel Hladek"", ""dp2027"", ""Oleh Poiasnik""]","[""Daniel Hladek"", ""dp2027"", ""Oleh Poiasnik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0378,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027959,,Ktorý autor dokumentu je pri osobe Andrii Pervashov spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Andrii Pervashov""]","[""Daniel Hladek"", ""bp2025"", ""Andrii Pervashov""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0383,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028748,,Ktorý autor dokumentu je pri osobe Alina Vitko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Alina Vitko""]","[""Daniel Hladek"", ""bp2022"", ""Alina Vitko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0384,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02859,,Ktorý autor dokumentu je pri osobe Ján Malinovský spojený s kategóriou dp2027?,"[""Daniel Hladek"", ""dp2027"", ""Ján Malinovský""]","[""Daniel Hladek"", ""dp2027"", ""Ján Malinovský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0391,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027715,,Ktorý autor dokumentu je pri osobe Samuel Vasiľ spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Samuel Vasiľ""]","[""Daniel Hladek"", ""bp2026"", ""Samuel Vasiľ""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0395,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027904,,Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Lukáš Pokrývka""]","[""Daniel Hladek"", ""bp2019"", ""Lukáš Pokrývka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0399,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028353,,Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Filip Tomáš""]","[""Daniel Hladek"", ""dp2024"", ""Filip Tomáš""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0401,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028499,,Ktorý autor dokumentu je pri osobe Ronald Zalacko spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Ronald Zalacko""]","[""Daniel Hladek"", ""bp2026"", ""Ronald Zalacko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0402,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028636,,Ktorý autor dokumentu je pri osobe Martin Wencel spojený s kategóriou bp2021?,"[""Daniel Hladek"", ""bp2021"", ""Martin Wencel""]","[""Daniel Hladek"", ""bp2021"", ""Martin Wencel""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0403,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027674,,Ktorý autor dokumentu je pri osobe Eduard Matovka spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Eduard Matovka""]","[""Daniel Hladek"", ""bp2024"", ""Eduard Matovka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0404,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029116,,Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2025?,"[""Daniel Hladek"", ""dp2025"", ""Filip Tomáš""]","[""Daniel Hladek"", ""dp2025"", ""Filip Tomáš""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0406,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02892,,Ktorý autor dokumentu je pri osobe Márk Fehér spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Márk Fehér""]","[""Daniel Hladek"", ""dp2022"", ""Márk Fehér""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0409,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02801,,Ktorý autor dokumentu je pri osobe Oleksandr Dorybohov spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Oleksandr Dorybohov""]","[""Daniel Hladek"", ""bp2026"", ""Oleksandr Dorybohov""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0413,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027263,,Ktorý autor dokumentu je pri osobe Dmytro Ushatenko spojený s kategóriou bp2020?,"[""Daniel Hladek"", ""bp2020"", ""Dmytro Ushatenko""]","[""Daniel Hladek"", ""bp2020"", ""Dmytro Ushatenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0414,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028031,,Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou vp2023?,"[""Daniel Hladek"", ""vp2023"", ""Martin Šarišský""]","[""Daniel Hladek"", ""vp2023"", ""Martin Šarišský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0418,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028608,,Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Filip Tomáš""]","[""Daniel Hladek"", ""bp2022"", ""Filip Tomáš""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0419,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028126,,Ktorý autor dokumentu je pri osobe Dárius Lindvai spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Dárius Lindvai""]","[""Daniel Hladek"", ""bp2019"", ""Dárius Lindvai""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0421,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029637,,Ktorý autor dokumentu je pri osobe Youssef Ressaissi spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Youssef Ressaissi""]","[""Daniel Hladek"", ""iaeste"", ""Youssef Ressaissi""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0423,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030141,,Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Lukáš Pokrývka""]","[""Daniel Hladek"", ""dp2021"", ""Lukáš Pokrývka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0428,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028402,,Ktorý autor dokumentu je pri osobe Vladyslav Yanchenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Vladyslav Yanchenko""]","[""Daniel Hladek"", ""bp2025"", ""Vladyslav Yanchenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0429,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028121,,Ktorý autor dokumentu je pri osobe Maksym Zatirka spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Maksym Zatirka""]","[""Daniel Hladek"", ""bp2026"", ""Maksym Zatirka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0430,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027976,,Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Martin Šarišský""]","[""Daniel Hladek"", ""bp2024"", ""Martin Šarišský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0431,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028124,,Ktorý autor dokumentu je pri osobe Sevval Bulburu spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Sevval Bulburu""]","[""Daniel Hladek"", ""iaeste"", ""Sevval Bulburu""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0432,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028059,,Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou dp2026?,"[""Daniel Hladek"", ""dp2026"", ""Martin Šarišský""]","[""Daniel Hladek"", ""dp2026"", ""Martin Šarišský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0434,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028602,,Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Oleh Poiasnik""]","[""Daniel Hladek"", ""bp2025"", ""Oleh Poiasnik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]" +True,True,,,g0437,test,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.031754,,V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?,"[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0441,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03159,,V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?,"[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0444,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026818,,V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?,"[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0446,test,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.026562,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dárius Lindvai?,"[""Dárius Lindvai"", ""bp2019"", ""dp2021""]","[""Dárius Lindvai"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0448,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026852,,V ktorých kategóriách sa nachádzajú dokumenty osoby Andrii Pervashov?,"[""Andrii Pervashov"", ""bp2025"", ""dp2027""]","[""Andrii Pervashov"", ""bp2025"", ""dp2027""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0451,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02694,,V ktorých kategóriách sa nachádzajú dokumenty osoby Martin Šarišský?,"[""Martin Šarišský"", ""bp2024"", ""dp2026"", ""vp2023""]","[""Martin Šarišský"", ""bp2024"", ""dp2026"", ""vp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0456,test,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.02701,,V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?,"[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0460,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027796,,V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?,"[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,,,g0463,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026692,,V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?,"[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]" +True,True,2,2,g0467,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031457,,"Z kandidátov Dárius Lindvai, Lukáš Pokrývka, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,3,3,g0468,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031701,,"Z kandidátov Alina Vitko, Filip Tomáš, Márk Fehér, Andrii Pervashov vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,2,2,g0470,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031747,,"Z kandidátov Dmytro Ushatenko, Martin Wencel, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?","[""Dmytro Ushatenko"", ""Martin Wencel"", ""2"", ""2020""]","[""Dmytro Ushatenko"", ""Martin Wencel"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,3,3,g0472,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031927,,"Z kandidátov Denis Le Thanh, Ján Malinovský, Maksym Zatirka, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?","[""Denis Le Thanh"", ""Ján Malinovský"", ""Maksym Zatirka"", ""3"", ""2026""]","[""Denis Le Thanh"", ""Ján Malinovský"", ""Maksym Zatirka"", ""3"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]" +True,True,2,2,g0474,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031857,,"Z kandidátov Andrii Pervashov, Oleh Poiasnik, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2027. Koľko ich je?","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2"", ""2027""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2"", ""2027""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,2,2,g0478,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032573,,"Ktoré osoby zo zoznamu Dárius Lindvai, Lukáš Pokrývka, Alina Vitko zdieľajú rok práce 2021? Uveď aj ich počet.","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,3,3,g0479,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031797,,"Ktoré osoby zo zoznamu Alina Vitko, Filip Tomáš, Márk Fehér, Andrii Pervashov zdieľajú rok práce 2022? Uveď aj ich počet.","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]" +True,True,,,g0481,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026888,,Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo inštrukcie a jej práca je uvedená v roku 2026?,"[""Denis Le Thanh"", ""inštrukcie"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]" +True,True,,,g0482,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026786,,Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Slovak Mistral a jej práca je uvedená v roku 2026?,"[""Denis Le Thanh"", ""Slovak Mistral"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]" +True,True,,,g0483,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026187,,Ktorá z osôb Oleh Poiasnik a Andrii Pervashov spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo znalostný graf a jej práca je uvedená v roku 2027?,"[""Oleh Poiasnik"", ""znalostný graf"", ""2027""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]" +True,True,,,g0487,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026325,,Ktorá z osôb Martin Wencel a Dmytro Ushatenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo pomenované entity a jej práca je uvedená v roku 2020?,"[""Martin Wencel"", ""pomenované entity"", ""2020""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]",[],"[""entity_resolution""]" +True,True,,,g0489,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026418,,Ktorá z osôb Dárius Lindvai a Lukáš Pokrývka spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo CRF a jej práca je uvedená v roku 2021?,"[""Dárius Lindvai"", ""CRF"", ""2021""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]",[],"[""entity_resolution""]" +True,True,,,g0491,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02581,,Ktorá z osôb Alina Vitko a Filip Tomáš spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Streamlit a jej práca je uvedená v roku 2022?,"[""Alina Vitko"", ""Streamlit"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]",[],"[""entity_resolution""]" +True,True,,,g0494,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.032847,,Ktorá z osôb Dmytro Ushatenko a Martin Wencel spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo chatbot a jej práca je uvedená v roku 2020?,"[""Dmytro Ushatenko"", ""chatbot"", ""2020""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]",[],"[""entity_resolution""]" +True,True,,,g0496,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026247,,Ktorá z osôb Andrii Pervashov a Oleh Poiasnik spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo speech-to-text a jej práca je uvedená v roku 2027?,"[""Andrii Pervashov"", ""speech-to-text"", ""2027""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]" +True,True,,,g0497,test,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032802,,Ktorá z osôb Lukáš Pokrývka a Dárius Lindvai spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo GPU a jej práca je uvedená v roku 2021?,"[""Lukáš Pokrývka"", ""GPU"", ""2021""]","[""Lukáš Pokrývka"", ""GPU"", ""2021""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]" diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.json b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.json new file mode 100644 index 0000000..b6cfbad --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.json @@ -0,0 +1,21155 @@ +{ + "evaluation_schema_version": 3, + "run_metadata": { + "started_at_utc": "2026-10-24T19:03:20.819107+00:00", + "python": "3.10.12", + "git_head": "9f3483d29017bee0d93ed4c225c9952c024d0029", + "wiki_git_head": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e", + "fingerprints": { + "implementation": { + "tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5", + "tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80", + "tools/graphrag/evaluation/evaluate_graphrag.py": "6bdf68307b6bb90731fe09a89955e96eee76fec13bdf82281a96715dd168680e", + "tools/graphrag/evaluation/freeze_graphrag.py": "32198eca7642f39a8ad33deefe0eea396d38fcc0f5bc5814cbb64ab6d3443b9e", + "tools/graphrag/evaluation/graphrag_evaluator.py": "267d4e9942b7767a78a3689e8f7c9d6ed49f025389b043b69449b2d225651160", + "tools/graphrag/evaluation/reproducibility.py": "5c28d8aa37ec6a973fa494f7e528c19af2f1326422ea7fd05912e01aa1af6725", + "tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2", + "tools/graphrag/graph_search.py": "20f466e8d9eef6a38e41860e9be9ebc719c93f38bcfa6f60aca0e1b56c7d6bca", + "tools/graphrag/graphrag.py": "bee2eb1f86d8df8e978495a61107edf723df2dc2e0468e3ecf844719ec635e1d", + "tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb", + "tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", + "tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748", + "tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b", + "tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48", + "tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e", + "tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298", + "tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f", + "tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c", + "requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a" + }, + "dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e", + "inputs": { + "data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52", + "data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9" + } + }, + "graph": { + "sha256": "0637d9ebb106c65d9aaa73d0634b28db81135e6a6c7503ea6b06c4a922e7e1e3", + "nodes": 422, + "relationships": 829 + }, + "completed_at_utc": "2026-10-24T19:03:27.594766+00:00", + "freeze_sha256": "2277226cbefa6337e04b5642da1145e1a11c48bbb05cf90de7ee5a7dbc71d806", + "audit_sha256": "4fbc8ea8090caaf275cac384e3c3c8ed7c3743b49523086bee3f0970e11d9276" + }, + "configuration": { + "questions_file": "/home/janko/DP/zp-agent/tools/graphrag/evaluation/graphrag_questions.json", + "split": "test", + "dataset_question_count": 500, + "selected_question_count": 214, + "limit": 40, + "max_entities": 8, + "ids": [], + "max_questions": null + }, + "summary": { + "questions": 214, + "strict_count": 152, + "strict_accuracy": 0.71028, + "error_count": 0, + "value_score": 0.735202, + "entity_score": 0.726636, + "relation_score": 0.738318, + "property_score": 0.794393, + "relation_choice_score": 0.953271, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.029583, + "latency_median_seconds": 0.029331, + "latency_p95_seconds": 0.033782 + }, + "by_category": { + "candidate_set_aggregation": { + "questions": 7, + "strict_count": 7, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.031866, + "latency_median_seconds": 0.031797, + "latency_p95_seconds": 0.032379 + }, + "conjunctive_disambiguation": { + "questions": 9, + "strict_count": 1, + "strict_accuracy": 0.111111, + "error_count": 0, + "value_score": 0.111111, + "entity_score": 0.111111, + "relation_score": 0.111111, + "property_score": 0.111111, + "relation_choice_score": 0.111111, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.027812, + "latency_median_seconds": 0.026418, + "latency_p95_seconds": 0.032829 + }, + "document_author_category_multi_hop": { + "questions": 25, + "strict_count": 25, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.028392, + "latency_median_seconds": 0.028353, + "latency_p95_seconds": 0.029533 + }, + "person_keyword_title": { + "questions": 38, + "strict_count": 3, + "strict_accuracy": 0.078947, + "error_count": 0, + "value_score": 0.105263, + "entity_score": 0.092105, + "relation_score": 0.105263, + "property_score": 0.105263, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.027967, + "latency_median_seconds": 0.025972, + "latency_p95_seconds": 0.033757 + }, + "person_multiple_categories": { + "questions": 9, + "strict_count": 6, + "strict_accuracy": 0.666667, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.028002, + "latency_median_seconds": 0.02694, + "latency_p95_seconds": 0.031688 + }, + "person_title_year": { + "questions": 36, + "strict_count": 36, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032105, + "latency_median_seconds": 0.031681, + "latency_p95_seconds": 0.035582 + }, + "same_academic_year_pair": { + "questions": 44, + "strict_count": 42, + "strict_accuracy": 0.954545, + "error_count": 0, + "value_score": 0.984849, + "entity_score": 0.954545, + "relation_score": 1.0, + "property_score": 0.954545, + "relation_choice_score": 0.954545, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.031572, + "latency_median_seconds": 0.031125, + "latency_p95_seconds": 0.033997 + }, + "same_start_year_pair": { + "questions": 32, + "strict_count": 32, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.02848, + "latency_median_seconds": 0.027546, + "latency_p95_seconds": 0.030821 + }, + "shared_keyword_pair": { + "questions": 14, + "strict_count": 0, + "strict_accuracy": 0.0, + "error_count": 0, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.026888, + "latency_median_seconds": 0.026382, + "latency_p95_seconds": 0.029034 + } + }, + "by_difficulty": { + "hard": { + "questions": 178, + "strict_count": 116, + "strict_accuracy": 0.651685, + "error_count": 0, + "value_score": 0.681648, + "entity_score": 0.671348, + "relation_score": 0.685393, + "property_score": 0.752809, + "relation_choice_score": 0.94382, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.029072, + "latency_median_seconds": 0.028377, + "latency_p95_seconds": 0.033747 + }, + "medium": { + "questions": 36, + "strict_count": 36, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032105, + "latency_median_seconds": 0.031681, + "latency_p95_seconds": 0.035582 + } + }, + "questions": [ + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0029", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Alina Vitko a Ronald Zalacko v ZP Wiki prepojené cez kľúčové slovo Docker? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.02863, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Ronald Zalacko", + "Docker" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Docker" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0030", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Alina Vitko a Ronald Zalacko cez kľúčové slovo Docker a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.025681, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Ronald Zalacko", + "Docker" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Docker" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0033", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Martin Šarišský a Oleksandr Dorybohov v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.028839, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Oleksandr Dorybohov", + "agent" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0034", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Martin Šarišský a Oleksandr Dorybohov cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.027412, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Oleksandr Dorybohov", + "agent" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0039", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Andrii Pervashov a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo OpenWebUI? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.029397, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Samuel Vasiľ", + "OpenWebUI" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "OpenWebUI" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0040", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Andrii Pervashov a Samuel Vasiľ cez kľúčové slovo OpenWebUI a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.025237, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Samuel Vasiľ", + "OpenWebUI" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "OpenWebUI" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0043", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Oleh Poiasnik a Ján Malinovský v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.025173, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Ján Malinovský", + "znalostný graf" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0044", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Oleh Poiasnik a Ján Malinovský cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.026392, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Ján Malinovský", + "znalostný graf" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0045", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Oleh Poiasnik a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.025938, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Maksym Zatirka", + "znalostný graf" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0046", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Oleh Poiasnik a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.0252, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Maksym Zatirka", + "znalostný graf" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0047", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Ján Malinovský a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.026373, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Maksym Zatirka", + "znalostný graf" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0048", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Ján Malinovský a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.025873, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Maksym Zatirka", + "znalostný graf" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "znalostný graf" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0051", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Sú osoby Ján Malinovský a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.", + "latency_seconds": 0.027964, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "RAG" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0052", + "split": "test", + "category": "shared_keyword_pair", + "difficulty": "hard", + "question": "Over prepojenie osôb Ján Malinovský a Samuel Vasiľ cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.", + "latency_seconds": 0.028319, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "RAG" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0055", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Ronald Zalacko?", + "latency_seconds": 0.033795, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0056", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Samuel Vasiľ?", + "latency_seconds": 0.032272, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0057", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Filip Tomáš a Márk Fehér?", + "latency_seconds": 0.032439, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "Márk Fehér", + "2022" + ], + "matched_values": [ + "Filip Tomáš", + "Márk Fehér", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0059", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Ronald Zalacko?", + "latency_seconds": 0.031066, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0061", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dárius Lindvai a Lukáš Pokrývka?", + "latency_seconds": 0.033916, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2021" + ], + "matched_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0062", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Samuel Vasiľ?", + "latency_seconds": 0.036186, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0065", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Martin Šarišský?", + "latency_seconds": 0.034872, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Martin Šarišský", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Martin Šarišský" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2017/martin_jancura/README.md", + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura", + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [ + "academic_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0067", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ronald Zalacko a Samuel Vasiľ?", + "latency_seconds": 0.032398, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ronald Zalacko", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Ronald Zalacko", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0069", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Márk Fehér?", + "latency_seconds": 0.0308, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Márk Fehér", + "2022" + ], + "matched_values": [ + "Alina Vitko", + "Márk Fehér", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0070", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Oleksandr Dorybohov?", + "latency_seconds": 0.030749, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Oleksandr Dorybohov", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Oleksandr Dorybohov", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0073", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Samuel Vasiľ?", + "latency_seconds": 0.033775, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0077", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Oleksandr Dorybohov?", + "latency_seconds": 0.032121, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Oleksandr Dorybohov", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Oleksandr Dorybohov", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0080", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Maksym Zatirka?", + "latency_seconds": 0.03028, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0082", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Samuel Vasiľ?", + "latency_seconds": 0.029731, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0083", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Oleksandr Dorybohov?", + "latency_seconds": 0.031184, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0085", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Ronald Zalacko?", + "latency_seconds": 0.030696, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0090", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Maksym Zatirka?", + "latency_seconds": 0.030473, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Maksym Zatirka", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Maksym Zatirka", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0094", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ronald Zalacko?", + "latency_seconds": 0.030979, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0096", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Filip Tomáš?", + "latency_seconds": 0.032781, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Filip Tomáš", + "2022" + ], + "matched_values": [ + "Alina Vitko", + "Filip Tomáš", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0101", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ján Malinovský?", + "latency_seconds": 0.031393, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Ján Malinovský", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Ján Malinovský", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0102", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Martin Šarišský?", + "latency_seconds": 0.031656, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Martin Šarišský", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Martin Šarišský", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0103", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Andrii Pervashov a Oleh Poiasnik?", + "latency_seconds": 0.031534, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2027" + ], + "matched_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2027" + ], + "expected_entities": [ + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0106", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Samuel Vasiľ?", + "latency_seconds": 0.030663, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0109", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Oleksandr Dorybohov?", + "latency_seconds": 0.031207, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Oleksandr Dorybohov", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Oleksandr Dorybohov", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0112", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dmytro Ushatenko a Martin Wencel?", + "latency_seconds": 0.030988, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "Martin Wencel", + "2020" + ], + "matched_values": [ + "Dmytro Ushatenko", + "Martin Wencel", + "2020" + ], + "expected_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0113", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Ronald Zalacko?", + "latency_seconds": 0.030088, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0117", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Martin Šarišský?", + "latency_seconds": 0.03159, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Martin Šarišský", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Martin Šarišský", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0119", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Martin Šarišský a Ronald Zalacko?", + "latency_seconds": 0.03127, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0120", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Maksym Zatirka a Samuel Vasiľ?", + "latency_seconds": 0.030895, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0121", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Filip Tomáš a Márk Fehér?", + "latency_seconds": 0.032381, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "Márk Fehér", + "2022" + ], + "matched_values": [ + "Filip Tomáš", + "Márk Fehér", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0123", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Oleksandr Dorybohov a Ronald Zalacko?", + "latency_seconds": 0.030853, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0125", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Dárius Lindvai a Lukáš Pokrývka?", + "latency_seconds": 0.032875, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2021" + ], + "matched_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0126", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Malinovský a Samuel Vasiľ?", + "latency_seconds": 0.03045, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0129", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Malinovský a Martin Šarišský?", + "latency_seconds": 0.032707, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Martin Šarišský", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Martin Šarišský" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2017/martin_jancura/README.md", + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura", + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [ + "academic_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0131", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ronald Zalacko a Samuel Vasiľ?", + "latency_seconds": 0.0308, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ronald Zalacko", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Ronald Zalacko", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0133", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Alina Vitko a Márk Fehér?", + "latency_seconds": 0.034011, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Márk Fehér", + "2022" + ], + "matched_values": [ + "Alina Vitko", + "Márk Fehér", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0134", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Martin Šarišský a Oleksandr Dorybohov?", + "latency_seconds": 0.030999, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Oleksandr Dorybohov", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Oleksandr Dorybohov", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0137", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Martin Šarišský a Samuel Vasiľ?", + "latency_seconds": 0.030742, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0141", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Malinovský a Oleksandr Dorybohov?", + "latency_seconds": 0.030214, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Oleksandr Dorybohov", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Oleksandr Dorybohov", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0144", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Denis Le Thanh a Maksym Zatirka?", + "latency_seconds": 0.030026, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0146", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Oleksandr Dorybohov a Samuel Vasiľ?", + "latency_seconds": 0.030005, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Samuel Vasiľ", + "2026" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Samuel Vasiľ", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0147", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Maksym Zatirka a Oleksandr Dorybohov?", + "latency_seconds": 0.030108, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0149", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Maksym Zatirka a Ronald Zalacko?", + "latency_seconds": 0.029898, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0154", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Malinovský a Maksym Zatirka?", + "latency_seconds": 0.031309, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Maksym Zatirka", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Maksym Zatirka", + "2026" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "academic_year_comparison", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0157", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Ronald Zalacko?", + "latency_seconds": 0.028997, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Ronald Zalacko", + "2023" + ], + "matched_values": [ + "Denis Le Thanh", + "Ronald Zalacko", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0158", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Oleh Poiasnik?", + "latency_seconds": 0.028138, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Oleh Poiasnik", + "2022" + ], + "matched_values": [ + "Ján Malinovský", + "Oleh Poiasnik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0159", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleh Poiasnik a Samuel Vasiľ?", + "latency_seconds": 0.02848, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Samuel Vasiľ", + "2022" + ], + "matched_values": [ + "Oleh Poiasnik", + "Samuel Vasiľ", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0161", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleksandr Dorybohov a Ronald Zalacko?", + "latency_seconds": 0.027429, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2023" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0166", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Vladyslav Yanchenko?", + "latency_seconds": 0.032411, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Andrii Pervashov", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0169", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleh Poiasnik a Vladyslav Yanchenko?", + "latency_seconds": 0.051023, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Oleh Poiasnik", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0170", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Maksym Zatirka a Oleksandr Dorybohov?", + "latency_seconds": 0.02952, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2023" + ], + "matched_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0171", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Samuel Vasiľ?", + "latency_seconds": 0.028049, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2022" + ], + "matched_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0173", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Maksym Zatirka?", + "latency_seconds": 0.028715, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2023" + ], + "matched_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0175", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Maksym Zatirka a Ronald Zalacko?", + "latency_seconds": 0.027294, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2023" + ], + "matched_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0176", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Oleksandr Dorybohov?", + "latency_seconds": 0.027561, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Oleksandr Dorybohov", + "2023" + ], + "matched_values": [ + "Denis Le Thanh", + "Oleksandr Dorybohov", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0178", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Oleh Poiasnik?", + "latency_seconds": 0.027137, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2022" + ], + "matched_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0179", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Vladyslav Yanchenko?", + "latency_seconds": 0.027344, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Ján Malinovský", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0180", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Vasiľ a Vladyslav Yanchenko?", + "latency_seconds": 0.02776, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Vasiľ", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Samuel Vasiľ", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0181", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Ján Malinovský?", + "latency_seconds": 0.028278, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Ján Malinovský", + "2022" + ], + "matched_values": [ + "Andrii Pervashov", + "Ján Malinovský", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0183", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Dárius Lindvai a Lukáš Pokrývka?", + "latency_seconds": 0.029056, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2016" + ], + "matched_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2016" + ], + "expected_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2016" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0184", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Eduard Matovka a Martin Šarišský?", + "latency_seconds": 0.027888, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Eduard Matovka", + "Martin Šarišský", + "2021" + ], + "matched_values": [ + "Eduard Matovka", + "Martin Šarišský", + "2021" + ], + "expected_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/eduard_matovka/README.md", + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/eduard_matovka/README.md", + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/eduard_matovka/README.md", + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka", + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka", + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka", + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0187", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Samuel Vasiľ?", + "latency_seconds": 0.02739, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Samuel Vasiľ", + "2022" + ], + "matched_values": [ + "Andrii Pervashov", + "Samuel Vasiľ", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year", + "start_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0191", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Ronald Zalacko?", + "latency_seconds": 0.027939, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Ronald Zalacko", + "2023" + ], + "matched_values": [ + "Denis Le Thanh", + "Ronald Zalacko", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0192", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Oleh Poiasnik?", + "latency_seconds": 0.027064, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Oleh Poiasnik", + "2022" + ], + "matched_values": [ + "Ján Malinovský", + "Oleh Poiasnik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0193", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Oleh Poiasnik a Samuel Vasiľ?", + "latency_seconds": 0.027957, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Samuel Vasiľ", + "2022" + ], + "matched_values": [ + "Oleh Poiasnik", + "Samuel Vasiľ", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0195", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Oleksandr Dorybohov a Ronald Zalacko?", + "latency_seconds": 0.027162, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2023" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Ronald Zalacko", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0200", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Andrii Pervashov a Vladyslav Yanchenko?", + "latency_seconds": 0.026257, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Andrii Pervashov", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0203", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Oleh Poiasnik a Vladyslav Yanchenko?", + "latency_seconds": 0.026844, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Oleh Poiasnik", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0204", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Maksym Zatirka a Oleksandr Dorybohov?", + "latency_seconds": 0.02753, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2023" + ], + "matched_values": [ + "Maksym Zatirka", + "Oleksandr Dorybohov", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0205", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Samuel Vasiľ?", + "latency_seconds": 0.028417, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2022" + ], + "matched_values": [ + "Ján Malinovský", + "Samuel Vasiľ", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0207", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Maksym Zatirka?", + "latency_seconds": 0.026652, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2023" + ], + "matched_values": [ + "Denis Le Thanh", + "Maksym Zatirka", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0209", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Maksym Zatirka a Ronald Zalacko?", + "latency_seconds": 0.026911, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2023" + ], + "matched_values": [ + "Maksym Zatirka", + "Ronald Zalacko", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md", + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka", + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0210", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Oleksandr Dorybohov?", + "latency_seconds": 0.026253, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Oleksandr Dorybohov", + "2023" + ], + "matched_values": [ + "Denis Le Thanh", + "Oleksandr Dorybohov", + "2023" + ], + "expected_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2023" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0212", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Andrii Pervashov a Oleh Poiasnik?", + "latency_seconds": 0.026634, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2022" + ], + "matched_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0213", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Vladyslav Yanchenko?", + "latency_seconds": 0.026713, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Ján Malinovský", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0214", + "split": "test", + "category": "same_start_year_pair", + "difficulty": "hard", + "question": "Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Vasiľ a Vladyslav Yanchenko?", + "latency_seconds": 0.026558, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Vasiľ", + "Vladyslav Yanchenko", + "2022" + ], + "matched_values": [ + "Samuel Vasiľ", + "Vladyslav Yanchenko", + "2022" + ], + "expected_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Person.start_year", + "Person.start_year" + ], + "matched_properties": [ + "Person.start_year", + "Person.start_year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md", + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil", + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "start_year_constraints" + ], + "fact_types": [ + "person_start_year" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0215", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Alina Vitko?", + "latency_seconds": 0.031693, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku", + "2022" + ], + "matched_values": [ + "Alina Vitko", + "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0216", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Alina Vitko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.031474, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku", + "2022" + ], + "matched_values": [ + "Alina Vitko", + "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0217", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Andrii Pervashov?", + "latency_seconds": 0.033513, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu", + "2027" + ], + "matched_values": [ + "Andrii Pervashov", + "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu", + "2027" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + }, + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0218", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Andrii Pervashov s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032751, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu", + "2027" + ], + "matched_values": [ + "Andrii Pervashov", + "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu", + "2027" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + }, + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0223", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Denis Le Thanh?", + "latency_seconds": 0.031669, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0224", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Denis Le Thanh s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.031798, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0225", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Dmytro Ushatenko?", + "latency_seconds": 0.030322, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "Jednoduchý chatbot v jazyku Python", + "2020" + ], + "matched_values": [ + "Dmytro Ushatenko", + "Jednoduchý chatbot v jazyku Python", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Jednoduchý chatbot v jazyku Python" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Jednoduchý chatbot v jazyku Python" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0226", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Dmytro Ushatenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.030611, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "Jednoduchý chatbot v jazyku Python", + "2020" + ], + "matched_values": [ + "Dmytro Ushatenko", + "Jednoduchý chatbot v jazyku Python", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Jednoduchý chatbot v jazyku Python" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Jednoduchý chatbot v jazyku Python" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0229", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Dárius Lindvai?", + "latency_seconds": 0.031376, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "Obnovenie interpunkcie pomocou hlbokých neurónových sietí", + "2021" + ], + "matched_values": [ + "Dárius Lindvai", + "Obnovenie interpunkcie pomocou hlbokých neurónových sietí", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0230", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Dárius Lindvai s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.033436, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "Obnovenie interpunkcie pomocou hlbokých neurónových sietí", + "2021" + ], + "matched_values": [ + "Dárius Lindvai", + "Obnovenie interpunkcie pomocou hlbokých neurónových sietí", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0233", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Eduard Matovka?", + "latency_seconds": 0.031967, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Eduard Matovka", + "Slovenská konverzačná umelá inteligencia", + "2024" + ], + "matched_values": [ + "Eduard Matovka", + "Slovenská konverzačná umelá inteligencia", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Slovenská konverzačná umelá inteligencia" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Slovenská konverzačná umelá inteligencia" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "actual_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "matched_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0234", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Eduard Matovka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.031886, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Eduard Matovka", + "Slovenská konverzačná umelá inteligencia", + "2024" + ], + "matched_values": [ + "Eduard Matovka", + "Slovenská konverzačná umelá inteligencia", + "2024" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Slovenská konverzačná umelá inteligencia" + }, + { + "type": "year", + "value": "2024" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Slovenská konverzačná umelá inteligencia" + }, + { + "type": "year", + "value": "2024" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "actual_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "matched_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0235", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Filip Tomáš?", + "latency_seconds": 0.032539, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia", + "2022" + ], + "matched_values": [ + "Filip Tomáš", + "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0236", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Filip Tomáš s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.03197, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia", + "2022" + ], + "matched_values": [ + "Filip Tomáš", + "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0241", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ján Malinovský?", + "latency_seconds": 0.030517, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Grafové vyhľadávanie pre podporu vzdelávania", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Grafové vyhľadávanie pre podporu vzdelávania", + "2026" + ], + "expected_entities": [ + { + "type": "work_title", + "value": "Grafové vyhľadávanie pre podporu vzdelávania" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "work_title", + "value": "Grafové vyhľadávanie pre podporu vzdelávania" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_WORK" + ], + "expected_properties": [ + "Work.title", + "Work.year" + ], + "matched_properties": [ + "Work.title", + "Work.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints" + ], + "fact_types": [ + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0242", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ján Malinovský s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.032665, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Grafové vyhľadávanie pre podporu vzdelávania", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Grafové vyhľadávanie pre podporu vzdelávania", + "2026" + ], + "expected_entities": [ + { + "type": "work_title", + "value": "Grafové vyhľadávanie pre podporu vzdelávania" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "work_title", + "value": "Grafové vyhľadávanie pre podporu vzdelávania" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_WORK" + ], + "expected_properties": [ + "Work.title", + "Work.year" + ], + "matched_properties": [ + "Work.title", + "Work.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints" + ], + "fact_types": [ + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0247", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Lukáš Pokrývka?", + "latency_seconds": 0.033034, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Lukáš Pokrývka", + "Paralelné trénovanie neurónových sietí", + "2021" + ], + "matched_values": [ + "Lukáš Pokrývka", + "Paralelné trénovanie neurónových sietí", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Paralelné trénovanie neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Paralelné trénovanie neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0248", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Lukáš Pokrývka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.031437, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Lukáš Pokrývka", + "Paralelné trénovanie neurónových sietí", + "2021" + ], + "matched_values": [ + "Lukáš Pokrývka", + "Paralelné trénovanie neurónových sietí", + "2021" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Paralelné trénovanie neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Paralelné trénovanie neurónových sietí" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0249", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Maksym Zatirka?", + "latency_seconds": 0.031002, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Grafová databáza pre podporu generovania slovenského jazyka", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Grafová databáza pre podporu generovania slovenského jazyka", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Grafová databáza pre podporu generovania slovenského jazyka" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Grafová databáza pre podporu generovania slovenského jazyka" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0250", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Maksym Zatirka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.03164, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "Grafová databáza pre podporu generovania slovenského jazyka", + "2026" + ], + "matched_values": [ + "Maksym Zatirka", + "Grafová databáza pre podporu generovania slovenského jazyka", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Grafová databáza pre podporu generovania slovenského jazyka" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Grafová databáza pre podporu generovania slovenského jazyka" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0253", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Martin Wencel?", + "latency_seconds": 0.03014, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Wencel", + "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy", + "2020" + ], + "matched_values": [ + "Martin Wencel", + "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0254", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Martin Wencel s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.03106, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Wencel", + "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy", + "2020" + ], + "matched_values": [ + "Martin Wencel", + "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy", + "2020" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + }, + { + "type": "year", + "value": "2020" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0255", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Martin Šarišský?", + "latency_seconds": 0.031488, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Agentové systémy pomocou veľkého jazykového modelu", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Agentové systémy pomocou veľkého jazykového modelu", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Agentové systémy pomocou veľkého jazykového modelu" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Agentové systémy pomocou veľkého jazykového modelu" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0256", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Martin Šarišský s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.033026, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "Agentové systémy pomocou veľkého jazykového modelu", + "2026" + ], + "matched_values": [ + "Martin Šarišský", + "Agentové systémy pomocou veľkého jazykového modelu", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Agentové systémy pomocou veľkého jazykového modelu" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Agentové systémy pomocou veľkého jazykového modelu" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0263", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Márk Fehér?", + "latency_seconds": 0.032823, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Márk Fehér", + "Klasifikácia textu metódami strojového učenia", + "2022" + ], + "matched_values": [ + "Márk Fehér", + "Klasifikácia textu metódami strojového učenia", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia textu metódami strojového učenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia textu metódami strojového učenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0264", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Márk Fehér s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.036111, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Márk Fehér", + "Klasifikácia textu metódami strojového učenia", + "2022" + ], + "matched_values": [ + "Márk Fehér", + "Klasifikácia textu metódami strojového učenia", + "2022" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia textu metódami strojového učenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia textu metódami strojového učenia" + }, + { + "type": "year", + "value": "2022" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0265", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Oleh Poiasnik?", + "latency_seconds": 0.041553, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Expertný agentový systém na podporu rozhodovania v lekárni", + "2027" + ], + "matched_values": [ + "Oleh Poiasnik", + "Expertný agentový systém na podporu rozhodovania v lekárni", + "2027" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Expertný agentový systém na podporu rozhodovania v lekárni" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Expertný agentový systém na podporu rozhodovania v lekárni" + }, + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0266", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Oleh Poiasnik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.035405, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "Expertný agentový systém na podporu rozhodovania v lekárni", + "2027" + ], + "matched_values": [ + "Oleh Poiasnik", + "Expertný agentový systém na podporu rozhodovania v lekárni", + "2027" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Expertný agentový systém na podporu rozhodovania v lekárni" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Expertný agentový systém na podporu rozhodovania v lekárni" + }, + { + "type": "year", + "value": "2027" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0267", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Oleksandr Dorybohov?", + "latency_seconds": 0.032375, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Automatické odpovede na otázky v právnej oblasti", + "2026" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Automatické odpovede na otázky v právnej oblasti", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Automatické odpovede na otázky v právnej oblasti" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatické odpovede na otázky v právnej oblasti" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0268", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Oleksandr Dorybohov s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.030871, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "Automatické odpovede na otázky v právnej oblasti", + "2026" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "Automatické odpovede na otázky v právnej oblasti", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Automatické odpovede na otázky v právnej oblasti" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Automatické odpovede na otázky v právnej oblasti" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0273", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Ronald Zalacko?", + "latency_seconds": 0.03133, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ronald Zalacko", + "Skórovací online systém pre robotické súťaže", + "2026" + ], + "matched_values": [ + "Ronald Zalacko", + "Skórovací online systém pre robotické súťaže", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Skórovací online systém pre robotické súťaže" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Skórovací online systém pre robotické súťaže" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0274", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Ronald Zalacko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.029625, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ronald Zalacko", + "Skórovací online systém pre robotické súťaže", + "2026" + ], + "matched_values": [ + "Ronald Zalacko", + "Skórovací online systém pre robotické súťaže", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Skórovací online systém pre robotické súťaže" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Skórovací online systém pre robotické súťaže" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0279", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Vasiľ?", + "latency_seconds": 0.030054, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Vasiľ", + "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI", + "2026" + ], + "matched_values": [ + "Samuel Vasiľ", + "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0280", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Samuel Vasiľ s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.033345, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Vasiľ", + "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI", + "2026" + ], + "matched_values": [ + "Samuel Vasiľ", + "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI", + "2026" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + }, + { + "type": "year", + "value": "2026" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0291", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Aký názov práce a aký rok práce sú uvedené pri osobe Vladyslav Yanchenko?", + "latency_seconds": 0.029265, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladyslav Yanchenko", + "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí", + "2025" + ], + "matched_values": [ + "Vladyslav Yanchenko", + "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0292", + "split": "test", + "category": "person_title_year", + "difficulty": "medium", + "question": "Prepoj osobu Vladyslav Yanchenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.", + "latency_seconds": 0.030024, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladyslav Yanchenko", + "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí", + "2025" + ], + "matched_values": [ + "Vladyslav Yanchenko", + "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí", + "2025" + ], + "expected_entities": [ + { + "type": "thesis_title", + "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + }, + { + "type": "year", + "value": "2025" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + }, + { + "type": "year", + "value": "2025" + } + ], + "expected_relations": [ + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [ + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year" + ], + "matched_properties": [ + "Thesis.title", + "Thesis.year" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0295", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo cloud?", + "latency_seconds": 0.032062, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladyslav Yanchenko", + "cloud", + "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "cloud" + }, + { + "type": "thesis_title", + "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0306", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo inštrukcie?", + "latency_seconds": 0.02586, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "inštrukcie", + "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "inštrukcie" + }, + { + "type": "thesis_title", + "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0307", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo právne informácie?", + "latency_seconds": 0.02625, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "právne informácie", + "Agentové systémy pomocou veľkého jazykového modelu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "právne informácie" + }, + { + "type": "thesis_title", + "value": "Agentové systémy pomocou veľkého jazykového modelu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0308", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ján Malinovský, ak jej dokument zároveň obsahuje kľúčové slovo RAG?", + "latency_seconds": 0.031762, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "RAG", + "Grafové vyhľadávanie pre podporu vzdelávania" + ], + "matched_values": [ + "Ján Malinovský", + "RAG", + "Grafové vyhľadávanie pre podporu vzdelávania" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + }, + { + "type": "work_title", + "value": "Grafové vyhľadávanie pre podporu vzdelávania" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "RAG" + }, + { + "type": "work_title", + "value": "Grafové vyhľadávanie pre podporu vzdelávania" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "actual_relations": [ + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "expected_properties": [ + "Work.title" + ], + "matched_properties": [ + "Work.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0310", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo SlovakAlpaca?", + "latency_seconds": 0.02632, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Eduard Matovka", + "SlovakAlpaca", + "Slovenská konverzačná umelá inteligencia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "SlovakAlpaca" + }, + { + "type": "thesis_title", + "value": "Slovenská konverzačná umelá inteligencia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "actual_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "matched_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0311", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo BiLSTM?", + "latency_seconds": 0.025225, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "BiLSTM", + "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "BiLSTM" + }, + { + "type": "thesis_title", + "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0312", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo NCCL?", + "latency_seconds": 0.025966, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Lukáš Pokrývka", + "NCCL", + "Paralelné trénovanie neurónových sietí" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "NCCL" + }, + { + "type": "thesis_title", + "value": "Paralelné trénovanie neurónových sietí" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0313", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo Docker?", + "latency_seconds": 0.025838, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ronald Zalacko", + "Docker", + "Skórovací online systém pre robotické súťaže" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Docker" + }, + { + "type": "thesis_title", + "value": "Skórovací online systém pre robotické súťaže" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0315", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo RAG?", + "latency_seconds": 0.033392, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Vasiľ", + "RAG", + "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "RAG" + }, + { + "type": "thesis_title", + "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0317", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo lekáreň?", + "latency_seconds": 0.025363, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "lekáreň", + "Expertný agentový systém na podporu rozhodovania v lekárni" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "lekáreň" + }, + { + "type": "thesis_title", + "value": "Expertný agentový systém na podporu rozhodovania v lekárni" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0318", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo chatbot?", + "latency_seconds": 0.03166, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "chatbot", + "Jednoduchý chatbot v jazyku Python" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "chatbot" + }, + { + "type": "thesis_title", + "value": "Jednoduchý chatbot v jazyku Python" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0320", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo Python?", + "latency_seconds": 0.030603, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "Python", + "Jednoduchý chatbot v jazyku Python" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Python" + }, + { + "type": "thesis_title", + "value": "Jednoduchý chatbot v jazyku Python" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0321", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo morfologická analýza?", + "latency_seconds": 0.024745, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Wencel", + "morfologická analýza", + "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "morfologická analýza" + }, + { + "type": "thesis_title", + "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0325", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo speech-to-text?", + "latency_seconds": 0.025801, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "speech-to-text", + "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "speech-to-text" + }, + { + "type": "thesis_title", + "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0326", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo robotické súťaže?", + "latency_seconds": 0.026016, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ronald Zalacko", + "robotické súťaže", + "Skórovací online systém pre robotické súťaže" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "robotické súťaže" + }, + { + "type": "thesis_title", + "value": "Skórovací online systém pre robotické súťaže" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0332", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?", + "latency_seconds": 0.043224, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Wencel", + "Spacy", + "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + ], + "matched_values": [ + "Martin Wencel", + "Spacy", + "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "thesis_title", + "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "Spacy" + }, + { + "type": "thesis_title", + "value": "Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0334", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo CI/CD?", + "latency_seconds": 0.025889, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "CI/CD", + "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "CI/CD" + }, + { + "type": "thesis_title", + "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0335", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo slovenský jazykový model?", + "latency_seconds": 0.026231, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Eduard Matovka", + "slovenský jazykový model", + "Slovenská konverzačná umelá inteligencia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenský jazykový model" + }, + { + "type": "thesis_title", + "value": "Slovenská konverzačná umelá inteligencia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "actual_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "matched_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0338", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo agent?", + "latency_seconds": 0.031166, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "agent", + "Automatické odpovede na otázky v právnej oblasti" + ], + "matched_values": [ + "Oleksandr Dorybohov", + "agent", + "Automatické odpovede na otázky v právnej oblasti" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + }, + { + "type": "thesis_title", + "value": "Automatické odpovede na otázky v právnej oblasti" + } + ], + "matched_entities": [ + { + "type": "keyword", + "value": "agent" + }, + { + "type": "thesis_title", + "value": "Automatické odpovede na otázky v právnej oblasti" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0339", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo MCP?", + "latency_seconds": 0.02561, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Vasiľ", + "MCP", + "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "MCP" + }, + { + "type": "thesis_title", + "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0342", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo agent?", + "latency_seconds": 0.033742, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "agent", + "Agentové systémy pomocou veľkého jazykového modelu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "agent" + }, + { + "type": "thesis_title", + "value": "Agentové systémy pomocou veľkého jazykového modelu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0350", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo PyTorch?", + "latency_seconds": 0.032128, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Lukáš Pokrývka", + "PyTorch", + "Paralelné trénovanie neurónových sietí" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "PyTorch" + }, + { + "type": "thesis_title", + "value": "Paralelné trénovanie neurónových sietí" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0351", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo Docker Compose?", + "latency_seconds": 0.025346, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "Docker Compose", + "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Docker Compose" + }, + { + "type": "thesis_title", + "value": "Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0352", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Streamlit?", + "latency_seconds": 0.025389, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Streamlit", + "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Streamlit" + }, + { + "type": "thesis_title", + "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0356", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Márk Fehér, ak jej dokument zároveň obsahuje kľúčové slovo klasifikácia textu?", + "latency_seconds": 0.033839, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 0.5, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Márk Fehér", + "klasifikácia textu", + "Klasifikácia textu metódami strojového učenia" + ], + "matched_values": [ + "Márk Fehér", + "klasifikácia textu", + "Klasifikácia textu metódami strojového učenia" + ], + "expected_entities": [ + { + "type": "keyword", + "value": "klasifikácia textu" + }, + { + "type": "thesis_title", + "value": "Klasifikácia textu metódami strojového učenia" + } + ], + "matched_entities": [ + { + "type": "thesis_title", + "value": "Klasifikácia textu metódami strojového učenia" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD", + "HAS_WORK" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [ + "Thesis.title" + ], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0357", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo Slovak Mistral?", + "latency_seconds": 0.025957, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Slovak Mistral", + "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Slovak Mistral" + }, + { + "type": "thesis_title", + "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0358", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo kyberbezpečnosť?", + "latency_seconds": 0.025629, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "kyberbezpečnosť", + "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "kyberbezpečnosť" + }, + { + "type": "thesis_title", + "value": "Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0360", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo slovenské právo?", + "latency_seconds": 0.025783, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "slovenské právo", + "Grafová databáza pre podporu generovania slovenského jazyka" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "slovenské právo" + }, + { + "type": "thesis_title", + "value": "Grafová databáza pre podporu generovania slovenského jazyka" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0362", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Question Answering?", + "latency_seconds": 0.031582, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Question Answering", + "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Question Answering" + }, + { + "type": "thesis_title", + "value": "Systémy pre generovanie odpovede na otázku v prirodzenom jazyku" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0363", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo LightRAG?", + "latency_seconds": 0.025125, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "LightRAG", + "Expertný agentový systém na podporu rozhodovania v lekárni" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "LightRAG" + }, + { + "type": "thesis_title", + "value": "Expertný agentový systém na podporu rozhodovania v lekárni" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0365", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?", + "latency_seconds": 0.025655, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "OpenWebUI", + "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "OpenWebUI" + }, + { + "type": "thesis_title", + "value": "Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0367", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo grafová databáza?", + "latency_seconds": 0.026591, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Maksym Zatirka", + "grafová databáza", + "Grafová databáza pre podporu generovania slovenského jazyka" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "grafová databáza" + }, + { + "type": "thesis_title", + "value": "Grafová databáza pre podporu generovania slovenského jazyka" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0369", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo API?", + "latency_seconds": 0.025261, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleksandr Dorybohov", + "API", + "Automatické odpovede na otázky v právnej oblasti" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "API" + }, + { + "type": "thesis_title", + "value": "Automatické odpovede na otázky v právnej oblasti" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0370", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?", + "latency_seconds": 0.02565, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Samuel Vasiľ", + "OpenWebUI", + "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "OpenWebUI" + }, + { + "type": "thesis_title", + "value": "Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0371", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo Azure?", + "latency_seconds": 0.025979, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Vladyslav Yanchenko", + "Azure", + "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "Azure" + }, + { + "type": "thesis_title", + "value": "Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0372", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo dialógový systém?", + "latency_seconds": 0.027264, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "dialógový systém", + "Jednoduchý chatbot v jazyku Python" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "dialógový systém" + }, + { + "type": "thesis_title", + "value": "Jednoduchý chatbot v jazyku Python" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0373", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo CRF?", + "latency_seconds": 0.027055, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "CRF", + "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "CRF" + }, + { + "type": "thesis_title", + "value": "Obnovenie interpunkcie pomocou hlbokých neurónových sietí" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0374", + "split": "test", + "category": "person_keyword_title", + "difficulty": "hard", + "question": "Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo DeepEval?", + "latency_seconds": 0.025773, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "DeepEval", + "Agentové systémy pomocou veľkého jazykového modelu" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "keyword", + "value": "DeepEval" + }, + { + "type": "thesis_title", + "value": "Agentové systémy pomocou veľkého jazykového modelu" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD", + "AUTHORED" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.title" + ], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0377", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou dp2027?", + "latency_seconds": 0.028582, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2027", + "Oleh Poiasnik" + ], + "matched_values": [ + "Daniel Hladek", + "dp2027", + "Oleh Poiasnik" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2027" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2027" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0378", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Andrii Pervashov spojený s kategóriou bp2025?", + "latency_seconds": 0.027959, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2025", + "Andrii Pervashov" + ], + "matched_values": [ + "Daniel Hladek", + "bp2025", + "Andrii Pervashov" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0383", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Alina Vitko spojený s kategóriou bp2022?", + "latency_seconds": 0.028748, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Alina Vitko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2022", + "Alina Vitko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0384", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ján Malinovský spojený s kategóriou dp2027?", + "latency_seconds": 0.02859, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2027", + "Ján Malinovský" + ], + "matched_values": [ + "Daniel Hladek", + "dp2027", + "Ján Malinovský" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2027" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2027" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0391", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Samuel Vasiľ spojený s kategóriou bp2026?", + "latency_seconds": 0.027715, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Samuel Vasiľ" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Samuel Vasiľ" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "actual_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "matched_documents": [ + "pages/students/2022/samuel_vasil/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0395", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou bp2019?", + "latency_seconds": 0.027904, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Lukáš Pokrývka" + ], + "matched_values": [ + "Daniel Hladek", + "bp2019", + "Lukáš Pokrývka" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0399", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2024?", + "latency_seconds": 0.028353, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2024", + "Filip Tomáš" + ], + "matched_values": [ + "Daniel Hladek", + "dp2024", + "Filip Tomáš" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0401", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Ronald Zalacko spojený s kategóriou bp2026?", + "latency_seconds": 0.028499, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Ronald Zalacko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Ronald Zalacko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "actual_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "matched_documents": [ + "pages/students/2023/ronald_zalacko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0402", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Martin Wencel spojený s kategóriou bp2021?", + "latency_seconds": 0.028636, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2021", + "Martin Wencel" + ], + "matched_values": [ + "Daniel Hladek", + "bp2021", + "Martin Wencel" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0403", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Eduard Matovka spojený s kategóriou bp2024?", + "latency_seconds": 0.027674, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2024", + "Eduard Matovka" + ], + "matched_values": [ + "Daniel Hladek", + "bp2024", + "Eduard Matovka" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "actual_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "matched_documents": [ + "pages/students/2021/eduard_matovka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0404", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2025?", + "latency_seconds": 0.029116, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2025", + "Filip Tomáš" + ], + "matched_values": [ + "Daniel Hladek", + "dp2025", + "Filip Tomáš" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0406", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Márk Fehér spojený s kategóriou dp2022?", + "latency_seconds": 0.02892, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2022", + "Márk Fehér" + ], + "matched_values": [ + "Daniel Hladek", + "dp2022", + "Márk Fehér" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0409", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Oleksandr Dorybohov spojený s kategóriou bp2026?", + "latency_seconds": 0.02801, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Oleksandr Dorybohov" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Oleksandr Dorybohov" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "actual_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "matched_documents": [ + "pages/students/2023/oleksandr_dorybohov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0413", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dmytro Ushatenko spojený s kategóriou bp2020?", + "latency_seconds": 0.027263, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2020", + "Dmytro Ushatenko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2020", + "Dmytro Ushatenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2020" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0414", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou vp2023?", + "latency_seconds": 0.028031, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "vp2023", + "Martin Šarišský" + ], + "matched_values": [ + "Daniel Hladek", + "vp2023", + "Martin Šarišský" + ], + "expected_entities": [ + { + "type": "category", + "value": "vp2023" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "vp2023" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0418", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou bp2022?", + "latency_seconds": 0.028608, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2022", + "Filip Tomáš" + ], + "matched_values": [ + "Daniel Hladek", + "bp2022", + "Filip Tomáš" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0419", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Dárius Lindvai spojený s kategóriou bp2019?", + "latency_seconds": 0.028126, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2019", + "Dárius Lindvai" + ], + "matched_values": [ + "Daniel Hladek", + "bp2019", + "Dárius Lindvai" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0421", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Youssef Ressaissi spojený s kategóriou iaeste?", + "latency_seconds": 0.029637, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "iaeste", + "Youssef Ressaissi" + ], + "matched_values": [ + "Daniel Hladek", + "iaeste", + "Youssef Ressaissi" + ], + "expected_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/yussef_ressaissi/README.md" + ], + "actual_documents": [ + "pages/interns/yussef_ressaissi/README.md" + ], + "matched_documents": [ + "pages/interns/yussef_ressaissi/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0423", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou dp2021?", + "latency_seconds": 0.030141, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2021", + "Lukáš Pokrývka" + ], + "matched_values": [ + "Daniel Hladek", + "dp2021", + "Lukáš Pokrývka" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2021" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0428", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Vladyslav Yanchenko spojený s kategóriou bp2025?", + "latency_seconds": 0.028402, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2025", + "Vladyslav Yanchenko" + ], + "matched_values": [ + "Daniel Hladek", + "bp2025", + "Vladyslav Yanchenko" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "actual_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "matched_documents": [ + "pages/students/2022/vladyslav_yanchenko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0429", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Maksym Zatirka spojený s kategóriou bp2026?", + "latency_seconds": 0.028121, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2026", + "Maksym Zatirka" + ], + "matched_values": [ + "Daniel Hladek", + "bp2026", + "Maksym Zatirka" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0430", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou bp2024?", + "latency_seconds": 0.027976, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2024", + "Martin Šarišský" + ], + "matched_values": [ + "Daniel Hladek", + "bp2024", + "Martin Šarišský" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0431", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Sevval Bulburu spojený s kategóriou iaeste?", + "latency_seconds": 0.028124, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "iaeste", + "Sevval Bulburu" + ], + "matched_values": [ + "Daniel Hladek", + "iaeste", + "Sevval Bulburu" + ], + "expected_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "iaeste" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/interns/sevval_bulburu/README.md" + ], + "actual_documents": [ + "pages/interns/sevval_bulburu/README.md" + ], + "matched_documents": [ + "pages/interns/sevval_bulburu/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0432", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou dp2026?", + "latency_seconds": 0.028059, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "dp2026", + "Martin Šarišský" + ], + "matched_values": [ + "Daniel Hladek", + "dp2026", + "Martin Šarišský" + ], + "expected_entities": [ + { + "type": "category", + "value": "dp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "dp2026" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0434", + "split": "test", + "category": "document_author_category_multi_hop", + "difficulty": "hard", + "question": "Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou bp2025?", + "latency_seconds": 0.028602, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Daniel Hladek", + "bp2025", + "Oleh Poiasnik" + ], + "matched_values": [ + "Daniel Hladek", + "bp2025", + "Oleh Poiasnik" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "document_author", + "value": "Daniel Hladek" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "actual_relations": [ + "AUTHORED_DOCUMENT", + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY", + "AUTHORED_DOCUMENT" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints", + "person_document_author_constraints" + ], + "fact_types": [ + "person_category", + "person_document_author" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0437", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?", + "latency_seconds": 0.031754, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Lukáš Pokrývka", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Lukáš Pokrývka", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2016/lukas_pokryvka/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0441", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?", + "latency_seconds": 0.03159, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "bp2022", + "dp2024", + "dp2025" + ], + "matched_values": [ + "Filip Tomáš", + "bp2022", + "dp2024", + "dp2025" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "dp2025" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "dp2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [ + "bp2022", + "dp2024", + "dp2025" + ], + "entity_set_actual": [ + "bp2022", + "dp2024", + "dp2025" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0444", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?", + "latency_seconds": 0.026818, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "bp2025", + "dp2027" + ], + "matched_values": [ + "Oleh Poiasnik", + "bp2025", + "dp2027" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [ + "bp2025", + "dp2027" + ], + "entity_set_actual": [ + "bp2025", + "dp2027" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0446", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Dárius Lindvai?", + "latency_seconds": 0.026562, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Dárius Lindvai", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0448", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Andrii Pervashov?", + "latency_seconds": 0.026852, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "bp2025", + "dp2027" + ], + "matched_values": [ + "Andrii Pervashov", + "bp2025", + "dp2027" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [ + "bp2025", + "dp2027" + ], + "entity_set_actual": [ + "bp2025", + "dp2027" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0451", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Martin Šarišský?", + "latency_seconds": 0.02694, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Šarišský", + "bp2024", + "dp2026", + "vp2023" + ], + "matched_values": [ + "Martin Šarišský", + "bp2024", + "dp2026", + "vp2023" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "category", + "value": "dp2026" + }, + { + "type": "category", + "value": "vp2023" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2024" + }, + { + "type": "category", + "value": "dp2026" + }, + { + "type": "category", + "value": "vp2023" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "actual_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky" + ], + "entity_set_expected": [ + "bp2024", + "dp2026", + "vp2023" + ], + "entity_set_actual": [ + "bp2024", + "dp2026", + "vp2023" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0456", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?", + "latency_seconds": 0.02701, + "error": null, + "strict": false, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Lukáš Pokrývka", + "bp2019", + "dp2021" + ], + "matched_values": [ + "Lukáš Pokrývka", + "bp2019", + "dp2021" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2019" + }, + { + "type": "category", + "value": "dp2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2016/lukas_pokryvka/timovy_projekt/README.md" + ], + "matched_documents": [ + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [ + "bp2019", + "dp2021" + ], + "entity_set_actual": [ + "bp2019", + "dp2021", + "tp2020" + ], + "entity_set_mode": "exact", + "entity_set_ok": false, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0460", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?", + "latency_seconds": 0.027796, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Filip Tomáš", + "bp2022", + "dp2024", + "dp2025" + ], + "matched_values": [ + "Filip Tomáš", + "bp2022", + "dp2024", + "dp2025" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "dp2025" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2022" + }, + { + "type": "category", + "value": "dp2024" + }, + { + "type": "category", + "value": "dp2025" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [ + "bp2022", + "dp2024", + "dp2025" + ], + "entity_set_actual": [ + "bp2022", + "dp2024", + "dp2025" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0463", + "split": "test", + "category": "person_multiple_categories", + "difficulty": "hard", + "question": "V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?", + "latency_seconds": 0.026692, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "bp2025", + "dp2027" + ], + "matched_values": [ + "Oleh Poiasnik", + "bp2025", + "dp2027" + ], + "expected_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + } + ], + "matched_entities": [ + { + "type": "category", + "value": "bp2025" + }, + { + "type": "category", + "value": "dp2027" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "actual_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "IN_CATEGORY" + ], + "expected_properties": [], + "matched_properties": [], + "relation_choices": [], + "expected_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [ + "bp2025", + "dp2027" + ], + "entity_set_actual": [ + "bp2025", + "dp2027" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "person_category_constraints" + ], + "fact_types": [ + "person_category" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0467", + "split": "test", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Dárius Lindvai, Lukáš Pokrývka, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?", + "latency_seconds": 0.031457, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2", + "2021" + ], + "matched_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Dárius Lindvai" + }, + { + "type": "person", + "value": "Lukáš Pokrývka" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Dárius Lindvai" + }, + { + "type": "person", + "value": "Lukáš Pokrývka" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [ + "darius lindvai", + "lukas pokryvka" + ], + "entity_set_actual": [ + "darius lindvai", + "lukas pokryvka" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0468", + "split": "test", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Alina Vitko, Filip Tomáš, Márk Fehér, Andrii Pervashov vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?", + "latency_seconds": 0.031701, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Filip Tomáš", + "Márk Fehér", + "3", + "2022" + ], + "matched_values": [ + "Alina Vitko", + "Filip Tomáš", + "Márk Fehér", + "3", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Alina Vitko" + }, + { + "type": "person", + "value": "Filip Tomáš" + }, + { + "type": "person", + "value": "Márk Fehér" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Alina Vitko" + }, + { + "type": "person", + "value": "Filip Tomáš" + }, + { + "type": "person", + "value": "Márk Fehér" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md", + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md", + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md", + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [ + "alina vitko", + "filip tomas", + "mark feher" + ], + "entity_set_actual": [ + "alina vitko", + "filip tomas", + "mark feher" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0470", + "split": "test", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Dmytro Ushatenko, Martin Wencel, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?", + "latency_seconds": 0.031747, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "Martin Wencel", + "2", + "2020" + ], + "matched_values": [ + "Dmytro Ushatenko", + "Martin Wencel", + "2", + "2020" + ], + "expected_entities": [ + { + "type": "person", + "value": "Dmytro Ushatenko" + }, + { + "type": "person", + "value": "Martin Wencel" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Dmytro Ushatenko" + }, + { + "type": "person", + "value": "Martin Wencel" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [ + "dmytro ushatenko", + "martin wencel" + ], + "entity_set_actual": [ + "dmytro ushatenko", + "martin wencel" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0472", + "split": "test", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Denis Le Thanh, Ján Malinovský, Maksym Zatirka, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?", + "latency_seconds": 0.031927, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Ján Malinovský", + "Maksym Zatirka", + "3", + "2026" + ], + "matched_values": [ + "Denis Le Thanh", + "Ján Malinovský", + "Maksym Zatirka", + "3", + "2026" + ], + "expected_entities": [ + { + "type": "person", + "value": "Denis Le Thanh" + }, + { + "type": "person", + "value": "Ján Malinovský" + }, + { + "type": "person", + "value": "Maksym Zatirka" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Denis Le Thanh" + }, + { + "type": "person", + "value": "Ján Malinovský" + }, + { + "type": "person", + "value": "Maksym Zatirka" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_WORK" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md", + "pages/students/2023/maksym_zatirka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh", + "https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka" + ], + "entity_set_expected": [ + "denis le thanh", + "jan malinovsky", + "maksym zatirka" + ], + "entity_set_actual": [ + "denis le thanh", + "jan malinovsky", + "maksym zatirka" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "work_constraints" + ], + "fact_types": [ + "person_thesis", + "person_work" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0474", + "split": "test", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Z kandidátov Andrii Pervashov, Oleh Poiasnik, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2027. Koľko ich je?", + "latency_seconds": 0.031857, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2", + "2027" + ], + "matched_values": [ + "Andrii Pervashov", + "Oleh Poiasnik", + "2", + "2027" + ], + "expected_entities": [ + { + "type": "person", + "value": "Andrii Pervashov" + }, + { + "type": "person", + "value": "Oleh Poiasnik" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Andrii Pervashov" + }, + { + "type": "person", + "value": "Oleh Poiasnik" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [ + "andrii pervashov", + "oleh poiasnik" + ], + "entity_set_actual": [ + "andrii pervashov", + "oleh poiasnik" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 2, + "actual_count": 2, + "complete": true, + "id": "g0478", + "split": "test", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Dárius Lindvai, Lukáš Pokrývka, Alina Vitko zdieľajú rok práce 2021? Uveď aj ich počet.", + "latency_seconds": 0.032573, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2", + "2021" + ], + "matched_values": [ + "Dárius Lindvai", + "Lukáš Pokrývka", + "2", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Dárius Lindvai" + }, + { + "type": "person", + "value": "Lukáš Pokrývka" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Dárius Lindvai" + }, + { + "type": "person", + "value": "Lukáš Pokrývka" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md", + "pages/students/2019/alina_vitko/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko" + ], + "entity_set_expected": [ + "darius lindvai", + "lukas pokryvka" + ], + "entity_set_actual": [ + "darius lindvai", + "lukas pokryvka" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": 3, + "actual_count": 3, + "complete": true, + "id": "g0479", + "split": "test", + "category": "candidate_set_aggregation", + "difficulty": "hard", + "question": "Ktoré osoby zo zoznamu Alina Vitko, Filip Tomáš, Márk Fehér, Andrii Pervashov zdieľajú rok práce 2022? Uveď aj ich počet.", + "latency_seconds": 0.031797, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Filip Tomáš", + "Márk Fehér", + "3", + "2022" + ], + "matched_values": [ + "Alina Vitko", + "Filip Tomáš", + "Márk Fehér", + "3", + "2022" + ], + "expected_entities": [ + { + "type": "person", + "value": "Alina Vitko" + }, + { + "type": "person", + "value": "Filip Tomáš" + }, + { + "type": "person", + "value": "Márk Fehér" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Alina Vitko" + }, + { + "type": "person", + "value": "Filip Tomáš" + }, + { + "type": "person", + "value": "Márk Fehér" + } + ], + "expected_relations": [], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY" + ], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md", + "pages/students/2022/andrii_pervashov/README.md" + ], + "actual_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md", + "pages/students/2022/andrii_pervashov/README.md" + ], + "matched_documents": [ + "pages/students/2016/mark_feher/README.md", + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md", + "pages/students/2022/andrii_pervashov/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/mark_feher", + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas", + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov" + ], + "entity_set_expected": [ + "alina vitko", + "filip tomas", + "mark feher" + ], + "entity_set_actual": [ + "alina vitko", + "filip tomas", + "mark feher" + ], + "entity_set_mode": "exact", + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints" + ], + "fact_types": [ + "person_thesis" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0481", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo inštrukcie a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.026888, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "inštrukcie", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Denis Le Thanh" + }, + { + "type": "keyword", + "value": "inštrukcie" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0482", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Slovak Mistral a jej práca je uvedená v roku 2026?", + "latency_seconds": 0.026786, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Denis Le Thanh", + "Slovak Mistral", + "2026" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Denis Le Thanh" + }, + { + "type": "keyword", + "value": "Slovak Mistral" + }, + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "actual_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "matched_documents": [ + "pages/students/2022/jan_malinovsky/README.md", + "pages/students/2023/denis_le_thanh/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky", + "https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0483", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Oleh Poiasnik a Andrii Pervashov spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo znalostný graf a jej práca je uvedená v roku 2027?", + "latency_seconds": 0.026187, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Oleh Poiasnik", + "znalostný graf", + "2027" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Oleh Poiasnik" + }, + { + "type": "keyword", + "value": "znalostný graf" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0487", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Martin Wencel a Dmytro Ushatenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo pomenované entity a jej práca je uvedená v roku 2020?", + "latency_seconds": 0.026325, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Martin Wencel", + "pomenované entity", + "2020" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Martin Wencel" + }, + { + "type": "keyword", + "value": "pomenované entity" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0489", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Dárius Lindvai a Lukáš Pokrývka spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo CRF a jej práca je uvedená v roku 2021?", + "latency_seconds": 0.026418, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dárius Lindvai", + "CRF", + "2021" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Dárius Lindvai" + }, + { + "type": "keyword", + "value": "CRF" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0491", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Alina Vitko a Filip Tomáš spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Streamlit a jej práca je uvedená v roku 2022?", + "latency_seconds": 0.02581, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Alina Vitko", + "Streamlit", + "2022" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Alina Vitko" + }, + { + "type": "keyword", + "value": "Streamlit" + }, + { + "type": "year", + "value": "2022" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "actual_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "matched_documents": [ + "pages/students/2019/alina_vitko/README.md", + "pages/students/2019/filip_tomas/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko", + "https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0494", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Dmytro Ushatenko a Martin Wencel spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo chatbot a jej práca je uvedená v roku 2020?", + "latency_seconds": 0.032847, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Dmytro Ushatenko", + "chatbot", + "2020" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Dmytro Ushatenko" + }, + { + "type": "keyword", + "value": "chatbot" + }, + { + "type": "year", + "value": "2020" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "actual_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "matched_documents": [ + "pages/students/2017/dmytro_ushatenko/README.md", + "pages/students/2018/martin_wencel/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko", + "https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0496", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Andrii Pervashov a Oleh Poiasnik spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo speech-to-text a jej práca je uvedená v roku 2027?", + "latency_seconds": 0.026247, + "error": null, + "strict": false, + "value_score": 0.0, + "entity_score": 0.0, + "relation_score": 0.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Andrii Pervashov", + "speech-to-text", + "2027" + ], + "matched_values": [], + "expected_entities": [ + { + "type": "person", + "value": "Andrii Pervashov" + }, + { + "type": "keyword", + "value": "speech-to-text" + }, + { + "type": "year", + "value": "2027" + } + ], + "matched_entities": [], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "actual_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "matched_documents": [ + "pages/students/2022/andrii_pervashov/README.md", + "pages/students/2022/oleh_poiasnik/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov", + "https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0497", + "split": "test", + "category": "conjunctive_disambiguation", + "difficulty": "hard", + "question": "Ktorá z osôb Lukáš Pokrývka a Dárius Lindvai spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo GPU a jej práca je uvedená v roku 2021?", + "latency_seconds": 0.032802, + "error": null, + "strict": true, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Lukáš Pokrývka", + "GPU", + "2021" + ], + "matched_values": [ + "Lukáš Pokrývka", + "GPU", + "2021" + ], + "expected_entities": [ + { + "type": "person", + "value": "Lukáš Pokrývka" + }, + { + "type": "keyword", + "value": "GPU" + }, + { + "type": "year", + "value": "2021" + } + ], + "matched_entities": [ + { + "type": "person", + "value": "Lukáš Pokrývka" + }, + { + "type": "keyword", + "value": "GPU" + }, + { + "type": "year", + "value": "2021" + } + ], + "expected_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "actual_relations": [ + "AUTHORED", + "EVIDENCED_BY", + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "matched_relations": [ + "HAS_DOCUMENT", + "HAS_KEYWORD" + ], + "expected_properties": [ + "Thesis.year|Work.year" + ], + "matched_properties": [ + "Thesis.year|Work.year" + ], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": true + } + ], + "expected_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "actual_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "matched_documents": [ + "pages/students/2016/darius_lindvai/README.md", + "pages/students/2016/lukas_pokryvka/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai", + "https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution", + "graph_traversal", + "thesis_constraints", + "person_keyword_constraints" + ], + "fact_types": [ + "person_keyword", + "person_thesis" + ] + } + ], + "source_consistent_summary": { + "questions": 154, + "strict_count": 152, + "strict_accuracy": 0.987013, + "error_count": 0, + "value_score": 0.995671, + "entity_score": 0.987013, + "relation_score": 1.0, + "property_score": 0.987013, + "relation_choice_score": 0.987013, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.030486, + "latency_median_seconds": 0.030564, + "latency_p95_seconds": 0.033949 + }, + "source_consistent_by_category": { + "candidate_set_aggregation": { + "questions": 7, + "strict_count": 7, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.031866, + "latency_median_seconds": 0.031797, + "latency_p95_seconds": 0.032379 + }, + "conjunctive_disambiguation": { + "questions": 1, + "strict_count": 1, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032802, + "latency_median_seconds": 0.032802, + "latency_p95_seconds": 0.032802 + }, + "document_author_category_multi_hop": { + "questions": 25, + "strict_count": 25, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.028392, + "latency_median_seconds": 0.028353, + "latency_p95_seconds": 0.029533 + }, + "person_keyword_title": { + "questions": 3, + "strict_count": 3, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.035384, + "latency_median_seconds": 0.031762, + "latency_p95_seconds": 0.042078 + }, + "person_multiple_categories": { + "questions": 6, + "strict_count": 6, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.027781, + "latency_median_seconds": 0.026896, + "latency_p95_seconds": 0.030641 + }, + "person_title_year": { + "questions": 36, + "strict_count": 36, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032105, + "latency_median_seconds": 0.031681, + "latency_p95_seconds": 0.035582 + }, + "same_academic_year_pair": { + "questions": 44, + "strict_count": 42, + "strict_accuracy": 0.954545, + "error_count": 0, + "value_score": 0.984849, + "entity_score": 0.954545, + "relation_score": 1.0, + "property_score": 0.954545, + "relation_choice_score": 0.954545, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.031572, + "latency_median_seconds": 0.031125, + "latency_p95_seconds": 0.033997 + }, + "same_start_year_pair": { + "questions": 32, + "strict_count": 32, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.02848, + "latency_median_seconds": 0.027546, + "latency_p95_seconds": 0.030821 + } + }, + "source_inconsistent_ids": [ + "g0029", + "g0030", + "g0033", + "g0034", + "g0039", + "g0040", + "g0043", + "g0044", + "g0045", + "g0046", + "g0047", + "g0048", + "g0051", + "g0052", + "g0295", + "g0306", + "g0307", + "g0310", + "g0311", + "g0312", + "g0313", + "g0315", + "g0317", + "g0318", + "g0320", + "g0321", + "g0325", + "g0326", + "g0334", + "g0335", + "g0339", + "g0342", + "g0350", + "g0351", + "g0352", + "g0356", + "g0357", + "g0358", + "g0360", + "g0362", + "g0363", + "g0365", + "g0367", + "g0369", + "g0370", + "g0371", + "g0372", + "g0373", + "g0374", + "g0437", + "g0446", + "g0456", + "g0481", + "g0482", + "g0483", + "g0487", + "g0489", + "g0491", + "g0494", + "g0496" + ] +} diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/holdout_failures.json b/tools/graphrag/evaluation/results/final_2026-10-24/holdout_failures.json new file mode 100644 index 0000000..e616f99 --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/holdout_failures.json @@ -0,0 +1,200 @@ +{ + "policy": "Recorded after the frozen TEST. No implementation or audit changes were made to improve these cases.", + "diagnosis": "Both questions concern the same pair. An additional Martin Jancura document appears in the evidence; likely overly broad fuzzy person matching. Investigate in a future version using separate development cases and a new holdout.", + "questions": [ + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0065", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Martin Šarišský?", + "latency_seconds": 0.034872, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Martin Šarišský", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Martin Šarišský" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2017/martin_jancura/README.md", + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura", + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [ + "academic_year_comparison" + ] + }, + { + "count_ok": true, + "expected_count": null, + "actual_count": null, + "complete": true, + "id": "g0129", + "split": "test", + "category": "same_academic_year_pair", + "difficulty": "hard", + "question": "Aký rok práce spája osoby Ján Malinovský a Martin Šarišský?", + "latency_seconds": 0.032707, + "error": null, + "strict": false, + "value_score": 0.666667, + "entity_score": 0.0, + "relation_score": 1.0, + "property_score": 0.0, + "relation_choice_score": 0.0, + "document_recall": 1.0, + "source_recall": 1.0, + "expected_values": [ + "Ján Malinovský", + "Martin Šarišský", + "2026" + ], + "matched_values": [ + "Ján Malinovský", + "Martin Šarišský" + ], + "expected_entities": [ + { + "type": "year", + "value": "2026" + } + ], + "matched_entities": [], + "expected_relations": [], + "actual_relations": [], + "matched_relations": [], + "expected_properties": [ + "Thesis.year|Work.year", + "Thesis.year|Work.year" + ], + "matched_properties": [], + "relation_choices": [ + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + }, + { + "choices": [ + "AUTHORED", + "HAS_WORK" + ], + "matched": false + } + ], + "expected_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "actual_documents": [ + "pages/students/2017/martin_jancura/README.md", + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "matched_documents": [ + "pages/students/2021/martin_sarissky/README.md", + "pages/students/2022/jan_malinovsky/README.md" + ], + "expected_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "actual_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura", + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "matched_source_urls": [ + "https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky", + "https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky" + ], + "entity_set_expected": [], + "entity_set_actual": [], + "entity_set_mode": null, + "entity_set_ok": true, + "strategies": [ + "entity_resolution" + ], + "fact_types": [ + "academic_year_comparison" + ] + } + ] +} diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/source_audit.json b/tools/graphrag/evaluation/results/final_2026-10-24/source_audit.json new file mode 100644 index 0000000..d9bca50 --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/source_audit.json @@ -0,0 +1,3804 @@ +{ + "method": "Static source checks; no retrieval output, question rewriting or alias invention.", + "questions": [ + { + "id": "g0001", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0002", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0003", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0004", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0005", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0006", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0007", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0008", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0009", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0010", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0011", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0012", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0013", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0014", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0015", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0016", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0017", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0018", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0019", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0020", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0021", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0022", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0023", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0024", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0025", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0026", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0027", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0028", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0029", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0030", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0031", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0032", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0033", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0034", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0035", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0036", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0037", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0038", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0039", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0040", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0041", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0042", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0043", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0044", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0045", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0046", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0047", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0048", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0049", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0050", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0051", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0052", + "split": "test", + "category": "shared_keyword_pair", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0053", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0054", + "split": "dev", + "category": "shared_keyword_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0055", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0056", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0057", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0058", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0059", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0060", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0061", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0062", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0063", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0064", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0065", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0066", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0067", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0068", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0069", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0070", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0071", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0072", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0073", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0074", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0075", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0076", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0077", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0078", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0079", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0080", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0081", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0082", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0083", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0084", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0085", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0086", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0087", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0088", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0089", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0090", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0091", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0092", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0093", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0094", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0095", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0096", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0097", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0098", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0099", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0100", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0101", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0102", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0103", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0104", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0105", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0106", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0107", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0108", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0109", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0110", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0111", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0112", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0113", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0114", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0115", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0116", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0117", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0118", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0119", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0120", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0121", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0122", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0123", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0124", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0125", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0126", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0127", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0128", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0129", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0130", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0131", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0132", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0133", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0134", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0135", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0136", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0137", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0138", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0139", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0140", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0141", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0142", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0143", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0144", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0145", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0146", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0147", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0148", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0149", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0150", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0151", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0152", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0153", + "split": "dev", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0154", + "split": "test", + "category": "same_academic_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0155", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0156", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0157", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0158", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0159", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0160", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0161", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0162", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0163", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0164", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0165", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0166", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0167", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0168", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0169", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0170", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0171", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0172", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0173", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0174", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0175", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0176", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0177", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0178", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0179", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0180", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0181", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0182", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0183", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0184", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0185", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0186", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0187", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0188", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0189", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0190", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0191", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0192", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0193", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0194", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0195", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0196", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0197", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0198", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0199", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0200", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0201", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0202", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0203", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0204", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0205", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0206", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0207", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0208", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0209", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0210", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0211", + "split": "dev", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0212", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0213", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0214", + "split": "test", + "category": "same_start_year_pair", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0215", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0216", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0217", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0218", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0219", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0220", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0221", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0222", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0223", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0224", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0225", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0226", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0227", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0228", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0229", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0230", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0231", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0232", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0233", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0234", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0235", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0236", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0237", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0238", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0239", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0240", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0241", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0242", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0243", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0244", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0245", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0246", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0247", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0248", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0249", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0250", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0251", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0252", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0253", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0254", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0255", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0256", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0257", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0258", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0259", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0260", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0261", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0262", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0263", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0264", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0265", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0266", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0267", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0268", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0269", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0270", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0271", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0272", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0273", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0274", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0275", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0276", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0277", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0278", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0279", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0280", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0281", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0282", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0283", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0284", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0285", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0286", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0287", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0288", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0289", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0290", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0291", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0292", + "split": "test", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0293", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0294", + "split": "dev", + "category": "person_title_year", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0295", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0296", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0297", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0298", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0299", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0300", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0301", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0302", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0303", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0304", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0305", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0306", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0307", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0308", + "split": "test", + "category": "person_keyword_title", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0309", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0310", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0311", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0312", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0313", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0314", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0315", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0316", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0317", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0318", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0319", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0320", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0321", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0322", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0323", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0324", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0325", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0326", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0327", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0328", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0329", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0330", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0331", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0332", + "split": "test", + "category": "person_keyword_title", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0333", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0334", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0335", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0336", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0337", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0338", + "split": "test", + "category": "person_keyword_title", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0339", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0340", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0341", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0342", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0343", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0344", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0345", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0346", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0347", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0348", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0349", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0350", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0351", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0352", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0353", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0354", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0355", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0356", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0357", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0358", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0359", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0360", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0361", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0362", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0363", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0364", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0365", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0366", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0367", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0368", + "split": "dev", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0369", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0370", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0371", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0372", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0373", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0374", + "split": "test", + "category": "person_keyword_title", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0375", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0376", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0377", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0378", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0379", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0380", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0381", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0382", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0383", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0384", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0385", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0386", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0387", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0388", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0389", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0390", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0391", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0392", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0393", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0394", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0395", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0396", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0397", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0398", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0399", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0400", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0401", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0402", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0403", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0404", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0405", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0406", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0407", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0408", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0409", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0410", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0411", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0412", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0413", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0414", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0415", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0416", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0417", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0418", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0419", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0420", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0421", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0422", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0423", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0424", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0425", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0426", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0427", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0428", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0429", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0430", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0431", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0432", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0433", + "split": "dev", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0434", + "split": "test", + "category": "document_author_category_multi_hop", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0435", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0436", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0437", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0438", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0439", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0440", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0441", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0442", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0443", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0444", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0445", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0446", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0447", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0448", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0449", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0450", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0451", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0452", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0453", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0454", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0455", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0456", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0457", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0458", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": false, + "issues": [ + "exact_categories_omit_or_add_source_categories" + ] + }, + { + "id": "g0459", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0460", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0461", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0462", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0463", + "split": "test", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0464", + "split": "dev", + "category": "person_multiple_categories", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0465", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0466", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0467", + "split": "test", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0468", + "split": "test", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0469", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0470", + "split": "test", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0471", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0472", + "split": "test", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0473", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0474", + "split": "test", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0475", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0476", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0477", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0478", + "split": "test", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0479", + "split": "test", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0480", + "split": "dev", + "category": "candidate_set_aggregation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0481", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0482", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0483", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0484", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0485", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0486", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0487", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0488", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0489", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0490", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0491", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0492", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0493", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0494", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_linked_to_expected_person" + ] + }, + { + "id": "g0495", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0496", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0497", + "split": "test", + "category": "conjunctive_disambiguation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0498", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": true, + "issues": [] + }, + { + "id": "g0499", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": false, + "issues": [ + "keyword_not_in_frontmatter_catalog" + ] + }, + { + "id": "g0500", + "split": "dev", + "category": "conjunctive_disambiguation", + "source_consistent": true, + "issues": [] + } + ], + "by_split": { + "dev": { + "questions": 286, + "source_consistent": 209, + "issues": { + "keyword_not_in_frontmatter_catalog": 66, + "keyword_not_linked_to_expected_person": 5, + "exact_categories_omit_or_add_source_categories": 6 + } + }, + "test": { + "questions": 214, + "source_consistent": 154, + "issues": { + "keyword_not_in_frontmatter_catalog": 46, + "keyword_not_linked_to_expected_person": 11, + "exact_categories_omit_or_add_source_categories": 3 + } + } + }, + "dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e", + "inputs": { + "data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52", + "data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9" + } +} diff --git a/tools/graphrag/evaluation/results/final_2026-10-24/summary.json b/tools/graphrag/evaluation/results/final_2026-10-24/summary.json new file mode 100644 index 0000000..822d775 --- /dev/null +++ b/tools/graphrag/evaluation/results/final_2026-10-24/summary.json @@ -0,0 +1,117 @@ +{ + "generated_at_utc": "2026-10-24T19:05:45.204482+00:00", + "freeze_sha256": "2277226cbefa6337e04b5642da1145e1a11c48bbb05cf90de7ee5a7dbc71d806", + "dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e", + "primary_metric": "Strict accuracy over ALL questions; no exclusions.", + "supplementary_metric": "Strict accuracy on the source-consistent subset declared by static audit before TEST.", + "baseline_dev_same_evaluator": { + "questions": 286, + "strict_count": 106, + "strict_accuracy": 0.370629, + "error_count": 0, + "value_score": 0.772494, + "entity_score": 0.624126, + "relation_score": 0.853147, + "property_score": 0.793706, + "relation_choice_score": 0.870629, + "document_recall": 1.0, + "source_recall": 0.900058, + "latency_mean_seconds": 0.029989, + "latency_median_seconds": 0.028124, + "latency_p95_seconds": 0.041821 + }, + "dev": { + "questions": 286, + "strict_count": 209, + "strict_accuracy": 0.730769, + "error_count": 0, + "value_score": 0.751748, + "entity_score": 0.751748, + "relation_score": 0.751748, + "property_score": 0.835664, + "relation_choice_score": 0.968531, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.032786, + "latency_median_seconds": 0.03221, + "latency_p95_seconds": 0.041831 + }, + "test": { + "questions": 214, + "strict_count": 152, + "strict_accuracy": 0.71028, + "error_count": 0, + "value_score": 0.735202, + "entity_score": 0.726636, + "relation_score": 0.738318, + "property_score": 0.794393, + "relation_choice_score": 0.953271, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.029583, + "latency_median_seconds": 0.029331, + "latency_p95_seconds": 0.033782 + }, + "dev_source_consistent": { + "questions": 209, + "strict_count": 209, + "strict_accuracy": 1.0, + "error_count": 0, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.033557, + "latency_median_seconds": 0.033169, + "latency_p95_seconds": 0.041472 + }, + "test_source_consistent": { + "questions": 154, + "strict_count": 152, + "strict_accuracy": 0.987013, + "error_count": 0, + "value_score": 0.995671, + "entity_score": 0.987013, + "relation_score": 1.0, + "property_score": 0.987013, + "relation_choice_score": 0.987013, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_mean_seconds": 0.030486, + "latency_median_seconds": 0.030564, + "latency_p95_seconds": 0.033949 + }, + "source_audit": { + "dev": { + "questions": 286, + "source_consistent": 209, + "issues": { + "keyword_not_in_frontmatter_catalog": 66, + "keyword_not_linked_to_expected_person": 5, + "exact_categories_omit_or_add_source_categories": 6 + } + }, + "test": { + "questions": 214, + "source_consistent": 154, + "issues": { + "keyword_not_in_frontmatter_catalog": 46, + "keyword_not_linked_to_expected_person": 11, + "exact_categories_omit_or_add_source_categories": 3 + } + } + }, + "unit_and_integration_tests": { + "passed": 359, + "skipped": 4, + "neo4j_integration_cases": 10 + }, + "holdout_failures_without_source_audit_issues": [ + "g0065", + "g0129" + ], + "post_test_code_changes": false +} diff --git a/tools/graphrag/graph_search.py b/tools/graphrag/graph_search.py index 320611e..923ee29 100644 --- a/tools/graphrag/graph_search.py +++ b/tools/graphrag/graph_search.py @@ -719,6 +719,24 @@ def has_stem( ) +def explicit_keyword_phrase(query: str) -> str | None: + """Identify a requested tag without treating 'ZP Wiki' as the tag ZP.""" + match = re.search( + r"\b(?:klucove\s+slovo|klucovym\s+slovom|klucoveho\s+slova|" + r"tagom|tagu|tag)\s+(.+)", + normalize_for_match(query), + ) + if not match: + return None + phrase = re.split( + r"\s+(?:a\s+(?:jej|jeho|ich|rok)|ak\s+|uved\w*\s+|" + r"pomenuj\s+|maju\s+|ma\s+)", + match.group(1), + maxsplit=1, + )[0].strip() + return phrase or None + + def extract_query_constraints( query: str, ) -> dict[str, Any]: @@ -904,10 +922,13 @@ def extract_query_constraints( ) mentions_title = ( - has_stem( - tokens, - "nazov", - ) + has_stem(tokens, "nazov") or has_stem(tokens, "nazv") + or (has_work_word and "vola" in token_set) + ) + mentions_academic_year = ( + has_work_word + and bool(token_set & {"rok", "roka", "roku", "rokom", "roky", "rokoch"}) + and not mentions_start_year ) mentions_shared = ( @@ -919,6 +940,7 @@ def extract_query_constraints( tokens, "rovnak", ) + or (mentions_academic_year and has_stem(tokens, "spaj")) ) mentions_person_answer = ( @@ -1056,6 +1078,9 @@ def extract_query_constraints( "mentions_title": ( mentions_title ), + "mentions_academic_year": mentions_academic_year, + "keyword_phrase": explicit_keyword_phrase(query), + "mentions_count": bool(token_set & {"kolko", "pocet", "spocitaj"}), "mentions_shared": ( mentions_shared ), @@ -2113,677 +2138,244 @@ def build_facts( return facts +PERSON_DOCUMENT_AUTHOR_FACTS_QUERY = """ +MATCH (person:Person)-[:HAS_DOCUMENT]->(document:Document) +MATCH (author:DocumentAuthor)-[:AUTHORED_DOCUMENT]->(document) +WHERE person.graph_scope = $scope AND document.graph_scope = $scope + AND author.graph_scope = $scope + AND (size($person_ids) = 0 OR elementId(person) IN $person_ids) + AND (size($author_ids) = 0 OR elementId(author) IN $author_ids) + AND (size($category_ids) = 0 OR EXISTS { + MATCH (document)-[:IN_CATEGORY]->(category:Category) + WHERE category.graph_scope = $scope AND elementId(category) IN $category_ids + }) +RETURN DISTINCT elementId(person) AS person_element_id, person.name AS person, + elementId(author) AS document_author_element_id, author.name AS document_author, + document.path AS document_path, document.source_url AS source_url +ORDER BY person, document_author, document_path +LIMIT $limit +""" + +DOCUMENT_SOURCES_QUERY = """ +MATCH (document:Document) +WHERE document.graph_scope = $scope AND document.path IN $paths +RETURN document.path AS document_path, document.source_url AS source_url +ORDER BY document_path +""" + + def search_graph_with_session( session: Any, query: str, *, - limit: int = ( - DEFAULT_LIMIT - ), - max_entities: int = ( - DEFAULT_MAX_ENTITIES - ), + limit: int = DEFAULT_LIMIT, + max_entities: int = DEFAULT_MAX_ENTITIES, ) -> dict[str, Any]: - clean_query = str( - query - or "" - ).strip() - + clean_query = str(query or "").strip() if not clean_query: - raise ValueError( - "Query nesmie byť prázdny" - ) - + raise ValueError("Query nesmie byť prázdny") if limit < 1: - raise ValueError( - "Limit musí byť aspoň 1" - ) - + raise ValueError("Limit musí byť aspoň 1") if max_entities < 1: - raise ValueError( - "max_entities musí byť aspoň 1" - ) + raise ValueError("max_entities musí byť aspoň 1") - constraints = ( - extract_query_constraints( - clean_query - ) + constraints = extract_query_constraints(clean_query) + catalog = run_rows(session, CATALOG_QUERY, scope=GRAPH_SCOPE) + # Explicit tag filters are resolved separately. Incidental names such as the + # tag 'zp' in 'ZP Wiki' must never become additional query constraints. + phrase = constraints["keyword_phrase"] + entities = resolve_entities( + clean_query, catalog, max_entities=max(len(catalog), max_entities), + preferred_kinds=constraints["target_kinds"], ) + if phrase: + keywords = resolve_entities( + phrase, [row for row in catalog if row.get("kind") == "Keyword"], + max_entities=max_entities, + ) + entities = [row for row in entities if row.get("kind") != "Keyword"] + keywords + constraints["unresolved_keyword"] = not bool(keywords) + else: + constraints["unresolved_keyword"] = False - catalog = run_rows( - session, - CATALOG_QUERY, - scope=GRAPH_SCOPE, - ) + # Preserve explicitly mentioned people when a longer topic/title also matches. + entities.sort(key=lambda row: (row.get("kind") != "Person", -row["match_score"])) + resolved_entities = entities[:max_entities] + entity_limit_reached = len(entities) > max_entities - resolved_entities = ( - resolve_entities( - clean_query, - catalog, - max_entities=( - max_entities - ), - preferred_kinds=( - constraints[ - "target_kinds" - ] - ), - ) - ) - - start_ids = [ - str( - entity[ - "element_id" - ] - ) - for entity - in resolved_entities - if entity.get( - "element_id" - ) - ] - - person_ids = [ - str( - entity[ - "element_id" - ] - ) - for entity - in resolved_entities - if ( - entity.get( - "element_id" - ) - and entity.get( - "kind" - ) - == "Person" - ) - ] - - thesis_ids = [ - str( - entity[ - "element_id" - ] - ) - for entity - in resolved_entities - if ( - entity.get( - "element_id" - ) - and entity.get( - "kind" - ) - == "Thesis" - ) - ] - - work_ids = [ - str( - entity[ - "element_id" - ] - ) - for entity - in resolved_entities - if ( - entity.get( - "element_id" - ) - and entity.get( - "kind" - ) - == "Work" - ) - ] - - keyword_ids = [ - str( - entity[ - "element_id" - ] - ) - for entity - in resolved_entities - if ( - entity.get( - "element_id" - ) - and entity.get( - "kind" - ) - == "Keyword" - ) - ] - - category_ids = [ - str( - entity[ - "element_id" - ] - ) - for entity - in resolved_entities - if ( - entity.get( - "element_id" - ) - and entity.get( - "kind" - ) - == "Category" - ) - ] - - year_specific = bool( - constraints[ - "years" - ] - and not constraints[ - "mentions_start_year" - ] - ) - - title_specific = ( - constraints[ - "mentions_title" - ] - ) + def ids(kind: str) -> list[str]: + return [str(row["element_id"]) for row in resolved_entities + if row.get("kind") == kind and row.get("element_id")] + person_ids = ids("Person") + thesis_ids, work_ids = ids("Thesis"), ids("Work") + keyword_ids, category_ids = ids("Keyword"), ids("Category") + author_ids = ids("DocumentAuthor") + year_specific = bool(constraints["years"] or constraints["mentions_academic_year"]) + title_specific = constraints["mentions_title"] thesis_specific = bool( - constraints[ - "mentions_thesis" - ] - or thesis_ids - or ( - title_specific - and not constraints[ - "mentions_work" - ] - ) - or ( - year_specific - and not constraints[ - "mentions_work" - ] - ) - ) - + constraints["mentions_thesis"] or thesis_ids + or ((title_specific or year_specific) and not constraints["mentions_work"]) + ) and not constraints["mentions_start_year"] work_specific = bool( - constraints[ - "mentions_work" - ] - or work_ids - or ( - title_specific - and not constraints[ - "mentions_thesis" - ] - ) - or ( - year_specific - and not constraints[ - "mentions_thesis" - ] - ) + constraints["mentions_work"] or work_ids + or ((title_specific or year_specific) and not constraints["mentions_thesis"]) + ) and not constraints["mentions_start_year"] + shared_keyword = bool( + constraints["mentions_shared"] and len(person_ids) >= 2 + and (constraints["mentions_keyword"] or constraints["mentions_topic"]) ) - - shared_keyword_query = bool( - constraints[ - "mentions_shared" - ] - and len( - person_ids - ) - >= 2 - and ( - constraints[ - "mentions_keyword" - ] - or constraints[ - "mentions_topic" - ] - ) + shared_category = bool( + constraints["mentions_shared"] and len(person_ids) >= 2 + and constraints["mentions_category"] ) - - shared_category_query = bool( - constraints[ - "mentions_shared" - ] - and len( - person_ids - ) - >= 2 - and constraints[ - "mentions_category" - ] + shared_author = bool( + constraints["mentions_shared"] and len(person_ids) >= 2 + and constraints["mentions_document_author"] ) - - shared_document_author_query = ( - bool( - constraints[ - "mentions_shared" - ] - and len( - person_ids - ) - >= 2 - and constraints[ - "mentions_document_author" - ] - ) - ) - keyword_specific = bool( - not constraints[ - "mentions_shared" - ] - and ( - keyword_ids - or ( - person_ids - and constraints[ - "mentions_keyword" - ] - ) + not shared_keyword and ( + (keyword_ids and not (thesis_specific or work_specific)) + or (person_ids and constraints["mentions_keyword"]) ) ) - category_specific = bool( - not constraints[ - "mentions_shared" - ] - and ( - category_ids - or ( - person_ids - and constraints[ - "mentions_category" - ] - ) - ) + not shared_category and (category_ids or (person_ids and constraints["mentions_category"])) ) + author_specific = bool(not shared_author and constraints["mentions_document_author"]) + structured = any(( + thesis_specific, work_specific, constraints["mentions_start_year"], + keyword_specific, category_specific, author_specific, + shared_keyword, shared_category, shared_author, + )) + # Fetch complete structured evidence before filtering/counting and applying + # the presentation limit. The catalog bounds the number of academic nodes; + # relational lookups use a conservative bound covering the managed graph. + fetch_limit = max(limit, len(catalog) ** 2) + common = {"scope": GRAPH_SCOPE, "person_ids": person_ids, "limit": fetch_limit} + blocked = constraints["unresolved_keyword"] + # A quoted unknown work title is a failed exact lookup, not a global listing. + quoted_titles = re.findall(r'[„“"«]([^„“”"»]+)[“”"»]', clean_query) + if quoted_titles and (thesis_specific or work_specific) and not thesis_ids and not work_ids: + blocked = True + constraints["unresolved_title"] = True - structured_query = ( - thesis_specific - or work_specific - or constraints[ - "mentions_start_year" - ] - or keyword_specific - or category_specific - or shared_keyword_query - or shared_category_query - or shared_document_author_query - ) + def fetch(enabled: bool, cypher: str, **params: Any) -> list[dict[str, Any]]: + return run_rows(session, cypher, **common, **params) if enabled and not blocked else [] - paths: list[ - dict[str, Any] - ] = [] + thesis_rows = fetch(thesis_specific, THESIS_FACTS_QUERY, + thesis_ids=thesis_ids, years=constraints["years"], + thesis_types=constraints["thesis_types"]) + work_rows = fetch(work_specific, WORK_FACTS_QUERY, + work_ids=work_ids, years=constraints["years"], + work_types=constraints["work_types"]) + start_rows = fetch(constraints["mentions_start_year"], START_YEAR_FACTS_QUERY, + years=constraints["years"]) + keyword_rows = fetch(keyword_specific, PERSON_KEYWORD_FACTS_QUERY, keyword_ids=keyword_ids) + category_rows = fetch(category_specific, PERSON_CATEGORY_FACTS_QUERY, category_ids=category_ids) + author_rows = fetch(author_specific, PERSON_DOCUMENT_AUTHOR_FACTS_QUERY, + author_ids=author_ids, category_ids=category_ids) + shared_keyword_rows = fetch(shared_keyword, SHARED_KEYWORD_FACTS_QUERY) + if keyword_ids: + shared_keyword_rows = [row for row in shared_keyword_rows + if str(row.get("keyword_element_id")) in keyword_ids] + shared_category_rows = fetch(shared_category, SHARED_CATEGORY_FACTS_QUERY) + if category_ids: + shared_category_rows = [row for row in shared_category_rows + if str(row.get("category_element_id")) in category_ids] + shared_author_rows = fetch(shared_author, SHARED_DOCUMENT_AUTHOR_FACTS_QUERY) - if thesis_specific: - paths.extend( - run_rows( - session, - THESIS_PATHS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - thesis_ids=( - thesis_ids - ), - years=( - constraints[ - "years" - ] - ), - thesis_types=( - constraints[ - "thesis_types" - ] - ), - limit=limit, - ) - ) + # Conjunctions must be witnessed by the same person, not by unrelated rows. + if keyword_specific and (thesis_specific or work_specific): + matching_people = {row.get("person_element_id") for row in keyword_rows} + thesis_rows = [row for row in thesis_rows if row.get("person_element_id") in matching_people] + work_rows = [row for row in work_rows if row.get("person_element_id") in matching_people] + academic_people = {row.get("person_element_id") for row in thesis_rows + work_rows} + keyword_rows = [row for row in keyword_rows if row.get("person_element_id") in academic_people] - if work_specific: - paths.extend( - run_rows( - session, - WORK_PATHS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - work_ids=( - work_ids - ), - years=( - constraints[ - "years" - ] - ), - work_types=( - constraints[ - "work_types" - ] - ), - limit=limit, - ) - ) + shared_years: list[int] | None = None + if (constraints["mentions_academic_year"] and constraints["mentions_shared"] + and len(person_ids) >= 2 and not (shared_keyword or shared_category or shared_author)): + years_by_person = { + person: {row["year"] for row in thesis_rows + work_rows + if row.get("person_element_id") == person and row.get("year") is not None} + for person in person_ids + } + shared_years = sorted(set.intersection(*years_by_person.values())) + thesis_rows = [row for row in thesis_rows if row.get("year") in shared_years] + work_rows = [row for row in work_rows if row.get("year") in shared_years] - if ( - not structured_query - and start_ids + paths: list[dict[str, Any]] = [] + for enabled, cypher, rows, kind, node_ids, types in ( + (thesis_specific, THESIS_PATHS_QUERY, thesis_rows, "Thesis", thesis_ids, constraints["thesis_types"]), + (work_specific, WORK_PATHS_QUERY, work_rows, "Work", work_ids, constraints["work_types"]), ): - if ( - constraints[ - "mentions_shared" - ] - and len( - start_ids - ) - >= 2 - ): - paths.extend( - run_rows( - session, - PAIR_PATH_QUERY, - scope=GRAPH_SCOPE, - start_ids=( - start_ids - ), - limit=limit, - ) - ) - + params = ({"thesis_ids": node_ids, "thesis_types": types} if kind == "Thesis" + else {"work_ids": node_ids, "work_types": types}) + returned = fetch(enabled, cypher, years=constraints["years"], **params) + allowed = {str(row.get("thesis_element_id") or row.get("work_element_id")) for row in rows} + paths.extend(path for path in returned if any( + node.get("kind") == kind and str(node.get("element_id")) in allowed + for node in path.get("nodes", []) + )) + if not structured and resolved_entities and not blocked: + start_ids = [str(row["element_id"]) for row in resolved_entities] + params = {"scope": GRAPH_SCOPE, "start_ids": start_ids, "limit": limit} + if constraints["mentions_shared"] and len(start_ids) >= 2: + paths.extend(run_rows(session, PAIR_PATH_QUERY, **params)) else: - paths.extend( - run_rows( - session, - NEIGHBORHOOD_QUERY, - scope=GRAPH_SCOPE, - start_ids=( - start_ids - ), - target_kinds=( - constraints[ - "target_kinds" - ] - ), - limit=limit, - ) - ) - - thesis_rows: list[ - dict[str, Any] - ] = [] - - if thesis_specific: - thesis_rows = run_rows( - session, - THESIS_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - thesis_ids=( - thesis_ids - ), - years=( - constraints[ - "years" - ] - ), - thesis_types=( - constraints[ - "thesis_types" - ] - ), - limit=limit, - ) - - work_rows: list[ - dict[str, Any] - ] = [] - - if work_specific: - work_rows = run_rows( - session, - WORK_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - work_ids=( - work_ids - ), - years=( - constraints[ - "years" - ] - ), - work_types=( - constraints[ - "work_types" - ] - ), - limit=limit, - ) - - start_year_rows: list[ - dict[str, Any] - ] = [] - - if constraints[ - "mentions_start_year" - ]: - start_year_rows = ( - run_rows( - session, - START_YEAR_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - years=( - constraints[ - "years" - ] - ), - limit=limit, - ) - ) - - person_keyword_rows: list[ - dict[str, Any] - ] = [] - - if keyword_specific: - person_keyword_rows = ( - run_rows( - session, - PERSON_KEYWORD_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - keyword_ids=( - keyword_ids - ), - limit=limit, - ) - ) - - person_category_rows: list[ - dict[str, Any] - ] = [] - - if category_specific: - person_category_rows = ( - run_rows( - session, - PERSON_CATEGORY_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - category_ids=( - category_ids - ), - limit=limit, - ) - ) - - shared_keyword_rows: list[ - dict[str, Any] - ] = [] - - if shared_keyword_query: - shared_keyword_rows = ( - run_rows( - session, - SHARED_KEYWORD_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - limit=limit, - ) - ) - - shared_category_rows: list[ - dict[str, Any] - ] = [] - - if shared_category_query: - shared_category_rows = ( - run_rows( - session, - SHARED_CATEGORY_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - limit=limit, - ) - ) - - shared_document_author_rows: list[ - dict[str, Any] - ] = [] - - if shared_document_author_query: - shared_document_author_rows = ( - run_rows( - session, - SHARED_DOCUMENT_AUTHOR_FACTS_QUERY, - scope=GRAPH_SCOPE, - person_ids=( - person_ids - ), - limit=limit, - ) - ) - - paths = deduplicate_paths( - paths - ) - + paths.extend(run_rows(session, NEIGHBORHOOD_QUERY, + target_kinds=constraints["target_kinds"], **params)) + paths = deduplicate_paths(paths) facts = build_facts( - thesis_rows, - work_rows, - start_year_rows, - person_keyword_rows, - person_category_rows, - shared_keyword_rows, - shared_category_rows, - shared_document_author_rows, - mentions_shared=( - constraints[ - "mentions_shared" - ] - ), + thesis_rows, work_rows, start_rows, keyword_rows, category_rows, + shared_keyword_rows, shared_category_rows, shared_author_rows, + mentions_shared=constraints["mentions_shared"], ) + for row in author_rows: + facts.append({**row, "fact_type": "person_document_author"}) + if shared_years is not None: + facts.append({"fact_type": "academic_year_comparison", "shared_years": shared_years, + "same_academic_year": bool(shared_years), + "people": [row["name"] for row in resolved_entities if row.get("kind") == "Person"]}) - documents = collect_documents( - resolved_entities, - paths, - facts, - ) - - strategies: list[ - str - ] = [] - - if resolved_entities: - strategies.append( - "entity_resolution" - ) - - if paths: - strategies.append( - "graph_traversal" - ) - - if thesis_rows: - strategies.append( - "thesis_constraints" - ) - - if work_rows: - strategies.append( - "work_constraints" - ) - - if start_year_rows: - strategies.append( - "start_year_constraints" - ) - - if person_keyword_rows: - strategies.append( - "person_keyword_constraints" - ) - - if person_category_rows: - strategies.append( - "person_category_constraints" - ) - - if shared_keyword_rows: - strategies.append( - "shared_keyword_constraints" - ) - - if shared_category_rows: - strategies.append( - "shared_category_constraints" - ) - - if shared_document_author_rows: - strategies.append( - "shared_document_author_constraints" - ) + aggregation = None + if constraints["mentions_count"]: + matching = sorted({str(row["person"]) for row in thesis_rows + work_rows}) + aggregation = {"count": len(matching), "people": matching, + "candidate_count": len(person_ids), "complete": not entity_limit_reached} + # Sources of rejected candidates still document the comparison. Fetch their + # actual stored URLs rather than manufacturing URLs from expected answers. + documents = collect_documents(resolved_entities, paths, facts) + sources = run_rows(session, DOCUMENT_SOURCES_QUERY, scope=GRAPH_SCOPE, + paths=[row["document_path"] for row in documents]) if documents else [] + by_path = {row["document_path"]: row.get("source_url") for row in sources} + for document in documents: + if not document.get("source_url"): + document["source_url"] = by_path.get(document["document_path"]) + strategies = [] + for active, name in ( + (resolved_entities, "entity_resolution"), (paths, "graph_traversal"), + (thesis_rows, "thesis_constraints"), (work_rows, "work_constraints"), + (start_rows, "start_year_constraints"), (keyword_rows, "person_keyword_constraints"), + (category_rows, "person_category_constraints"), (author_rows, "person_document_author_constraints"), + (shared_keyword_rows, "shared_keyword_constraints"), + (shared_category_rows, "shared_category_constraints"), + (shared_author_rows, "shared_document_author_constraints"), + ): + if active: + strategies.append(name) return { - "query": clean_query, - "strategies": strategies, - "constraints": constraints, - "resolved_entities": ( - resolved_entities - ), - "paths": paths[:limit], - "facts": facts[:limit], - "documents": documents, + "query": clean_query, "strategies": strategies, "constraints": constraints, + "resolved_entities": resolved_entities, "paths": paths[:limit], "facts": facts[:limit], + "documents": documents, "aggregation": aggregation, + "truncated": entity_limit_reached or len(facts) > limit or len(paths) > limit, } + + def search_graph( query: str, *, diff --git a/tools/graphrag/graphrag.py b/tools/graphrag/graphrag.py index 3821829..721fc77 100644 --- a/tools/graphrag/graphrag.py +++ b/tools/graphrag/graphrag.py @@ -833,6 +833,163 @@ def extract_explicit_proposal_title( ) +ROOT_PROFILE_TITLE_LABELS = { + "nazov", + "nazov prace", + "nazov bakalarskej prace", + "nazov diplomovej prace", + "predbezny nazov", +} + + +def extract_profile_root_title( + chunks: list[dict[str, Any]], +) -> tuple[str | None, list[str]]: + candidates: dict[ + str, + dict[str, Any], + ] = {} + + for chunk in sorted( + chunks, + key=lambda item: int( + item.get( + "chunk_index", + 0, + ) + ), + ): + text = str( + chunk.get( + "text", + "", + ) + ) + + if not text: + continue + + has_section_marker = any( + normalize_text( + strip_list_prefix( + line + ) + ).startswith( + "sekcia:" + ) + for line in text.splitlines() + ) + + if has_section_marker: + continue + + title = extract_labeled_title( + [text], + ROOT_PROFILE_TITLE_LABELS, + ) + + if not title: + continue + + normalized_title = normalize_text( + title + ) + + candidate = candidates.setdefault( + normalized_title, + { + "title": title, + "chunk_ids": set(), + }, + ) + + chunk_id = chunk.get( + "chunk_id" + ) + + if chunk_id: + candidate[ + "chunk_ids" + ].add( + str(chunk_id) + ) + + if len(candidates) != 1: + return None, [] + + candidate = next( + iter( + candidates.values() + ) + ) + + return ( + str( + candidate["title"] + ), + sorted( + candidate[ + "chunk_ids" + ] + ), + ) + + +def latest_thesis_category( + categories: list[str], +) -> tuple[str, int] | None: + candidates: list[ + tuple[str, int] + ] = [] + + for category in categories: + work_type, year = ( + parse_category( + category + ) + ) + + if ( + work_type + not in THESIS_TYPES + or year is None + ): + continue + + candidates.append( + ( + work_type, + year, + ) + ) + + if not candidates: + return None + + latest_year = max( + year + for _, year + in candidates + ) + + latest = sorted( + { + ( + work_type, + year, + ) + for work_type, year + in candidates + if year == latest_year + } + ) + + if len(latest) != 1: + return None + + return latest[0] + + def extract_start_year( path: str, chunks: list[dict[str, Any]], @@ -1106,6 +1263,98 @@ def extract_works( } ) + ( + root_title, + root_title_chunk_ids, + ) = extract_profile_root_title( + chunks + ) + + thesis_category = ( + latest_thesis_category( + categories + ) + ) + + if ( + root_title + and thesis_category + ): + ( + thesis_type, + thesis_year, + ) = thesis_category + + matching_theses = [ + item + for item in result + if ( + item[ + "work_type" + ] + == thesis_type + and item[ + "year" + ] + == thesis_year + ) + ] + + if len( + matching_theses + ) == 1: + existing = ( + matching_theses[0] + ) + + if existing[ + "title" + ] is None: + existing[ + "title" + ] = root_title + + existing[ + "source_chunk_ids" + ] = sorted( + set( + existing[ + "source_chunk_ids" + ] + ) + | set( + root_title_chunk_ids + ) + ) + + elif not matching_theses: + result.append( + { + "work_type": ( + thesis_type + ), + "work_type_label": ( + WORK_TYPE_LABELS[ + thesis_type + ] + ), + "heading": ( + WORK_TYPE_LABELS[ + thesis_type + ] + + " " + + str( + thesis_year + ) + ), + "year": thesis_year, + "title": root_title, + "source_chunk_ids": ( + root_title_chunk_ids + ), + } + ) + return sorted( result, key=lambda item: ( diff --git a/tools/graphrag/tests/test_graph_search_neo4j.py b/tools/graphrag/tests/test_graph_search_neo4j.py new file mode 100644 index 0000000..0157a6f --- /dev/null +++ b/tools/graphrag/tests/test_graph_search_neo4j.py @@ -0,0 +1,118 @@ +"""Optional real Cypher regressions; all fixtures are rolled back.""" +from __future__ import annotations + +import os +import uuid + +import pytest + +from tools.graphrag import graph_search as gs +from tools.graphrag.graph_db import create_neo4j_driver, get_neo4j_settings + +pytestmark = pytest.mark.skipif(os.getenv('RUN_NEO4J_TESTS') != '1', reason='Set RUN_NEO4J_TESTS=1 for isolated Neo4j regressions.') + + +@pytest.fixture +def graph(monkeypatch): + scope = 'regression-' + uuid.uuid4().hex + monkeypatch.setattr(gs, 'GRAPH_SCOPE', scope) + category = 'regcat-' + uuid.uuid4().hex + settings = get_neo4j_settings() + with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session: + tx = session.begin_transaction() + try: + for suffix, name, year, tag in [('a', 'Alena Nová', 2024, 'alpha'), + ('b', 'Boris Iný', 2024, 'beta'), + ('c', 'Cyril Malý', 2025, 'alpha')]: + tx.run('CREATE (p:Person {id:$id, name:$name, source_document:$path, graph_scope:$scope}) ' + 'CREATE (d:Document {path:$path, source_url:$url, graph_scope:$scope}) ' + 'CREATE (t:Thesis {id:$thesis, title:$title, year:$year, thesis_type:"bachelor_thesis", graph_scope:$scope}) ' + 'MERGE (k:Keyword {id:$keyword, name:$tag, graph_scope:$scope}) ' + 'CREATE (p)-[:HAS_DOCUMENT]->(d)-[:HAS_KEYWORD]->(k) ' + 'CREATE (p)-[:AUTHORED]->(t)-[:EVIDENCED_BY]->(d)', + id=scope+suffix, name=name, path=scope+'/'+suffix+'.md', + url='https://example.test/'+suffix, scope=scope, thesis=scope+'th'+suffix, + title='Výskum '+suffix, year=year, keyword=scope+tag, tag=tag).consume() + tx.run('MATCH (p:Person {id:$person})-[:HAS_DOCUMENT]->(d) ' + 'CREATE (c:Category {name:$category, graph_scope:$scope}) ' + 'CREATE (a:DocumentAuthor {id:$author, name:"Autor Správny", graph_scope:$scope}) ' + 'CREATE (d)-[:IN_CATEGORY]->(c) CREATE (a)-[:AUTHORED_DOCUMENT]->(d) ' + 'CREATE (child:Document {path:$child, graph_scope:$scope}) ' + 'CREATE (wrong:DocumentAuthor {id:$wrong, name:"Autor Iný", graph_scope:$scope}) ' + 'CREATE (p)-[:HAS_DOCUMENT]->(child)<-[:AUTHORED_DOCUMENT]-(wrong)', + person=scope+'a', category=category, scope=scope, author=scope+'author', + child=scope+'/child.md', wrong=scope+'wrong').consume() + yield tx, category + finally: + tx.rollback() + + +def test_real_keyword_year_conjunction(graph): + tx, _ = graph + result = gs.search_graph_with_session(tx, + 'Ktorá z osôb Alena Nová a Boris Iný má kľúčové slovo alpha a jej práca je v roku 2024?') + assert {r['person'] for r in result['facts'] if r['fact_type'] == 'person_thesis'} == {'Alena Nová'} + assert {r['person'] for r in result['facts'] if r['fact_type'] == 'person_keyword'} == {'Alena Nová'} + + +def test_real_count_and_rejected_candidate_provenance(graph): + tx, _ = graph + result = gs.search_graph_with_session(tx, + 'Z kandidátov Alena Nová, Boris Iný, Cyril Malý vyber osoby s prácou v roku 2024. Koľko ich je?') + assert result['aggregation'] == {'count': 2, 'people': ['Alena Nová', 'Boris Iný'], 'candidate_count': 3, 'complete': True} + assert 'https://example.test/c' in {r['source_url'] for r in result['documents']} + + +def test_real_author_and_category_must_share_document(graph): + tx, category = graph + result = gs.search_graph_with_session(tx, f'Ktorý autor dokumentu je pri osobe Alena Nová spojený s kategóriou {category}?') + authors = [r['document_author'] for r in result['facts'] if r['fact_type'] == 'person_document_author'] + assert authors == ['Autor Správny'] + + +def test_real_shared_year_does_not_invent_intersection(graph): + tx, _ = graph + result = gs.search_graph_with_session(tx, 'V ktorom rovnakom roku je práca pri osobách Alena Nová a Cyril Malý?') + assert not any(r['fact_type'] in {'person_thesis', 'person_work'} for r in result['facts']) + assert next(r for r in result['facts'] if r['fact_type'] == 'academic_year_comparison')['shared_years'] == [] + + +def test_real_shared_keyword_uses_requested_keyword(graph): + tx, _ = graph + result = gs.search_graph_with_session(tx, + 'Sú osoby Alena Nová a Cyril Malý prepojené cez kľúčové slovo alpha? Uveď spoločné kľúčové slovo.') + assert [r['keyword'] for r in result['facts'] if r['fact_type'] == 'shared_keyword'] == ['alpha'] + + +def test_real_unknown_keyword_is_not_a_global_listing(graph): + tx, _ = graph + result = gs.search_graph_with_session(tx, 'Aký názov práce má Alena Nová, ak má kľúčové slovo missingtag?') + assert result['facts'] == [] + + +@pytest.mark.parametrize('question', [ + 'V ktorom rovnakom roku je práca pri osobách Alena Nová a Boris Iný?', + 'Aký rok práce spája osoby Alena Nová a Boris Iný?', +]) +def test_real_shared_year_paraphrases_have_same_answer(graph, question): + tx, _ = graph + result = gs.search_graph_with_session(tx, question) + assert next(r for r in result['facts'] if r['fact_type'] == 'academic_year_comparison')['shared_years'] == [2024] + assert {r['year'] for r in result['facts'] if r['fact_type'] == 'person_thesis'} == {2024} + + +def test_real_title_and_keyword_are_both_returned(graph): + tx, _ = graph + result = gs.search_graph_with_session(tx, + 'Aký je názov práce osoby Alena Nová, ak jej dokument obsahuje kľúčové slovo alpha?') + assert [(r['person'], r['title']) for r in result['facts'] if r['fact_type'] == 'person_thesis'] == [('Alena Nová', 'Výskum a')] + assert [r['keyword'] for r in result['facts'] if r['fact_type'] == 'person_keyword'] == ['alpha'] + + +def test_real_count_is_not_cut_off_by_presentation_limit(graph): + tx, _ = graph + result = gs.search_graph_with_session(tx, + 'Z kandidátov Alena Nová, Boris Iný, Cyril Malý vyber osoby s prácou v roku 2024. Koľko ich je?', limit=1) + assert result['aggregation']['count'] == 2 + assert len(result['facts']) == 1 + assert result['truncated'] diff --git a/tools/graphrag/tests/test_graph_search_regressions.py b/tools/graphrag/tests/test_graph_search_regressions.py new file mode 100644 index 0000000..3035894 --- /dev/null +++ b/tools/graphrag/tests/test_graph_search_regressions.py @@ -0,0 +1,111 @@ +from __future__ import annotations + +import pytest + +from tools.graphrag import graph_search as gs +from tools.graphrag.evaluation.audit_benchmark import audit_questions +from tools.graphrag.evaluation.graphrag_evaluator import evaluate_result, property_present, value_is_present +from .test_graph_search import FakeSession, sample_catalog + + +@pytest.mark.parametrize('word', ['názov', 'názvom', 'názvu']) +def test_title_inflections(word): + assert gs.extract_query_constraints(f'Prepoj osobu s {word} jej práce.')['mentions_title'] + + +@pytest.mark.parametrize('question', [ + 'V ktorom rovnakom roku je uvedená práca pri osobách?', + 'Aký rok práce spája tieto osoby?', + 'Prepoj osobu s názvom jej práce a rokom.', +]) +def test_academic_year_intent_does_not_require_a_numeric_year(question): + assert gs.extract_query_constraints(question)['mentions_academic_year'] + + +def test_tag_is_extracted_without_following_clause(): + assert gs.explicit_keyword_phrase('Kľúčové slovo RAG a jej práca v roku 2024?') == 'rag' + + +def test_incidental_zp_tag_does_not_filter_title_lookup(): + catalog = sample_catalog() + [{'element_id': 'zp', 'kind': 'Keyword', 'id': 'zp', 'name': 'zp'}] + fact = {'person_element_id': 'p2', 'person': 'Jakub Maruniak', 'thesis_element_id': 'th1', + 'title': 'Ukážková práca', 'year': 2021, 'thesis_type': 'diploma_thesis'} + session = FakeSession({gs.CATALOG_QUERY: catalog, gs.THESIS_FACTS_QUERY: [fact]}) + result = gs.search_graph_with_session(session, 'Aký názov práce je v ZP Wiki pri osobe Jakub Maruniak?') + assert any(row['fact_type'] == 'person_thesis' for row in result['facts']) + assert gs.PERSON_KEYWORD_FACTS_QUERY not in {query for query, _ in session.calls} + + +def test_keyword_and_year_cannot_be_satisfied_by_different_people(): + session = FakeSession({ + gs.CATALOG_QUERY: sample_catalog(), + gs.THESIS_FACTS_QUERY: [{'person_element_id': 'p2', 'person': 'Jakub Maruniak', + 'year': 2024, 'thesis_element_id': 'th1'}], + gs.PERSON_KEYWORD_FACTS_QUERY: [{'person_element_id': 'p1', 'person': 'Maroš Harahus', + 'keyword_element_id': 'k2', 'keyword': 'RAG'}], + gs.THESIS_PATHS_QUERY: [{'nodes': [{'kind': 'Thesis', 'element_id': 'th1', 'year': 2024}], + 'relationships': ['AUTHORED']}], + }) + result = gs.search_graph_with_session(session, + 'Ktorá z osôb Maroš Harahus a Jakub Maruniak má kľúčové slovo RAG a jej práca je z roku 2024?') + assert result['facts'] == [] + assert result['paths'] == [] + + +def test_unknown_explicit_tag_does_not_return_unfiltered_titles(): + session = FakeSession({gs.CATALOG_QUERY: sample_catalog(), gs.THESIS_FACTS_QUERY: [{'title': 'Nepodložené'}]}) + result = gs.search_graph_with_session(session, + 'Aký názov práce má Jakub Maruniak, ak má kľúčové slovo neexistujucitag?') + assert result['facts'] == [] + assert result['constraints']['unresolved_keyword'] + + +def test_unknown_quoted_title_does_not_list_every_thesis(): + session = FakeSession({gs.CATALOG_QUERY: sample_catalog(), gs.THESIS_FACTS_QUERY: [{'title': 'Iná práca'}]}) + result = gs.search_graph_with_session(session, 'Kto riešil diplomovú prácu „Úplne vymyslený názov“?') + assert result['facts'] == [] + + +def test_recognized_query_entities_are_not_answer_evidence(): + result = {'resolved_entities': [{'kind': 'Thesis', 'title': 'Vymyslený názov', 'year': 2024}], + 'facts': [], 'paths': [], 'documents': [{'document_path': 'Vymyslený názov'}]} + assert not value_is_present('Vymyslený názov', result) + assert not property_present('Thesis.title', result) + + +def test_value_matching_has_word_boundaries(): + assert not value_is_present('202', {'facts': [{'year': 2024}]}) + + +def test_wrong_entity_type_cannot_satisfy_expected_keyword(): + question = {'graph': {'expected_entities': [{'type': 'keyword', 'value': 'RAG'}]}} + row = evaluate_result(question, {'facts': [{'title': 'RAG', 'thesis_type': 'diploma_thesis'}]}, latency_seconds=0) + assert row['entity_score'] == 0 + + +def test_correct_set_with_wrong_count_fails_strict(): + question = {'category': 'candidate_set_aggregation', 'graph': { + 'expected_count': 1, 'expected_entity_set': ['Eva Nová'], 'entity_set_mode': 'exact'}} + result = {'facts': [{'fact_type': 'person_thesis', 'person': 'Eva Nová'}], + 'aggregation': {'count': 2, 'complete': True}} + row = evaluate_result(question, result, latency_seconds=0) + assert not row['strict'] and not row['count_ok'] + + +def test_truncated_result_cannot_pass_strict(): + assert not evaluate_result({'graph': {}}, {'truncated': True}, latency_seconds=0)['strict'] + + +def test_source_audit_detects_nonexistent_tag_and_omitted_child_category(): + payload = {'people': [{'id': 'p', 'name': 'Eva Nová', 'source_document': 'p.md'}], + 'documents': [{'path': 'p.md', 'categories': ['bp2024']}, + {'path': 'child.md', 'categories': ['tp2023']}], + 'person_documents': [{'person_id': 'p', 'document_path': path} for path in ['p.md', 'child.md']], + 'keywords': [{'id': 'nlp', 'name': 'NLP'}], 'document_keywords': [], 'theses': [], 'works': []} + question = {'id': 'example', 'split': 'dev', 'category': 'person_multiple_categories', 'question': '', + 'graph': {'start_entities': [{'type': 'person', 'value': 'Eva Nová'}], + 'expected_entities': [{'type': 'keyword', 'value': 'Chýbajúci tag'}], + 'expected_entity_set': ['bp2024'], 'entity_set_mode': 'exact'}} + issues = audit_questions([question], payload)['questions'][0]['issues'] + assert 'keyword_not_in_frontmatter_catalog' in issues + assert 'exact_categories_omit_or_add_source_categories' in issues diff --git a/tools/graphrag/tests/test_graphrag_evaluator.py b/tools/graphrag/tests/test_graphrag_evaluator.py new file mode 100644 index 0000000..f4c4169 --- /dev/null +++ b/tools/graphrag/tests/test_graphrag_evaluator.py @@ -0,0 +1,305 @@ +from __future__ import annotations + +from tools.graphrag.evaluation.graphrag_evaluator import ( + aggregate_rows, + collect_actual_relationships, + evaluate_result, + normalize_text, + property_present, +) + + +def test_normalize_text() -> None: + assert normalize_text( + "Dárius Lindvai" + ) == "darius lindvai" + + +def test_relationships_can_be_derived_from_fact() -> None: + result = { + "paths": [], + "facts": [ + { + "fact_type": ( + "person_keyword" + ), + "person": ( + "Jakub Maruniak" + ), + "keyword": "NLP", + } + ], + } + + relationships = ( + collect_actual_relationships( + result + ) + ) + + assert relationships == { + "HAS_DOCUMENT", + "HAS_KEYWORD", + } + + +def test_thesis_properties_from_fact() -> None: + result = { + "resolved_entities": [], + "paths": [], + "facts": [ + { + "fact_type": ( + "person_thesis" + ), + "person": ( + "Dárius Lindvai" + ), + "title": ( + "Obnovenie interpunkcie" + ), + "year": 2021, + "thesis_type": ( + "diploma_thesis" + ), + } + ], + } + + assert property_present( + "Thesis.title", + result, + ) + + assert property_present( + "Thesis.year", + result, + ) + + assert property_present( + "Thesis.year|Work.year", + result, + ) + + +def test_strict_thesis_result() -> None: + question = { + "id": "g-test", + "split": "dev", + "category": ( + "person_title_year" + ), + "difficulty": "medium", + "question": ( + "Aký názov a rok práce?" + ), + "expected_answer_contains": [ + "Dárius Lindvai", + ( + "Obnovenie interpunkcie " + "pomocou hlbokých neurónových sietí" + ), + "2021", + ], + "expected_documents": [ + ( + "pages/students/2016/" + "darius_lindvai/README.md" + ) + ], + "expected_source_urls": [ + ( + "https://zp.kemt.fei.tuke.sk/" + "students/2016/darius_lindvai" + ) + ], + "graph": { + "schema_version": 2, + "expected_entities": [ + { + "type": ( + "thesis_title" + ), + "value": ( + "Obnovenie interpunkcie " + "pomocou hlbokých neurónových sietí" + ), + }, + { + "type": "year", + "value": "2021", + }, + ], + "expected_relations": [ + "AUTHORED", + ], + "expected_properties": [ + "Thesis.title", + "Thesis.year", + ], + }, + } + + result = { + "strategies": [ + "entity_resolution", + "thesis_constraints", + ], + "resolved_entities": [], + "paths": [], + "facts": [ + { + "fact_type": ( + "person_thesis" + ), + "person": ( + "Dárius Lindvai" + ), + "title": ( + "Obnovenie interpunkcie " + "pomocou hlbokých neurónových sietí" + ), + "year": 2021, + "thesis_type": ( + "diploma_thesis" + ), + "document_path": ( + "pages/students/2016/" + "darius_lindvai/README.md" + ), + "source_url": ( + "https://zp.kemt.fei.tuke.sk/" + "students/2016/darius_lindvai" + ), + } + ], + "documents": [ + { + "document_path": ( + "pages/students/2016/" + "darius_lindvai/README.md" + ), + "source_url": ( + "https://zp.kemt.fei.tuke.sk/" + "students/2016/darius_lindvai" + ), + } + ], + } + + row = evaluate_result( + question, + result, + latency_seconds=0.01, + ) + + assert row[ + "strict" + ] is True + + assert row[ + "value_score" + ] == 1.0 + + assert row[ + "document_recall" + ] == 1.0 + + +def test_failed_result_is_not_strict() -> None: + question = { + "id": "g-test", + "split": "dev", + "category": ( + "shared_keyword_pair" + ), + "difficulty": "hard", + "question": "Otázka", + "expected_answer_contains": [ + "NLP", + ], + "expected_documents": [ + "a.md", + ], + "expected_source_urls": [], + "graph": { + "schema_version": 2, + "expected_entities": [ + { + "type": "keyword", + "value": "NLP", + } + ], + "expected_relations": [ + "HAS_KEYWORD", + ], + "expected_properties": [], + }, + } + + result = { + "strategies": [], + "resolved_entities": [], + "paths": [], + "facts": [], + "documents": [], + } + + row = evaluate_result( + question, + result, + latency_seconds=0.01, + ) + + assert row[ + "strict" + ] is False + + +def test_aggregate_rows() -> None: + rows = [ + { + "strict": True, + "error": None, + "value_score": 1.0, + "entity_score": 1.0, + "relation_score": 1.0, + "property_score": 1.0, + "relation_choice_score": 1.0, + "document_recall": 1.0, + "source_recall": 1.0, + "latency_seconds": 0.1, + }, + { + "strict": False, + "error": None, + "value_score": 0.5, + "entity_score": 0.5, + "relation_score": 0.5, + "property_score": 0.5, + "relation_choice_score": 0.5, + "document_recall": 0.5, + "source_recall": 0.5, + "latency_seconds": 0.2, + }, + ] + + summary = aggregate_rows( + rows + ) + + assert summary[ + "questions" + ] == 2 + + assert summary[ + "strict_count" + ] == 1 + + assert summary[ + "strict_accuracy" + ] == 0.5 + + assert summary[ + "latency_mean_seconds" + ] == 0.15 diff --git a/tools/graphrag/tests/test_graphrag_freeze.py b/tools/graphrag/tests/test_graphrag_freeze.py new file mode 100644 index 0000000..5763d71 --- /dev/null +++ b/tools/graphrag/tests/test_graphrag_freeze.py @@ -0,0 +1,72 @@ +from __future__ import annotations + +import copy + +import pytest + +from tools.graphrag.evaluation.freeze_graphrag import make_freeze +from tools.graphrag.evaluation.reproducibility import sha256_file, verify_freeze + + +@pytest.fixture +def freeze_case(): + questions = [{'id': 'development-a', 'split': 'dev'}, {'id': 'holdout-a', 'split': 'test'}] + fingerprints = {'implementation': {'search.py': 'version-one'}, 'dataset_sha256': 'dataset', 'inputs': {}} + graph = {'sha256': 'graph', 'nodes': 1, 'relationships': 0} + audit = {'questions': [{'id': q['id']} for q in questions], 'by_split': {}, + 'dataset_sha256': 'dataset', 'inputs': {}} + dev = {'configuration': {'split': 'dev', 'limit': 40, 'max_entities': 8}, + 'summary': {'error_count': 0}, 'questions': [{'id': 'development-a', 'error': None}], + 'run_metadata': {'fingerprints': fingerprints, 'graph': graph}} + return questions, fingerprints, graph, audit, dev + + +def test_freeze_rejects_partial_dev(freeze_case): + questions, fingerprints, _, audit, dev = freeze_case + dev['questions'] = [] + with pytest.raises(RuntimeError, match='complete DEV'): + make_freeze(dev, questions, fingerprints, audit) + + +def test_freeze_rejects_runtime_errors(freeze_case): + questions, fingerprints, _, audit, dev = freeze_case + dev['questions'][0]['error'] = 'database unavailable' + with pytest.raises(RuntimeError, match='runtime errors'): + make_freeze(dev, questions, fingerprints, audit) + + +def test_freeze_rejects_code_changed_after_dev(freeze_case): + questions, fingerprints, _, audit, dev = freeze_case + changed = copy.deepcopy(fingerprints) + changed['implementation']['search.py'] = 'version-two' + with pytest.raises(RuntimeError, match='changed after DEV'): + make_freeze(dev, questions, changed, audit) + + +def test_freeze_rejects_stale_source_audit(freeze_case): + questions, fingerprints, _, audit, dev = freeze_case + audit['inputs'] = {'documents': 'old-snapshot'} + with pytest.raises(RuntimeError, match='audit does not match'): + make_freeze(dev, questions, fingerprints, audit) + + +@pytest.mark.parametrize('mutation', ['code', 'graph', 'parameters', 'audit']) +def test_holdout_rejects_changes_after_freeze(freeze_case, tmp_path, mutation): + questions, fingerprints, graph, audit, dev = freeze_case + manifest = make_freeze(dev, questions, fingerprints, audit) + audit_path = tmp_path / 'audit.json' + audit_path.write_text('original-audit') + manifest['audit_sha256'] = sha256_file(audit_path) + metadata = {'fingerprints': copy.deepcopy(fingerprints)} + actual_graph = dict(graph) + limit = 40 + if mutation == 'code': + metadata['fingerprints']['implementation']['search.py'] = 'changed' + elif mutation == 'graph': + actual_graph['sha256'] = 'changed' + elif mutation == 'parameters': + limit = 41 + else: + audit_path.write_text('changed-audit') + with pytest.raises(RuntimeError, match='TEST refused'): + verify_freeze(manifest, metadata, actual_graph, limit=limit, max_entities=8, audit=audit_path) diff --git a/tools/graphrag/tests/test_graphrag_root_title.py b/tools/graphrag/tests/test_graphrag_root_title.py new file mode 100644 index 0000000..d4b139d --- /dev/null +++ b/tools/graphrag/tests/test_graphrag_root_title.py @@ -0,0 +1,171 @@ +from __future__ import annotations + +from tools.graphrag.graphrag import ( + build_graph_payload, + extract_works, +) + + +DARIUS_PATH = ( + "pages/students/2016/" + "darius_lindvai/README.md" +) + + +def make_darius_document() -> dict: + return { + "path": DARIUS_PATH, + "title": "Dárius Lindvai", + "categories": [ + "dp2021", + "bp2019", + ], + "tags": [ + "nn", + "interpunction", + "nlp", + ], + "author": "Daniel Hladek", + "published": True, + } + + +def make_root_chunk() -> dict: + text = ( + "Dokument: Dárius Lindvai\n\n" + "Rok začiatku štúdia: 2016\n\n" + "Repozitár so zdrojovými kódmi\n\n" + "Názov: Obnovenie interpunkcie pomocou " + "hlbokých neurónových sietí\n\n" + "1. Vypracujte prehľad metód.\n" + "2. Vyberte vhodnú metódu." + ) + + return { + "chunk_id": ( + f"{DARIUS_PATH}::chunk-0" + ), + "document_path": DARIUS_PATH, + "title": "Dárius Lindvai", + "categories": [ + "dp2021", + "bp2019", + ], + "tags": [ + "nn", + "interpunction", + "nlp", + ], + "author": "Daniel Hladek", + "published": True, + "chunk_index": 0, + "heading_paths": [ + [ + "Dárius Lindvai", + ] + ], + "text": text, + "text_length": len(text), + "token_count": 1, + "content_hash": "darius-root", + } + + +def test_root_title_creates_missing_latest_thesis() -> None: + works = extract_works( + make_darius_document(), + [ + make_root_chunk(), + ], + ) + + diploma = [ + work + for work in works + if ( + work["work_type"] + == "diploma_thesis" + ) + ] + + bachelor = [ + work + for work in works + if ( + work["work_type"] + == "bachelor_thesis" + ) + ] + + assert len( + diploma + ) == 1 + + assert bachelor == [] + + thesis = diploma[0] + + assert thesis[ + "year" + ] == 2021 + + assert thesis[ + "heading" + ] == "Diplomová práca 2021" + + assert thesis[ + "title" + ] == ( + "Obnovenie interpunkcie pomocou " + "hlbokých neurónových sietí" + ) + + assert thesis[ + "source_chunk_ids" + ] == [ + f"{DARIUS_PATH}::chunk-0" + ] + + +def test_graph_payload_contains_darius_thesis() -> None: + payload = build_graph_payload( + [ + make_darius_document(), + ], + [ + make_root_chunk(), + ], + ) + + assert len( + payload[ + "theses" + ] + ) == 1 + + thesis = payload[ + "theses" + ][0] + + assert thesis[ + "thesis_type" + ] == "diploma_thesis" + + assert thesis[ + "year" + ] == 2021 + + assert thesis[ + "title" + ] == ( + "Obnovenie interpunkcie pomocou " + "hlbokých neurónových sietí" + ) + + assert thesis[ + "source_document" + ] == DARIUS_PATH + + assert payload[ + "works" + ] == []