Document six completed LR runs as preparation for full Aya training on Perun. Record selection of LR 0.00010 by lowest final validation loss, selected-model lm-eval and partial SK-bench results, reproducible provenance, and dataset-access/context-truncation limitations. Preserve existing 30k and Titan material.
9 lines
145 B
JSON
9 lines
145 B
JSON
{
|
|
"lm_eval": "0.4.8",
|
|
"transformers": "4.48.2",
|
|
"torch": "2.6.0+cu124",
|
|
"datasets": "5.0.1",
|
|
"peft": "0.14.0",
|
|
"evaluate": "0.4.6"
|
|
}
|