Jakub
67061cf373
Document six completed LR runs as preparation for full Aya training on Perun. Record selection of LR 0.00010 by lowest final validation loss, selected-model lm-eval and partial SK-bench results, reproducible provenance, and dataset-access/context-truncation limitations. Preserve existing 30k and Titan material.
13 lines
387 B
JSON
13 lines
387 B
JSON
{
|
|
"epoch": 1.0,
|
|
"eval_loss": 0.875216543674469,
|
|
"eval_runtime": 84.3566,
|
|
"eval_samples_per_second": 11.854,
|
|
"eval_steps_per_second": 11.854,
|
|
"num_input_tokens_seen": 62891360,
|
|
"total_flos": 2.69902163257983e+18,
|
|
"train_loss": 0.9401782060884041,
|
|
"train_runtime": 79243.6449,
|
|
"train_samples_per_second": 3.773,
|
|
"train_steps_per_second": 0.236
|
|
} |