Jakub
67061cf373
Document six completed LR runs as preparation for full Aya training on Perun. Record selection of LR 0.00010 by lowest final validation loss, selected-model lm-eval and partial SK-bench results, reproducible provenance, and dataset-access/context-truncation limitations. Preserve existing 30k and Titan material.
9 lines
246 B
JSON
9 lines
246 B
JSON
{
|
|
"epoch": 1.0,
|
|
"num_input_tokens_seen": 62891360,
|
|
"total_flos": 2.69902163257983e+18,
|
|
"train_loss": 0.9577838991296618,
|
|
"train_runtime": 80127.6428,
|
|
"train_samples_per_second": 3.732,
|
|
"train_steps_per_second": 0.233
|
|
} |