Document six completed LR runs as preparation for full Aya training on Perun. Record selection of LR 0.00010 by lowest final validation loss, selected-model lm-eval and partial SK-bench results, reproducible provenance, and dataset-access/context-truncation limitations. Preserve existing 30k and Titan material.
9 lines
314 B
Plaintext
9 lines
314 B
Plaintext
model=hf
|
|
pretrained=/home/schwarc/diplomovka/skbench_evaluation/models/aya_300k_lr_0p00010
|
|
tokenizer=/home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4
|
|
dtype=bfloat16
|
|
num_fewshot=0
|
|
batch_size=1
|
|
apply_chat_template=false
|
|
CUDA_VISIBLE_DEVICES=1
|