Jakub
67061cf373
Document six completed LR runs as preparation for full Aya training on Perun. Record selection of LR 0.00010 by lowest final validation loss, selected-model lm-eval and partial SK-bench results, reproducible provenance, and dataset-access/context-truncation limitations. Preserve existing 30k and Titan material.
9 lines
638 B
Django/Jinja
9 lines
638 B
Django/Jinja
{% set system_message = 'Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
|
|
|
' %}{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% endif %}{% if system_message is defined %}{{ system_message }}{% endif %}{% for message in loop_messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ '### Instruction:
|
|
' + content + '
|
|
|
|
### Response:
|
|
' }}{% elif message['role'] == 'assistant' %}{{ content + '</s>' + '
|
|
|
|
' }}{% endif %}{% endfor %} |