|
01_baseline_r16_a16_lr5e5_adamw
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
02_optimizer_adamw8bit_r16_a16_lr5e5
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
03_rank8_a16_lr5e5
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
04_rank32_a32_lr5e5
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
05_r16_alpha32_lr5e5
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
06_lr1e4_r16_a16
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
07_lr2e5_r16_a16
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
08_attention_only_r16_a16_lr5e5
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
09_batch2_accum4_r16_a16_lr5e5
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |
|
10_r16_a32_lr1e4
|
perun + fix
|
2026-11-04 23:46:33 +01:00 |