Diplomovka/aya_300k_lr_experiments/results/eval_loss_history.csv
Jakub 67061cf373 Add Aya 300k learning-rate study and benchmark results
Document six completed LR runs as preparation for full Aya training on Perun. Record selection of LR 0.00010 by lowest final validation loss, selected-model lm-eval and partial SK-bench results, reproducible provenance, and dataset-access/context-truncation limitations. Preserve existing 30k and Titan material.
2026-10-25 00:33:24 +02:00

4.8 KiB

1learning_raterunstepeval_loss
28e-05lr_0p0000810001.0020490884780884
38e-05lr_0p0000820000.9672194719314575
48e-05lr_0p0000830000.9505742192268372
58e-05lr_0p0000840000.9352602362632751
68e-05lr_0p0000850000.9294734597206116
78e-05lr_0p0000860000.9264867305755615
88e-05lr_0p0000870000.9184143543243408
98e-05lr_0p0000880000.9120934009552002
108e-05lr_0p0000890000.9065558910369873
118e-05lr_0p00008100000.9004696011543274
128e-05lr_0p00008110000.8929902911186218
138e-05lr_0p00008120000.8897570371627808
148e-05lr_0p00008130000.8844991326332092
158e-05lr_0p00008140000.8800909519195557
168e-05lr_0p00008150000.8777939677238464
178e-05lr_0p00008160000.8767354488372803
188e-05lr_0p00008170000.875752329826355
198e-05lr_0p00008180000.875270426273346
208e-05lr_0p00008186880.875216543674469
210.0001lr_0p0001010001.0004310607910156
220.0001lr_0p0001020000.9658941626548767
230.0001lr_0p0001030000.9526628255844116
240.0001lr_0p0001040000.9393344521522522
250.0001lr_0p0001050000.9336668848991394
260.0001lr_0p0001060000.931794285774231
270.0001lr_0p0001070000.9227241277694702
280.0001lr_0p0001080000.9158084392547607
290.0001lr_0p0001090000.9100468158721924
300.0001lr_0p00010100000.9019826650619507
310.0001lr_0p00010110000.8941853642463684
320.0001lr_0p00010120000.8896107077598572
330.0001lr_0p00010130000.8851001262664795
340.0001lr_0p00010140000.8795706033706665
350.0001lr_0p00010150000.8770407438278198
360.0001lr_0p00010160000.8748454451560974
370.0001lr_0p00010170000.8731834888458252
380.0001lr_0p00010180000.8727287650108337
390.0001lr_0p00010186880.87261962890625
400.00015lr_0p0001510001.0024861097335815
410.00015lr_0p0001520000.9763674139976501
420.00015lr_0p0001530000.97147536277771
430.00015lr_0p0001540000.9657827019691467
440.00015lr_0p0001550000.9659448266029358
450.00015lr_0p0001560000.9597828388214111
460.00015lr_0p0001570000.951335608959198
470.00015lr_0p0001580000.9469588994979858
480.00015lr_0p0001590000.9383289813995361
490.00015lr_0p00015100000.9309172630310059
500.00015lr_0p00015110000.9210461974143982
510.00015lr_0p00015120000.9106600284576416
520.00015lr_0p00015130000.9036438465118408
530.00015lr_0p00015140000.8952069878578186
540.00015lr_0p00015150000.8909939527511597
550.00015lr_0p00015160000.8871906995773315
560.00015lr_0p00015170000.8851967453956604
570.00015lr_0p00015180000.8842737674713135
580.00015lr_0p00015186880.8842697143554688
590.00018lr_0p0001810000.9958739280700684
600.00018lr_0p0001820000.9904810786247253
610.00018lr_0p0001830000.9867064356803894
620.00018lr_0p0001840000.9833324551582336
630.00018lr_0p0001850000.9868490099906921
640.00018lr_0p0001860000.9755926728248596
650.00018lr_0p0001870000.9768977761268616
660.00018lr_0p0001880000.9687609076499939
670.00018lr_0p0001890000.9562658071517944
680.00018lr_0p00018100000.9435049891471863
690.00018lr_0p00018110000.9342814683914185
700.00018lr_0p00018120000.922635018825531
710.00018lr_0p00018130000.9130367636680603
720.00018lr_0p00018140000.904951810836792
730.00018lr_0p00018150000.8994976878166199
740.00018lr_0p00018160000.8953551650047302
750.00018lr_0p00018170000.8925029039382935
760.00018lr_0p00018180000.891387939453125
770.00018lr_0p00018186880.8914602994918823
780.0002lr_0p0002010000.9974449276924133
790.0002lr_0p0002020000.9973769783973694
800.0002lr_0p0002030001.0056378841400146
810.0002lr_0p0002040000.9973607063293457
820.0002lr_0p0002050001.0010013580322266
830.0002lr_0p0002060001.000449776649475
840.0002lr_0p0002070000.9865806698799133
850.0002lr_0p0002080000.9824715852737427
860.0002lr_0p0002090000.9666008353233337
870.0002lr_0p00020100000.9573416709899902
880.0002lr_0p00020110000.9432744383811951
890.0002lr_0p00020120000.9326162338256836
900.0002lr_0p00020130000.9201604127883911
910.0002lr_0p00020140000.9126585721969604
920.0002lr_0p00020150000.907073438167572
930.0002lr_0p00020160000.9014313817024231
940.0002lr_0p00020170000.8986518979072571
950.0002lr_0p00020180000.897506594657898
960.0002lr_0p00020186880.8976690173149109
970.00023lr_0p0002310001.0002912282943726
980.00023lr_0p0002320001.0145149230957031
990.00023lr_0p0002330001.0228914022445679
1000.00023lr_0p0002340001.0323290824890137
1010.00023lr_0p0002350001.0345656871795654
1020.00023lr_0p0002360001.0246530771255493
1030.00023lr_0p0002370001.0160919427871704
1040.00023lr_0p0002380001.0105783939361572
1050.00023lr_0p0002390000.9934014678001404
1060.00023lr_0p00023100000.980603039264679
1070.00023lr_0p00023110000.963624119758606
1080.00023lr_0p00023120000.951417088508606
1090.00023lr_0p00023130000.9340505599975586
1100.00023lr_0p00023140000.9227956533432007
1110.00023lr_0p00023150000.9158667325973511
1120.00023lr_0p00023160000.908878743648529
1130.00023lr_0p00023170000.9046502709388733
1140.00023lr_0p00023180000.9031931161880493
1150.00023lr_0p00023186880.9032362699508667