js886io/Diplomovka
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2302243974
Diplomovka/optuna_30k_experiments/logs/trial_003_lr_2.000e-04.log
Jakub 2302243974 30k_experiment_hruska
2026-10-17 22:23:38 +02:00

12727 lines
543 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/torch/cuda/__init__.py:734: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
[INFO|2026-10-13 06:24:10] llamafactory.hparams.parser:651 >> Process rank: 0, world size: 1, device: cuda:0, distributed training: False, compute dtype: torch.bfloat16
Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
[INFO|configuration_utils.py:765] 2026-10-13 06:24:10,818 >> loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
[INFO|configuration_utils.py:841] 2026-10-13 06:24:10,827 >> Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
[INFO|configuration_utils.py:765] 2026-10-13 06:24:12,510 >> loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
[INFO|configuration_utils.py:841] 2026-10-13 06:24:12,514 >> Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
[INFO|configuration_utils.py:765] 2026-10-13 06:24:12,662 >> loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
[INFO|configuration_utils.py:841] 2026-10-13 06:24:12,665 >> Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
[INFO|2026-10-13 06:24:13] llamafactory.data.loader:144 >> Loading dataset aya_slovak_hpo_30k.jsonl...
training example:
input_ids:
[20548, 336, 349, 396, 13126, 369, 13966, 264, 3638, 28723, 12018, 264, 2899, 369, 6582, 1999, 2691, 274, 272, 2159, 28723, 13, 13, 27332, 3133, 3112, 28747, 13, 28828, 2176, 28711, 28863, 29114, 10268, 28709, 6612, 28714, 2892, 493, 363, 6294, 10719, 363, 3811, 28723, 7379, 626, 28889, 307, 14637, 311, 28768, 2218, 22885, 3748, 28725, 446, 6909, 28820, 637, 3531, 598, 28820, 284, 8341, 6729, 345, 28738, 28739, 363, 8357, 28710, 307, 14637, 311, 28768, 626, 363, 29826, 17339, 28723, 524, 4634, 28711, 570, 1879, 261, 28863, 532, 613, 14483, 28718, 28723, 367, 280, 28879, 570, 9335, 3175, 29826, 626, 323, 7509, 17984, 2950, 28718, 16986, 29826, 28708, 345, 15962, 28739, 363, 3292, 10719, 6612, 529, 28710, 818, 5237, 626, 4845, 1879, 15173, 537, 284, 8341, 705, 28723, 367, 280, 28879, 570, 4415, 28716, 28797, 9335, 3175, 29826, 626, 323, 412, 8514, 16986, 29826, 28708, 345, 15962, 28739, 1879, 15173, 537, 1221, 4566, 28718, 325, 28707, 28723, 461, 28723, 724, 494, 8891, 24160, 28725, 8582, 28862, 24160, 28725, 20532, 28764, 271, 28725, 438, 29365, 15745, 1319, 12035, 28862, 8269, 284, 28827, 2762, 28709, 264, 4798, 8359, 1450, 8325, 12121, 1798, 420, 762, 1089, 290, 28906, 18765, 724, 2331, 29114, 1221, 4304, 1780, 363, 13881, 29826, 316, 2085, 28708, 28723, 22627, 28873, 263, 335, 20208, 284, 28827, 2762, 28709, 264, 4798, 5424, 10056, 1286, 290, 28906, 18765, 724, 2331, 29114, 11323, 10719, 12490, 363, 13881, 29826, 316, 284, 8341, 2390, 28723, 22127, 280, 28879, 21022, 1150, 424, 724, 28827, 1144, 28873, 340, 17066, 270, 21022, 485, 284, 8341, 705, 28725, 446, 6909, 28797, 637, 28705, 29114, 28708, 28879, 4798, 6612, 28827, 1100, 28768, 28863, 28723, 320, 412, 28879, 637, 15612, 28716, 28889, 28726, 1150, 424, 19523, 412, 28873, 276, 28797, 2390, 284, 8341, 2390, 363, 23407, 11277, 9538, 2085, 28708, 28723, 9532, 2144, 686, 7865, 28718, 341, 14475, 1687, 28706, 18037, 452, 270, 8269, 284, 8341, 705, 28725, 290, 4827, 486, 2710, 2144, 332, 1800, 16344, 29114, 6588, 269, 28862, 28711, 28863, 686, 1653, 5388, 28718, 710, 261, 1296, 28709, 284, 8341, 705, 28723, 351, 28711, 1371, 28797, 1776, 29826, 8269, 284, 8341, 705, 268, 28863, 1776, 29826, 8269, 1879, 3497, 598, 8269, 8631, 28879, 279, 412, 28725, 12121, 7988, 268, 28863, 24270, 12115, 28797, 1879, 5626, 263, 28862, 8269, 8631, 28879, 279, 412, 28723, 318, 15612, 1473, 276, 15690, 2245, 626, 15690, 307, 14637, 311, 28768, 300, 15469, 28711, 570, 446, 450, 4798, 29826, 333, 28729, 1879, 319, 3976, 294, 405, 28768, 4882, 405, 28725, 534, 28724, 2710, 724, 313, 4827, 2245, 626, 28889, 20532, 28764, 271, 28723, 10650, 300, 12235, 28827, 28873, 424, 268, 27172, 2245, 28723, 1054, 15504, 28879, 424, 724, 313, 8768, 4545, 504, 270, 8269, 2124, 2245, 626, 12689, 4584, 10906, 28718, 710, 18782, 28879, 28715, 28797, 1135, 10356, 28723, 2645, 28764, 12275, 28820, 28873, 29114, 13067, 549, 2892, 5872, 3811, 8631, 25991, 3026, 29114, 408, 28906, 28764, 485, 2082, 1403, 12121, 1798, 1773, 29826, 28729, 22160, 710, 408, 28906, 28764, 485, 1135, 10874, 1776, 4536, 28873, 300, 23407, 11277, 9538, 2085, 28708, 28723, 22127, 3361, 13470, 1150, 317, 28873, 424, 2082, 7330, 511, 2085, 28708, 28723, 401, 492, 13591, 28820, 261, 2220, 28862, 10766, 381, 28827, 486, 29114, 363, 28879, 4689, 3418, 28879, 21775, 29114, 280, 28723, 418, 28820, 11277, 28716, 6294, 26177, 903, 12689, 6612, 20122, 28733, 12868, 291, 2124, 2085, 28708, 1879, 6670, 28862, 9348, 493, 686, 375, 5620, 386, 28862, 28827, 28725, 23374, 4536, 25306, 16388, 957, 450, 15612, 28764, 2126, 29114, 511, 2152, 363, 25769, 14110, 17413, 26177, 903, 28873, 15808, 19396, 28723, 351, 28906, 28879, 3811, 14628, 28879, 8631, 28879, 28710, 29114, 307, 14637, 311, 28768, 7379, 1879, 277, 7939, 1879, 724, 313, 8768, 2245, 28718, 363, 446, 551, 9538, 12121, 1798, 24473, 21694, 300, 261, 5869, 28723, 384, 28728, 491, 28712, 4566, 15469, 28711, 570, 1879, 2245, 28725, 534, 28724, 2710, 7463, 15612, 13335, 28728, 4371, 1144, 28723, 10650, 300, 15469, 28711, 570, 1879, 1160, 28709, 28879, 3907, 13288, 491, 363, 3292, 10719, 6612, 529, 28710, 818, 5237, 626, 4845, 28725, 534, 28724, 637, 686, 598, 5237, 5945, 17984, 28718, 2117, 18904, 3146, 515, 13288, 25208, 28723, 367, 280, 28879, 570, 12472, 1006, 5872, 28863, 358, 446, 311, 4845, 1879, 6149, 783, 494, 28718, 2245, 28718, 363, 17984, 28718, 405, 13288, 491, 28723, 13343, 29826, 28729, 385, 29114, 284, 8341, 705, 28747, 399, 3711, 3175, 29826, 626, 12990, 17984, 28718, 2117, 268, 6125, 15690, 345, 28738, 28739, 16986, 29826, 28708, 1773, 29826, 10641, 2124, 345, 28738, 28739, 582, 20524, 12214, 1773, 29826, 28729, 385, 29114, 284, 8341, 705, 28723, 351, 28906, 28879, 3811, 14628, 28879, 8631, 28879, 28710, 29114, 307, 14637, 311, 28768, 15173, 537, 28718, 325, 849, 3748, 28725, 446, 6909, 28820, 3061, 28720, 300, 28827, 1520, 6612, 749, 1780, 20532, 28764, 271, 586, 28873, 28710, 363, 8357, 28710, 307, 14637, 311, 28768, 626, 363, 29826, 17339, 28731, 1879, 686, 6729, 1773, 29826, 28729, 22160, 284, 8341, 705, 28723, 550, 11245, 412, 28747, 550, 11245, 412, 1683, 28827, 16032, 271, 1342, 4295, 3191, 316, 28729, 6449, 2245, 28718, 28723, 367, 280, 28879, 570, 9335, 3175, 29826, 626, 323, 7509, 17984, 2950, 28718, 16986, 29826, 28708, 22885, 2557, 28725, 446, 6909, 28820, 637, 3531, 598, 28820, 345, 28741, 28739, 1879, 22954, 338, 28718, 297, 12689, 345, 28741, 28739, 686, 2129, 28710, 29114, 16986, 28863, 358, 28723, 17563, 971, 28747, 17563, 971, 582, 20524, 12214, 1342, 28764, 1193, 1342, 4295, 5765, 6175, 2959, 15416, 28710, 13288, 491, 3589, 28723, 9532, 484, 28717, 3811, 18904, 17101, 29114, 22399, 971, 28725, 15612, 13335, 28728, 4371, 28711, 570, 13288, 20996, 28725, 446, 6909, 28797, 484, 28717, 3811, 18904, 17101, 29114, 28725, 264, 2513, 300, 8631, 28879, 570, 9335, 3175, 29826, 626, 323, 7509, 17984, 2950, 28718, 16986, 29826, 28708, 22885, 2557, 268, 345, 28741, 28739, 264, 28790, 28724, 537, 424, 2245, 626, 28889, 307, 14637, 311, 28768, 28723, 550, 28724, 537, 424, 284, 28827, 2762, 28709, 28723, 1921, 313, 1150, 424, 268, 27172, 2245, 28723, 500, 783, 494, 424, 1773, 29826, 28729, 385, 29114, 264, 4321, 303, 715, 2245, 28718, 28723, 550, 28724, 28764, 1520, 28862, 424, 1773, 22605, 284, 8341, 705, 28723, 2, 13, 13]
inputs:
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
Zhrnúť tento článok v jednej vete. Textový nástroj je ikona, ktorá sa podobá písmenu "T" v paneli nástrojov vľavo. Kliknite na túto ikonu. Použite rozbaľovaciu ponuku vedľa "Character" v hornej časti obrazovky na výber písma. Použite druhé rozbaľovacie menu vedľa "Character" na výber formátu (t. j. pravidelný, tučný, kurzor, atď.). Tradičné písmo ako Times New Roman alebo Garamond môže pridať formálny vzhľad loga. Bezšerifové písmo ako Helvetica môže pridať modernejší vzhľad písmu. Nepoužívajte príliš dekoratívne písma, ktoré sa ťažko čítajú. Tiež sa vyhýbajte zmiešanému písmu v návrhu loga. Ak si z internetu stiahnete bezplatné písma, mali by ste si uvedomiť licenčnú zmluvu pre tieto písma. Mnohé voľné písma sú voľné na osobné použitie, ale nie sú povolené na komerčné použitie. S vybraným textovým nástrojom kliknite kdekoľvek na grafickej doske, aby ste pridali textový kurzor. Potom napíšte svoj text. Zvážte pridanie samostatného textového objektu pre každé slovo. Obzvlášť ak plánujete používať rôzne farby alebo veľkosti pre rôzne slová vo vašom návrhu loga. Nepridávaj ešte farbu do loga. Farebná tlač nemusí byť vždy možnosťou. Návrh jednoduchého čierno-bieleho loga na začiatok zabezpečí, že vaše logo bude vyzerať dobre v jeho najjednoduchšej forme. Môžete tiež použiť nástroj Text na ceste na pridanie textu v kruhu alebo zakrivenom tvare. Dvakrát kliknite na text, aby ste ho vyzdvihli. Potom kliknite na položku znak v hornej časti obrazovky, aby sa zobrazila ponuka nastavenia znakov. Použite nasledujúce kroky na úpravu textu v ponuke znak. Veľkosť písma: Rozbaľovacia ponuka s malým "T" vedľa veľkého "T" upravuje veľkosť písma. Môžete tiež použiť nástroj výberu (ikona, ktorá pripomína čierny kurzor myši v paneli nástrojov vľavo) na zmenu veľkosti písma. Vedenie: Vedenie mení priestor medzi riadkami textu. Použite rozbaľovaciu ponuku vedľa ikony, ktorá sa podobá "A" na vrchu iného "A" zmeniť vedúce. Kerning: Kerning upravuje medzery medzi konkrétnymi znakmi. Ak chcete nastaviť kerning, vyzdvihnite znaky, ktoré chcete nastaviť, a potom použite rozbaľovaciu ponuku vedľa ikony s "A" aVyberte textový nástroj. Vyberte písmo. Pridajte svoj text. Upravte veľkosť a odstup textu. Vyznačte vektor písma.</s>
label_ids:
[-100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, 28790, 28724, 537, 424, 2245, 626, 28889, 307, 14637, 311, 28768, 28723, 550, 28724, 537, 424, 284, 28827, 2762, 28709, 28723, 1921, 313, 1150, 424, 268, 27172, 2245, 28723, 500, 783, 494, 424, 1773, 29826, 28729, 385, 29114, 264, 4321, 303, 715, 2245, 28718, 28723, 550, 28724, 28764, 1520, 28862, 424, 1773, 22605, 284, 8341, 705, 28723, 2, 13, 13]
labels:
Vyberte textový nástroj. Vyberte písmo. Pridajte svoj text. Upravte veľkosť a odstup textu. Vyznačte vektor písma.</s>
eval example:
input_ids:
[20548, 336, 349, 396, 13126, 369, 13966, 264, 3638, 28723, 12018, 264, 2899, 369, 6582, 1999, 2691, 274, 272, 2159, 28723, 13, 13, 27332, 3133, 3112, 28747, 13, 28965, 28709, 637, 8631, 25991, 3026, 28725, 13067, 10531, 28729, 350, 2591, 686, 3023, 28862, 28827, 284, 28873, 269, 13096, 28711, 28863, 6149, 3399, 28804, 550, 13881, 29826, 316, 300, 1879, 7871, 338, 28820, 6936, 1150, 28863, 7340, 6957, 8905, 3907, 12235, 28827, 28873, 424, 5765, 772, 28725, 446, 6909, 28889, 14848, 912, 12214, 4321, 28720, 751, 29365, 28723, 351, 28906, 18765, 298, 486, 29114, 28705, 28740, 387, 28705, 28750, 28734, 22116, 28827, 28723, 8294, 772, 28747, 13, 13, 27332, 12107, 28747, 13, 15774, 4295, 28873, 841, 335, 681, 28820, 9335, 1294, 17122, 29114, 549, 350, 5905, 2218, 6612, 28710, 26041, 28862, 485, 686, 350, 28720, 2947, 20946, 6670, 298, 28725, 23374, 17984, 28863, 28729, 433, 408, 28906, 7745, 271, 350, 385, 29114, 363, 1879, 28873, 300, 6294, 291, 28723, 560, 12423, 841, 335, 681, 28820, 9335, 1294, 17122, 29114, 28725, 9335, 1294, 17122, 29114, 12121, 28714, 363, 408, 10422, 1189, 6294, 8269, 2124, 4415, 9538, 28725, 307, 10422, 14628, 28879, 17984, 28863, 2117, 1776, 29826, 7330, 363, 1879, 28873, 15808, 1117, 458, 28723, 9532, 686, 346, 28716, 28820, 6149, 311, 1705, 363, 1326, 493, 517, 28863, 267, 28725, 668, 328, 412, 28716, 433, 637, 1879, 1627, 29826, 28711, 1371, 3382, 350, 5856, 1252, 28718, 9335, 1294, 17122, 29114, 28725, 534, 28724, 991, 28706, 13288, 626, 28718, 686, 293, 316, 2689, 284, 28906, 670, 7988, 28862, 9619, 4147, 15690, 28723, 9532, 284, 374, 284, 374, 626, 380, 29826, 686, 3023, 28862, 28827, 6149, 3399, 284, 28873, 269, 535, 28725, 290, 28906, 28879, 5037, 363, 12472, 1006, 5872, 28863, 675, 6739, 686, 293, 12035, 29114, 4321, 328, 10719, 28873, 7509, 4321, 3399, 284, 28873, 269, 535, 28725, 3061, 28862, 300, 637, 668, 328, 412, 28716, 433, 1879, 363, 28711, 24043, 2737, 841, 335, 681, 28863, 9335, 1294, 17122, 29114, 28723, 351, 28906, 28879, 5037, 637, 363, 28764, 1705, 29114, 1219, 28729, 9041, 284, 28873, 269, 535, 363, 711, 28768, 532, 818, 4081, 28710, 264, 363, 846, 12035, 29114, 6149, 452, 485, 297, 28889, 4415, 28716, 28725, 668, 328, 412, 28716, 1150, 28863, 28717, 637, 1879, 1342, 28764, 313, 551, 28716, 626, 28863, 9335, 1294, 17122, 29114, 28723, 384, 493, 266, 2591, 23371, 1627, 29826, 28711, 1371, 3382, 350, 5856, 9883, 668, 5053, 28862, 21775, 29114, 28725, 446, 6909, 28820, 2413, 5856, 485, 284, 374, 12214, 1326, 493, 517, 28863, 643, 28725, 637, 363, 4273, 28862, 279, 300, 3614, 314, 4371, 28718, 668, 328, 412, 2799, 1879, 287, 2563, 2023, 28764, 6454, 28723, 2, 13, 13]
inputs:
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
Čo sa používa, ak škodca zničí pšeničnú úrodu? Vzhľadom na predchádzajúcu otázku napíšte kontext, ktorý obsahuje odpoveď. Môže to byť 1 - 20 vetí. Kontext:
### Response:
Medzišpecifická rozmanitosť plodín je čiastočne zodpovedná za to, že ponúkame rôznorodosť v našom jedle. Intraspecifická rozmanitosť, rozmanitosť alel v rámci jedného druhu, nám tiež ponúka voľbu v našej strave. Ak zlyhá úroda v monokultúre, spoliehame sa na poľnohospodársku rozmanitosť, aby sme znovu zasadili pôdu niečím novým. Ak pest pestovateľ zničí úrodu pšenice, môžeme v nasledujúcom roku zasadiť odolnejšiu odrodu pšenice, pričom sa spoliehame na vnútrospecifickú rozmanitosť. Môžeme sa vzdať produkcie pšenice v tejto oblasti a vysadiť úplne iný druh, spoliehajúc sa na medzidruhovú rozmanitosť. Dokonca aj poľnohospodárska spoločnosť, ktorá primárne pestuje monokultúry, sa v určitom okamihu spolieha na biodiverzitu.</s>
label_ids:
[-100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, 15774, 4295, 28873, 841, 335, 681, 28820, 9335, 1294, 17122, 29114, 549, 350, 5905, 2218, 6612, 28710, 26041, 28862, 485, 686, 350, 28720, 2947, 20946, 6670, 298, 28725, 23374, 17984, 28863, 28729, 433, 408, 28906, 7745, 271, 350, 385, 29114, 363, 1879, 28873, 300, 6294, 291, 28723, 560, 12423, 841, 335, 681, 28820, 9335, 1294, 17122, 29114, 28725, 9335, 1294, 17122, 29114, 12121, 28714, 363, 408, 10422, 1189, 6294, 8269, 2124, 4415, 9538, 28725, 307, 10422, 14628, 28879, 17984, 28863, 2117, 1776, 29826, 7330, 363, 1879, 28873, 15808, 1117, 458, 28723, 9532, 686, 346, 28716, 28820, 6149, 311, 1705, 363, 1326, 493, 517, 28863, 267, 28725, 668, 328, 412, 28716, 433, 637, 1879, 1627, 29826, 28711, 1371, 3382, 350, 5856, 1252, 28718, 9335, 1294, 17122, 29114, 28725, 534, 28724, 991, 28706, 13288, 626, 28718, 686, 293, 316, 2689, 284, 28906, 670, 7988, 28862, 9619, 4147, 15690, 28723, 9532, 284, 374, 284, 374, 626, 380, 29826, 686, 3023, 28862, 28827, 6149, 3399, 284, 28873, 269, 535, 28725, 290, 28906, 28879, 5037, 363, 12472, 1006, 5872, 28863, 675, 6739, 686, 293, 12035, 29114, 4321, 328, 10719, 28873, 7509, 4321, 3399, 284, 28873, 269, 535, 28725, 3061, 28862, 300, 637, 668, 328, 412, 28716, 433, 1879, 363, 28711, 24043, 2737, 841, 335, 681, 28863, 9335, 1294, 17122, 29114, 28723, 351, 28906, 28879, 5037, 637, 363, 28764, 1705, 29114, 1219, 28729, 9041, 284, 28873, 269, 535, 363, 711, 28768, 532, 818, 4081, 28710, 264, 363, 846, 12035, 29114, 6149, 452, 485, 297, 28889, 4415, 28716, 28725, 668, 328, 412, 28716, 1150, 28863, 28717, 637, 1879, 1342, 28764, 313, 551, 28716, 626, 28863, 9335, 1294, 17122, 29114, 28723, 384, 493, 266, 2591, 23371, 1627, 29826, 28711, 1371, 3382, 350, 5856, 9883, 668, 5053, 28862, 21775, 29114, 28725, 446, 6909, 28820, 2413, 5856, 485, 284, 374, 12214, 1326, 493, 517, 28863, 643, 28725, 637, 363, 4273, 28862, 279, 300, 3614, 314, 4371, 28718, 668, 328, 412, 2799, 1879, 287, 2563, 2023, 28764, 6454, 28723, 2, 13, 13]
labels:
Medzišpecifická rozmanitosť plodín je čiastočne zodpovedná za to, že ponúkame rôznorodosť v našom jedle. Intraspecifická rozmanitosť, rozmanitosť alel v rámci jedného druhu, nám tiež ponúka voľbu v našej strave. Ak zlyhá úroda v monokultúre, spoliehame sa na poľnohospodársku rozmanitosť, aby sme znovu zasadili pôdu niečím novým. Ak pest pestovateľ zničí úrodu pšenice, môžeme v nasledujúcom roku zasadiť odolnejšiu odrodu pšenice, pričom sa spoliehame na vnútrospecifickú rozmanitosť. Môžeme sa vzdať produkcie pšenice v tejto oblasti a vysadiť úplne iný druh, spoliehajúc sa na medzidruhovú rozmanitosť. Dokonca aj poľnohospodárska spoločnosť, ktorá primárne pestuje monokultúry, sa v určitom okamihu spolieha na biodiverzitu.</s>
[INFO|configuration_utils.py:765] 2026-10-13 06:24:14,178 >> loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
[INFO|configuration_utils.py:841] 2026-10-13 06:24:14,181 >> Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
[INFO|2026-10-13 06:24:14] llamafactory.model.model_utils.kv_cache:144 >> KV cache is disabled during training.
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/unsloth/__init__.py:165: UserWarning: WARNING: Unsloth should be imported before [trl, transformers, peft] to ensure all optimizations are applied. Your code may run slower or encounter memory issues without these optimizations.
Please restructure your imports with 'import unsloth' at the top of your file.
from ._gpu_init import *
🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/torch/cuda/__init__.py:734: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
🦥 Unsloth Zoo will now patch everything to make training faster!
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
Unsloth: WARNING `trust_remote_code` is True.
Are you certain you want to do remote code execution?
==((====))== Unsloth 2026.6.1: Fast Mistral patching. Transformers: 5.5.0.
\\ /| NVIDIA RTX A4500. Num GPUs = 1. Max memory: 19.698 GB. Platform: Linux.
O^O/ \_/ \ Torch: 2.6.0+cu124. CUDA: 8.6. CUDA Toolkit: 12.4. Triton: 3.2.0
\ / Bfloat16 = TRUE. FA [Xformers = 0.0.29.post3. FA2 = False]
"-____-" Free license: http://github.com/unslothai/unsloth
Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
loading weights file model.safetensors from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/model.safetensors.index.json
Will use dtype=torch.bfloat16 as defined in model's config object
Generate config GenerationConfig {
"bos_token_id": 1,
"eos_token_id": 2,
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 2,
"use_cache": true
}
Loading weights: 0%| | 0/291 [00:00<?, ?it/s]
Loading weights: 2%|▏ | 5/291 [00:00<00:06, 46.54it/s]
Loading weights: 5%|▌ | 15/291 [00:00<00:03, 71.34it/s]
Loading weights: 11%|█ | 31/291 [00:00<00:02, 101.07it/s]
Loading weights: 14%|█▍ | 42/291 [00:00<00:02, 100.71it/s]
Loading weights: 19%|█▉ | 55/291 [00:00<00:02, 108.28it/s]
Loading weights: 23%|██▎ | 67/291 [00:00<00:02, 108.44it/s]
Loading weights: 27%|██▋ | 78/291 [00:00<00:02, 99.66it/s]
Loading weights: 32%|███▏ | 92/291 [00:00<00:01, 110.97it/s]
Loading weights: 36%|███▌ | 104/291 [00:01<00:01, 101.44it/s]
Loading weights: 40%|███▉ | 115/291 [00:01<00:01, 97.15it/s]
Loading weights: 44%|████▎ | 127/291 [00:01<00:01, 102.07it/s]
Loading weights: 48%|████▊ | 139/291 [00:01<00:01, 105.72it/s]
Loading weights: 53%|█████▎ | 154/291 [00:01<00:01, 117.18it/s]
Loading weights: 57%|█████▋ | 167/291 [00:01<00:01, 120.72it/s]
Loading weights: 62%|██████▏ | 180/291 [00:01<00:00, 118.21it/s]
Loading weights: 66%|██████▋ | 193/291 [00:01<00:00, 119.89it/s]
Loading weights: 71%|███████ | 206/291 [00:01<00:00, 110.42it/s]
Loading weights: 76%|███████▌ | 220/291 [00:02<00:00, 114.00it/s]
Loading weights: 80%|███████▉ | 232/291 [00:02<00:00, 103.49it/s]
Loading weights: 85%|████████▍ | 247/291 [00:02<00:00, 111.87it/s]
Loading weights: 89%|████████▉ | 259/291 [00:02<00:00, 102.47it/s]
Loading weights: 93%|█████████▎| 272/291 [00:02<00:00, 108.87it/s]
Loading weights: 98%|█████████▊| 284/291 [00:02<00:00, 104.33it/s]
Loading weights: 100%|██████████| 291/291 [00:02<00:00, 107.20it/s]
loading configuration file generation_config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/generation_config.json
Generate config GenerationConfig {
"bos_token_id": 1,
"eos_token_id": 2
}
Could not locate the custom_generate/generate.py inside slovak-nlp/mistral-sk-7b.
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
Unsloth: slovak-nlp/mistral-sk-7b had a bad pad_token (</s>). Using pad_token = <unk>.
/home/schwarc/LLaMA-Factory/src/llamafactory/model/model_utils/checkpointing.py:68: FutureWarning: `torch.cuda.amp.custom_fwd(args...)` is deprecated. Please use `torch.amp.custom_fwd(args..., device_type='cuda')` instead.
@torch.cuda.amp.custom_fwd
/home/schwarc/LLaMA-Factory/src/llamafactory/model/model_utils/checkpointing.py:85: FutureWarning: `torch.cuda.amp.custom_bwd(args...)` is deprecated. Please use `torch.amp.custom_bwd(args..., device_type='cuda')` instead.
@torch.cuda.amp.custom_bwd
[INFO|2026-10-13 06:24:31] llamafactory.model.model_utils.checkpointing:144 >> Gradient checkpointing enabled.
[INFO|2026-10-13 06:24:31] llamafactory.model.adapter:144 >> Upcasting trainable params to float32.
[INFO|2026-10-13 06:24:31] llamafactory.model.adapter:144 >> Fine-tuning method: LoRA
Unsloth 2026.6.1 patched 32 layers with 32 QKV layers, 32 O layers and 32 MLP layers.
[INFO|2026-10-13 06:24:34] llamafactory.model.loader:144 >> trainable params: 41,943,040 || all params: 7,283,675,136 || trainable%: 0.5758
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'pad_token_id': 2}.
==((====))== Unsloth - 2x faster free finetuning | Num GPUs used = 1
\\ /| Num examples = 29,000 | Num Epochs = 1 | Total steps = 1,813
O^O/ \_/ \ Batch size per device = 1 | Gradient accumulation steps = 16
\ / Data Parallel GPUs = 1 | Total batch size (1 x 16 x 1) = 16
"-____-" Trainable parameters = 41,943,040 of 7,283,675,136 (0.58% trained)
0%| | 0/1813 [00:00<?, ?it/s]`use_return_dict` is deprecated! Use `return_dict` instead!
Unsloth: Double buffering enabled (parallel H2D + compute) for backward pass.
Unsloth: Will smartly offload gradients to save VRAM!
0%| | 1/1813 [00:06<3:24:19, 6.77s/it]
0%| | 2/1813 [00:13<3:19:41, 6.62s/it]
0%| | 3/1813 [00:18<3:01:54, 6.03s/it]
0%| | 4/1813 [00:22<2:38:10, 5.25s/it]
0%| | 5/1813 [00:29<2:52:04, 5.71s/it]
0%| | 6/1813 [00:36<3:09:01, 6.28s/it]
0%| | 7/1813 [00:42<3:10:29, 6.33s/it]
0%| | 8/1813 [00:48<2:58:58, 5.95s/it]
0%| | 9/1813 [00:55<3:13:30, 6.44s/it]
1%| | 10/1813 [01:01<3:04:31, 6.14s/it]
{'loss': '1.777', 'grad_norm': '3.533', 'learning_rate': '1.2e-05', 'epoch': '0.005517', 'num_input_tokens_seen': 65928, 'train_runtime': '61.12', 'train_tokens_per_second': '1079'}
1%| | 10/1813 [01:01<3:04:31, 6.14s/it]
1%| | 11/1813 [01:07<3:05:24, 6.17s/it]
1%| | 12/1813 [01:15<3:20:21, 6.68s/it]
1%| | 13/1813 [01:19<2:58:25, 5.95s/it]
1%| | 14/1813 [01:25<2:59:23, 5.98s/it]
1%| | 15/1813 [01:30<2:50:34, 5.69s/it]
1%| | 16/1813 [01:36<2:53:36, 5.80s/it]
1%| | 17/1813 [01:42<2:58:47, 5.97s/it]
1%| | 18/1813 [01:49<3:00:06, 6.02s/it]
1%| | 19/1813 [01:55<3:06:43, 6.24s/it]
1%| | 20/1813 [02:01<3:04:37, 6.18s/it]
{'loss': '1.454', 'grad_norm': '1.221', 'learning_rate': '2.533e-05', 'epoch': '0.01103', 'num_input_tokens_seen': 131352, 'train_runtime': '121.9', 'train_tokens_per_second': '1078'}
1%| | 20/1813 [02:01<3:04:37, 6.18s/it]
1%| | 21/1813 [02:07<3:01:16, 6.07s/it]
1%| | 22/1813 [02:12<2:49:57, 5.69s/it]
1%|▏ | 23/1813 [02:17<2:45:09, 5.54s/it]
1%|▏ | 24/1813 [02:23<2:46:22, 5.58s/it]
1%|▏ | 25/1813 [02:30<2:58:42, 6.00s/it]
1%|▏ | 26/1813 [02:37<3:09:39, 6.37s/it]
1%|▏ | 27/1813 [02:43<3:04:24, 6.20s/it]
2%|▏ | 28/1813 [02:50<3:09:03, 6.35s/it]
2%|▏ | 29/1813 [02:57<3:22:30, 6.81s/it]
2%|▏ | 30/1813 [03:02<3:03:04, 6.16s/it]
{'loss': '1.323', 'grad_norm': '1.325', 'learning_rate': '3.867e-05', 'epoch': '0.01655', 'num_input_tokens_seen': 197376, 'train_runtime': '182.6', 'train_tokens_per_second': '1081'}
2%|▏ | 30/1813 [03:02<3:03:04, 6.16s/it]
2%|▏ | 31/1813 [03:08<3:03:23, 6.18s/it]
2%|▏ | 32/1813 [03:14<2:54:57, 5.89s/it]
2%|▏ | 33/1813 [03:20<2:55:21, 5.91s/it]
2%|▏ | 34/1813 [03:27<3:09:39, 6.40s/it]
2%|▏ | 35/1813 [03:33<3:09:58, 6.41s/it]
2%|▏ | 36/1813 [03:40<3:09:49, 6.41s/it]
2%|▏ | 37/1813 [03:45<2:58:17, 6.02s/it]
2%|▏ | 38/1813 [03:50<2:48:35, 5.70s/it]
2%|▏ | 39/1813 [03:56<2:47:53, 5.68s/it]
2%|▏ | 40/1813 [04:01<2:47:51, 5.68s/it]
{'loss': '1.207', 'grad_norm': '1.188', 'learning_rate': '5.2e-05', 'epoch': '0.02207', 'num_input_tokens_seen': 261168, 'train_runtime': '241.8', 'train_tokens_per_second': '1080'}
2%|▏ | 40/1813 [04:01<2:47:51, 5.68s/it]
2%|▏ | 41/1813 [04:06<2:43:09, 5.52s/it]
2%|▏ | 42/1813 [04:12<2:46:04, 5.63s/it]
2%|▏ | 43/1813 [04:20<3:03:14, 6.21s/it]
2%|▏ | 44/1813 [04:26<3:05:31, 6.29s/it]
2%|▏ | 45/1813 [04:34<3:15:13, 6.63s/it]
3%|▎ | 46/1813 [04:40<3:09:27, 6.43s/it]
3%|▎ | 47/1813 [04:45<3:01:55, 6.18s/it]
3%|▎ | 48/1813 [04:52<3:06:17, 6.33s/it]
3%|▎ | 49/1813 [04:58<3:05:55, 6.32s/it]
3%|▎ | 50/1813 [05:05<3:04:47, 6.29s/it]
{'loss': '1.276', 'grad_norm': '1.357', 'learning_rate': '6.533e-05', 'epoch': '0.02759', 'num_input_tokens_seen': 330104, 'train_runtime': '305', 'train_tokens_per_second': '1082'}
3%|▎ | 50/1813 [05:05<3:04:47, 6.29s/it]
3%|▎ | 51/1813 [05:12<3:15:02, 6.64s/it]
3%|▎ | 52/1813 [05:21<3:38:19, 7.44s/it]
3%|▎ | 53/1813 [05:27<3:25:37, 7.01s/it]
3%|▎ | 54/1813 [05:35<3:29:34, 7.15s/it]
3%|▎ | 55/1813 [05:41<3:21:37, 6.88s/it]
3%|▎ | 56/1813 [05:48<3:19:21, 6.81s/it]
3%|▎ | 57/1813 [05:53<3:03:09, 6.26s/it]
3%|▎ | 58/1813 [06:01<3:21:13, 6.88s/it]
3%|▎ | 59/1813 [06:08<3:22:00, 6.91s/it]
3%|▎ | 60/1813 [06:13<3:07:15, 6.41s/it]
{'loss': '1.17', 'grad_norm': '1.461', 'learning_rate': '7.867e-05', 'epoch': '0.0331', 'num_input_tokens_seen': 407792, 'train_runtime': '373.7', 'train_tokens_per_second': '1091'}
3%|▎ | 60/1813 [06:13<3:07:15, 6.41s/it]
3%|▎ | 61/1813 [06:18<2:55:19, 6.00s/it]
3%|▎ | 62/1813 [06:24<2:51:00, 5.86s/it]
3%|▎ | 63/1813 [06:29<2:49:22, 5.81s/it]
4%|▎ | 64/1813 [06:35<2:48:26, 5.78s/it]
4%|▎ | 65/1813 [06:42<2:59:59, 6.18s/it]
4%|▎ | 66/1813 [06:49<3:00:49, 6.21s/it]
4%|▎ | 67/1813 [06:54<2:54:15, 5.99s/it]
4%|▍ | 68/1813 [07:00<2:55:12, 6.02s/it]
4%|▍ | 69/1813 [07:07<3:04:13, 6.34s/it]
4%|▍ | 70/1813 [07:15<3:13:45, 6.67s/it]
{'loss': '1.066', 'grad_norm': '1.061', 'learning_rate': '9.2e-05', 'epoch': '0.03862', 'num_input_tokens_seen': 474368, 'train_runtime': '435.2', 'train_tokens_per_second': '1090'}
4%|▍ | 70/1813 [07:15<3:13:45, 6.67s/it]
4%|▍ | 71/1813 [07:20<3:03:12, 6.31s/it]
4%|▍ | 72/1813 [07:29<3:24:35, 7.05s/it]
4%|▍ | 73/1813 [07:35<3:12:27, 6.64s/it]
4%|▍ | 74/1813 [07:41<3:08:54, 6.52s/it]
4%|▍ | 75/1813 [07:47<3:09:11, 6.53s/it]
4%|▍ | 76/1813 [07:54<3:05:24, 6.40s/it]
4%|▍ | 77/1813 [08:00<3:09:02, 6.53s/it]
4%|▍ | 78/1813 [08:06<3:00:35, 6.24s/it]
4%|▍ | 79/1813 [08:11<2:54:43, 6.05s/it]
4%|▍ | 80/1813 [08:18<2:56:17, 6.10s/it]
{'loss': '1.089', 'grad_norm': '1.242', 'learning_rate': '0.0001053', 'epoch': '0.04414', 'num_input_tokens_seen': 541616, 'train_runtime': '498.2', 'train_tokens_per_second': '1087'}
4%|▍ | 80/1813 [08:18<2:56:17, 6.10s/it]
4%|▍ | 81/1813 [08:24<2:54:09, 6.03s/it]
5%|▍ | 82/1813 [08:31<3:01:39, 6.30s/it]
5%|▍ | 83/1813 [08:38<3:08:06, 6.52s/it]
5%|▍ | 84/1813 [08:44<3:11:34, 6.65s/it]
5%|▍ | 85/1813 [08:51<3:08:31, 6.55s/it]
5%|▍ | 86/1813 [08:57<3:07:37, 6.52s/it]
5%|▍ | 87/1813 [09:02<2:54:51, 6.08s/it]
5%|▍ | 88/1813 [09:09<2:56:07, 6.13s/it]
5%|▍ | 89/1813 [09:14<2:54:04, 6.06s/it]
5%|▍ | 90/1813 [09:21<2:56:52, 6.16s/it]
{'loss': '1.025', 'grad_norm': '0.8814', 'learning_rate': '0.0001187', 'epoch': '0.04966', 'num_input_tokens_seen': 608792, 'train_runtime': '561.3', 'train_tokens_per_second': '1085'}
5%|▍ | 90/1813 [09:21<2:56:52, 6.16s/it]
5%|▌ | 91/1813 [09:26<2:52:03, 6.00s/it]
5%|▌ | 92/1813 [09:31<2:41:53, 5.64s/it]
5%|▌ | 93/1813 [09:37<2:43:49, 5.71s/it]
5%|▌ | 94/1813 [09:43<2:48:43, 5.89s/it]
5%|▌ | 95/1813 [09:50<2:52:42, 6.03s/it]
5%|▌ | 96/1813 [09:56<2:51:24, 5.99s/it]
5%|▌ | 97/1813 [10:02<2:55:40, 6.14s/it]
5%|▌ | 98/1813 [10:07<2:46:30, 5.83s/it]
5%|▌ | 99/1813 [10:13<2:43:48, 5.73s/it]
6%|▌ | 100/1813 [10:19<2:48:25, 5.90s/it]
{'loss': '1.065', 'grad_norm': '0.8532', 'learning_rate': '0.000132', 'epoch': '0.05517', 'num_input_tokens_seen': 670936, 'train_runtime': '619.6', 'train_tokens_per_second': '1083'}
6%|▌ | 100/1813 [10:19<2:48:25, 5.90s/it]
6%|▌ | 101/1813 [10:26<2:54:33, 6.12s/it]
6%|▌ | 102/1813 [10:32<2:59:05, 6.28s/it]
6%|▌ | 103/1813 [10:38<2:55:52, 6.17s/it]
6%|▌ | 104/1813 [10:45<2:56:22, 6.19s/it]
6%|▌ | 105/1813 [10:50<2:49:38, 5.96s/it]
6%|▌ | 106/1813 [10:56<2:49:41, 5.96s/it]
6%|▌ | 107/1813 [11:02<2:52:46, 6.08s/it]
6%|▌ | 108/1813 [11:09<2:55:05, 6.16s/it]
6%|▌ | 109/1813 [11:15<2:54:23, 6.14s/it]
6%|▌ | 110/1813 [11:22<2:59:41, 6.33s/it]
{'loss': '1.096', 'grad_norm': '0.7748', 'learning_rate': '0.0001453', 'epoch': '0.06069', 'num_input_tokens_seen': 738632, 'train_runtime': '682', 'train_tokens_per_second': '1083'}
6%|▌ | 110/1813 [11:22<2:59:41, 6.33s/it]
6%|▌ | 111/1813 [11:28<3:03:54, 6.48s/it]
6%|▌ | 112/1813 [11:35<3:05:50, 6.56s/it]
6%|▌ | 113/1813 [11:41<3:02:36, 6.45s/it]
6%|▋ | 114/1813 [11:49<3:11:43, 6.77s/it]
6%|▋ | 115/1813 [11:55<3:03:21, 6.48s/it]
6%|▋ | 116/1813 [12:01<3:06:24, 6.59s/it]
6%|▋ | 117/1813 [12:07<2:56:20, 6.24s/it]
7%|▋ | 118/1813 [12:13<2:52:33, 6.11s/it]
7%|▋ | 119/1813 [12:19<2:53:52, 6.16s/it]
7%|▋ | 120/1813 [12:25<2:54:26, 6.18s/it]
{'loss': '1.1', 'grad_norm': '1.095', 'learning_rate': '0.0001587', 'epoch': '0.06621', 'num_input_tokens_seen': 808824, 'train_runtime': '745.7', 'train_tokens_per_second': '1085'}
7%|▋ | 120/1813 [12:25<2:54:26, 6.18s/it]
7%|▋ | 121/1813 [12:29<2:36:52, 5.56s/it]
7%|▋ | 122/1813 [12:34<2:31:32, 5.38s/it]
7%|▋ | 123/1813 [12:41<2:40:04, 5.68s/it]
7%|▋ | 124/1813 [12:46<2:36:01, 5.54s/it]
7%|▋ | 125/1813 [12:52<2:44:48, 5.86s/it]
7%|▋ | 126/1813 [12:59<2:47:08, 5.94s/it]
7%|▋ | 127/1813 [13:03<2:35:57, 5.55s/it]
7%|▋ | 128/1813 [13:08<2:29:06, 5.31s/it]
7%|▋ | 129/1813 [13:16<2:52:42, 6.15s/it]
7%|▋ | 130/1813 [13:23<2:56:34, 6.30s/it]
{'loss': '1.042', 'grad_norm': '0.7589', 'learning_rate': '0.000172', 'epoch': '0.07172', 'num_input_tokens_seen': 869720, 'train_runtime': '803.2', 'train_tokens_per_second': '1083'}
7%|▋ | 130/1813 [13:23<2:56:34, 6.30s/it]
7%|▋ | 131/1813 [13:29<2:52:35, 6.16s/it]
7%|▋ | 132/1813 [13:34<2:44:15, 5.86s/it]
7%|▋ | 133/1813 [13:39<2:40:35, 5.74s/it]
7%|▋ | 134/1813 [13:44<2:34:10, 5.51s/it]
7%|▋ | 135/1813 [13:49<2:30:36, 5.39s/it]
8%|▊ | 136/1813 [13:55<2:34:05, 5.51s/it]
8%|▊ | 137/1813 [14:01<2:38:52, 5.69s/it]
8%|▊ | 138/1813 [14:08<2:50:46, 6.12s/it]
8%|▊ | 139/1813 [14:15<2:55:02, 6.27s/it]
8%|▊ | 140/1813 [14:22<3:00:09, 6.46s/it]
{'loss': '1.042', 'grad_norm': '1.091', 'learning_rate': '0.0001853', 'epoch': '0.07724', 'num_input_tokens_seen': 932000, 'train_runtime': '862.3', 'train_tokens_per_second': '1081'}
8%|▊ | 140/1813 [14:22<3:00:09, 6.46s/it]
8%|▊ | 141/1813 [14:27<2:52:10, 6.18s/it]
8%|▊ | 142/1813 [14:35<3:06:21, 6.69s/it]
8%|▊ | 143/1813 [14:41<2:54:55, 6.28s/it]
8%|▊ | 144/1813 [14:46<2:44:58, 5.93s/it]
8%|▊ | 145/1813 [14:53<2:54:24, 6.27s/it]
8%|▊ | 146/1813 [14:59<2:54:55, 6.30s/it]
8%|▊ | 147/1813 [15:05<2:49:37, 6.11s/it]
8%|▊ | 148/1813 [15:11<2:49:00, 6.09s/it]
8%|▊ | 149/1813 [15:17<2:46:53, 6.02s/it]
8%|▊ | 150/1813 [15:23<2:48:32, 6.08s/it]
{'loss': '1.1', 'grad_norm': '0.8783', 'learning_rate': '0.0001987', 'epoch': '0.08276', 'num_input_tokens_seen': 997296, 'train_runtime': '923.4', 'train_tokens_per_second': '1080'}
8%|▊ | 150/1813 [15:23<2:48:32, 6.08s/it]
8%|▊ | 151/1813 [15:28<2:43:25, 5.90s/it]
8%|▊ | 152/1813 [15:34<2:41:23, 5.83s/it]
8%|▊ | 153/1813 [15:40<2:42:59, 5.89s/it]
8%|▊ | 154/1813 [15:47<2:47:37, 6.06s/it]
9%|▊ | 155/1813 [15:54<2:56:26, 6.38s/it]
9%|▊ | 156/1813 [16:00<2:53:18, 6.28s/it]
9%|▊ | 157/1813 [16:06<2:52:44, 6.26s/it]
9%|▊ | 158/1813 [16:11<2:42:17, 5.88s/it]
9%|▉ | 159/1813 [16:17<2:40:47, 5.83s/it]
9%|▉ | 160/1813 [16:22<2:38:40, 5.76s/it]
{'loss': '1.026', 'grad_norm': '1.363', 'learning_rate': '0.0002', 'epoch': '0.08828', 'num_input_tokens_seen': 1060096, 'train_runtime': '982.7', 'train_tokens_per_second': '1079'}
9%|▉ | 160/1813 [16:22<2:38:40, 5.76s/it]
9%|▉ | 161/1813 [16:28<2:38:21, 5.75s/it]
9%|▉ | 162/1813 [16:32<2:25:33, 5.29s/it]
9%|▉ | 163/1813 [16:39<2:36:38, 5.70s/it]
9%|▉ | 164/1813 [16:46<2:49:29, 6.17s/it]
9%|▉ | 165/1813 [16:52<2:49:24, 6.17s/it]
9%|▉ | 166/1813 [17:00<3:02:11, 6.64s/it]
9%|▉ | 167/1813 [17:07<3:02:24, 6.65s/it]
9%|▉ | 168/1813 [17:14<3:06:19, 6.80s/it]
9%|▉ | 169/1813 [17:19<2:56:50, 6.45s/it]
9%|▉ | 170/1813 [17:26<2:58:35, 6.52s/it]
{'loss': '1.053', 'grad_norm': '0.6226', 'learning_rate': '0.0001999', 'epoch': '0.09379', 'num_input_tokens_seen': 1130368, 'train_runtime': '1047', 'train_tokens_per_second': '1080'}
9%|▉ | 170/1813 [17:26<2:58:35, 6.52s/it]
9%|▉ | 171/1813 [17:31<2:48:43, 6.17s/it]
9%|▉ | 172/1813 [17:37<2:41:58, 5.92s/it]
10%|▉ | 173/1813 [17:43<2:45:46, 6.07s/it]
10%|▉ | 174/1813 [17:49<2:43:05, 5.97s/it]
10%|▉ | 175/1813 [17:55<2:45:07, 6.05s/it]
10%|▉ | 176/1813 [18:00<2:37:22, 5.77s/it]
10%|▉ | 177/1813 [18:08<2:51:03, 6.27s/it]
10%|▉ | 178/1813 [18:13<2:39:23, 5.85s/it]
10%|▉ | 179/1813 [18:19<2:39:48, 5.87s/it]
10%|▉ | 180/1813 [18:25<2:41:31, 5.93s/it]
{'loss': '1.037', 'grad_norm': '0.9835', 'learning_rate': '0.0001998', 'epoch': '0.09931', 'num_input_tokens_seen': 1193192, 'train_runtime': '1105', 'train_tokens_per_second': '1080'}
10%|▉ | 180/1813 [18:25<2:41:31, 5.93s/it]
10%|▉ | 181/1813 [18:30<2:37:55, 5.81s/it]
10%|█ | 182/1813 [18:35<2:34:14, 5.67s/it]
10%|█ | 183/1813 [18:41<2:33:22, 5.65s/it]
10%|█ | 184/1813 [18:46<2:31:26, 5.58s/it]
10%|█ | 185/1813 [18:55<2:51:19, 6.31s/it]
10%|█ | 186/1813 [19:01<2:51:12, 6.31s/it]
10%|█ | 187/1813 [19:07<2:49:10, 6.24s/it]
10%|█ | 188/1813 [19:12<2:40:39, 5.93s/it]
10%|█ | 189/1813 [19:19<2:46:11, 6.14s/it]
10%|█ | 190/1813 [19:25<2:50:30, 6.30s/it]
{'loss': '0.9777', 'grad_norm': '0.9615', 'learning_rate': '0.0001997', 'epoch': '0.1048', 'num_input_tokens_seen': 1259336, 'train_runtime': '1166', 'train_tokens_per_second': '1080'}
10%|█ | 190/1813 [19:25<2:50:30, 6.30s/it]
11%|█ | 191/1813 [19:31<2:44:58, 6.10s/it]
11%|█ | 192/1813 [19:38<2:49:12, 6.26s/it]
11%|█ | 193/1813 [19:44<2:52:52, 6.40s/it]
11%|█ | 194/1813 [19:51<2:50:27, 6.32s/it]
11%|█ | 195/1813 [19:58<3:00:52, 6.71s/it]
11%|█ | 196/1813 [20:04<2:50:15, 6.32s/it]
11%|█ | 197/1813 [20:11<2:57:06, 6.58s/it]
11%|█ | 198/1813 [20:18<3:03:34, 6.82s/it]
11%|█ | 199/1813 [20:25<3:03:06, 6.81s/it]
11%|█ | 200/1813 [20:32<3:01:52, 6.77s/it]
{'loss': '1.086', 'grad_norm': '1.075', 'learning_rate': '0.0001996', 'epoch': '0.1103', 'num_input_tokens_seen': 1331224, 'train_runtime': '1232', 'train_tokens_per_second': '1080'}
11%|█ | 200/1813 [20:32<3:01:52, 6.77s/it]
11%|█ | 201/1813 [20:37<2:52:39, 6.43s/it]
11%|█ | 202/1813 [20:42<2:43:23, 6.09s/it]
11%|█ | 203/1813 [20:48<2:35:35, 5.80s/it]
11%|█▏ | 204/1813 [20:55<2:45:05, 6.16s/it]
11%|█▏ | 205/1813 [21:00<2:38:56, 5.93s/it]
11%|█▏ | 206/1813 [21:06<2:38:21, 5.91s/it]
11%|█▏ | 207/1813 [21:12<2:38:34, 5.92s/it]
11%|█▏ | 208/1813 [21:20<2:53:52, 6.50s/it]
12%|█▏ | 209/1813 [21:25<2:42:19, 6.07s/it]
12%|█▏ | 210/1813 [21:31<2:44:02, 6.14s/it]
{'loss': '0.9652', 'grad_norm': '1.053', 'learning_rate': '0.0001994', 'epoch': '0.1159', 'num_input_tokens_seen': 1392472, 'train_runtime': '1292', 'train_tokens_per_second': '1078'}
12%|█▏ | 210/1813 [21:31<2:44:02, 6.14s/it]
12%|█▏ | 211/1813 [21:40<3:04:57, 6.93s/it]
12%|█▏ | 212/1813 [21:46<2:55:59, 6.60s/it]
12%|█▏ | 213/1813 [21:51<2:47:05, 6.27s/it]
12%|█▏ | 214/1813 [21:57<2:40:25, 6.02s/it]
12%|█▏ | 215/1813 [22:02<2:35:52, 5.85s/it]
12%|█▏ | 216/1813 [22:07<2:25:11, 5.45s/it]
12%|█▏ | 217/1813 [22:12<2:22:36, 5.36s/it]
12%|█▏ | 218/1813 [22:18<2:30:06, 5.65s/it]
12%|█▏ | 219/1813 [22:24<2:34:15, 5.81s/it]
12%|█▏ | 220/1813 [22:30<2:36:59, 5.91s/it]
{'loss': '1.042', 'grad_norm': '0.8483', 'learning_rate': '0.0001992', 'epoch': '0.1214', 'num_input_tokens_seen': 1454040, 'train_runtime': '1351', 'train_tokens_per_second': '1076'}
12%|█▏ | 220/1813 [22:30<2:36:59, 5.91s/it]
12%|█▏ | 221/1813 [22:37<2:40:39, 6.06s/it]
12%|█▏ | 222/1813 [22:42<2:34:00, 5.81s/it]
12%|█▏ | 223/1813 [22:50<2:47:45, 6.33s/it]
12%|█▏ | 224/1813 [22:55<2:37:16, 5.94s/it]
12%|█▏ | 225/1813 [23:02<2:45:49, 6.27s/it]
12%|█▏ | 226/1813 [23:08<2:50:08, 6.43s/it]
13%|█▎ | 227/1813 [23:14<2:45:24, 6.26s/it]
13%|█▎ | 228/1813 [23:21<2:47:35, 6.34s/it]
13%|█▎ | 229/1813 [23:28<2:53:59, 6.59s/it]
13%|█▎ | 230/1813 [23:33<2:41:23, 6.12s/it]
{'loss': '1.007', 'grad_norm': '1.187', 'learning_rate': '0.0001989', 'epoch': '0.1269', 'num_input_tokens_seen': 1522056, 'train_runtime': '1413', 'train_tokens_per_second': '1077'}
13%|█▎ | 230/1813 [23:33<2:41:23, 6.12s/it]
13%|█▎ | 231/1813 [23:38<2:33:03, 5.81s/it]
13%|█▎ | 232/1813 [23:45<2:45:38, 6.29s/it]
13%|█▎ | 233/1813 [23:51<2:36:27, 5.94s/it]
13%|█▎ | 234/1813 [23:56<2:31:53, 5.77s/it]
13%|█▎ | 235/1813 [24:03<2:41:09, 6.13s/it]
13%|█▎ | 236/1813 [24:11<2:52:48, 6.58s/it]
13%|█▎ | 237/1813 [24:18<2:55:41, 6.69s/it]
13%|█▎ | 238/1813 [24:23<2:47:48, 6.39s/it]
13%|█▎ | 239/1813 [24:31<2:57:39, 6.77s/it]
13%|█▎ | 240/1813 [24:37<2:54:02, 6.64s/it]
{'loss': '1.002', 'grad_norm': '0.8349', 'learning_rate': '0.0001986', 'epoch': '0.1324', 'num_input_tokens_seen': 1590200, 'train_runtime': '1478', 'train_tokens_per_second': '1076'}
13%|█▎ | 240/1813 [24:37<2:54:02, 6.64s/it]
13%|█▎ | 241/1813 [24:44<2:52:13, 6.57s/it]
13%|█▎ | 242/1813 [24:50<2:50:00, 6.49s/it]
13%|█▎ | 243/1813 [24:56<2:45:02, 6.31s/it]
13%|█▎ | 244/1813 [25:03<2:51:57, 6.58s/it]
14%|█▎ | 245/1813 [25:10<2:56:34, 6.76s/it]
14%|█▎ | 246/1813 [25:16<2:47:33, 6.42s/it]
14%|█▎ | 247/1813 [25:23<2:51:54, 6.59s/it]
14%|█▎ | 248/1813 [25:31<3:01:50, 6.97s/it]
14%|█▎ | 249/1813 [25:36<2:51:16, 6.57s/it]
14%|█▍ | 250/1813 [25:42<2:43:59, 6.30s/it]
{'loss': '1.08', 'grad_norm': '0.9302', 'learning_rate': '0.0001983', 'epoch': '0.1379', 'num_input_tokens_seen': 1658648, 'train_runtime': '1542', 'train_tokens_per_second': '1075'}
14%|█▍ | 250/1813 [25:42<2:43:59, 6.30s/it]
14%|█▍ | 251/1813 [25:47<2:30:19, 5.77s/it]
14%|█▍ | 252/1813 [25:52<2:26:41, 5.64s/it]
14%|█▍ | 253/1813 [25:58<2:30:51, 5.80s/it]
14%|█▍ | 254/1813 [26:05<2:42:21, 6.25s/it]
14%|█▍ | 255/1813 [26:12<2:45:12, 6.36s/it]
14%|█▍ | 256/1813 [26:17<2:37:18, 6.06s/it]
14%|█▍ | 257/1813 [26:24<2:42:46, 6.28s/it]
14%|█▍ | 258/1813 [26:31<2:48:22, 6.50s/it]
14%|█▍ | 259/1813 [26:36<2:34:18, 5.96s/it]
14%|█▍ | 260/1813 [26:42<2:33:53, 5.95s/it]
{'loss': '0.8734', 'grad_norm': '1.161', 'learning_rate': '0.0001979', 'epoch': '0.1434', 'num_input_tokens_seen': 1722792, 'train_runtime': '1602', 'train_tokens_per_second': '1075'}
14%|█▍ | 260/1813 [26:42<2:33:53, 5.95s/it]
14%|█▍ | 261/1813 [26:49<2:43:17, 6.31s/it]
14%|█▍ | 262/1813 [26:55<2:45:31, 6.40s/it]
15%|█▍ | 263/1813 [27:02<2:46:19, 6.44s/it]
15%|█▍ | 264/1813 [27:08<2:45:02, 6.39s/it]
15%|█▍ | 265/1813 [27:14<2:43:28, 6.34s/it]
15%|█▍ | 266/1813 [27:19<2:32:34, 5.92s/it]
15%|█▍ | 267/1813 [27:25<2:28:52, 5.78s/it]
15%|█▍ | 268/1813 [27:30<2:23:21, 5.57s/it]
15%|█▍ | 269/1813 [27:36<2:27:55, 5.75s/it]
15%|█▍ | 270/1813 [27:42<2:28:23, 5.77s/it]
{'loss': '0.9334', 'grad_norm': '1.075', 'learning_rate': '0.0001975', 'epoch': '0.149', 'num_input_tokens_seen': 1786808, 'train_runtime': '1662', 'train_tokens_per_second': '1075'}
15%|█▍ | 270/1813 [27:42<2:28:23, 5.77s/it]
15%|█▍ | 271/1813 [27:50<2:44:56, 6.42s/it]
15%|█▌ | 272/1813 [27:55<2:37:04, 6.12s/it]
15%|█▌ | 273/1813 [28:04<2:54:23, 6.79s/it]
15%|█▌ | 274/1813 [28:10<2:53:35, 6.77s/it]
15%|█▌ | 275/1813 [28:16<2:41:43, 6.31s/it]
15%|█▌ | 276/1813 [28:21<2:32:41, 5.96s/it]
15%|█▌ | 277/1813 [28:27<2:34:18, 6.03s/it]
15%|█▌ | 278/1813 [28:33<2:34:18, 6.03s/it]
15%|█▌ | 279/1813 [28:41<2:46:22, 6.51s/it]
15%|█▌ | 280/1813 [28:47<2:45:37, 6.48s/it]
{'loss': '1.018', 'grad_norm': '0.9419', 'learning_rate': '0.000197', 'epoch': '0.1545', 'num_input_tokens_seen': 1858112, 'train_runtime': '1728', 'train_tokens_per_second': '1076'}
15%|█▌ | 280/1813 [28:47<2:45:37, 6.48s/it]
15%|█▌ | 281/1813 [28:53<2:39:07, 6.23s/it]
16%|█▌ | 282/1813 [28:58<2:34:19, 6.05s/it]
16%|█▌ | 283/1813 [29:04<2:29:00, 5.84s/it]
16%|█▌ | 284/1813 [29:09<2:26:49, 5.76s/it]
16%|█▌ | 285/1813 [29:16<2:34:39, 6.07s/it]
16%|█▌ | 286/1813 [29:22<2:34:30, 6.07s/it]
16%|█▌ | 287/1813 [29:28<2:35:57, 6.13s/it]
16%|█▌ | 288/1813 [29:34<2:31:47, 5.97s/it]
16%|█▌ | 289/1813 [29:41<2:36:35, 6.16s/it]
16%|█▌ | 290/1813 [29:47<2:40:42, 6.33s/it]
{'loss': '0.9688', 'grad_norm': '0.933', 'learning_rate': '0.0001966', 'epoch': '0.16', 'num_input_tokens_seen': 1920600, 'train_runtime': '1788', 'train_tokens_per_second': '1074'}
16%|█▌ | 290/1813 [29:47<2:40:42, 6.33s/it]
16%|█▌ | 291/1813 [29:54<2:46:58, 6.58s/it]
16%|█▌ | 292/1813 [30:02<2:53:00, 6.82s/it]
16%|█▌ | 293/1813 [30:08<2:45:55, 6.55s/it]
16%|█▌ | 294/1813 [30:15<2:50:16, 6.73s/it]
16%|█▋ | 295/1813 [30:22<2:55:11, 6.92s/it]
16%|█▋ | 296/1813 [30:28<2:45:51, 6.56s/it]
16%|█▋ | 297/1813 [30:34<2:41:42, 6.40s/it]
16%|█▋ | 298/1813 [30:39<2:30:32, 5.96s/it]
16%|█▋ | 299/1813 [30:45<2:31:47, 6.02s/it]
17%|█▋ | 300/1813 [30:51<2:31:21, 6.00s/it]
{'loss': '1.039', 'grad_norm': '0.9525', 'learning_rate': '0.0001961', 'epoch': '0.1655', 'num_input_tokens_seen': 1988312, 'train_runtime': '1852', 'train_tokens_per_second': '1074'}
17%|█▋ | 300/1813 [30:51<2:31:21, 6.00s/it]
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:71: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:281: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:172: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:202: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:254: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:03, 15.81it/s]
0%| | 5/1000 [00:00<02:17, 7.24it/s]
1%| | 7/1000 [00:00<01:59, 8.33it/s]
1%| | 9/1000 [00:01<02:33, 6.47it/s]
1%| | 11/1000 [00:01<02:02, 8.09it/s]
1%|▏ | 13/1000 [00:01<02:20, 7.01it/s]
1%|▏ | 14/1000 [00:01<02:24, 6.84it/s]
2%|▏ | 15/1000 [00:02<02:44, 5.97it/s]
2%|▏ | 16/1000 [00:02<02:51, 5.73it/s]
2%|▏ | 18/1000 [00:02<02:42, 6.05it/s]
2%|▏ | 19/1000 [00:02<03:10, 5.14it/s]
2%|▏ | 20/1000 [00:03<03:33, 4.60it/s]
2%|▏ | 22/1000 [00:03<02:36, 6.24it/s]
2%|▏ | 23/1000 [00:03<02:54, 5.59it/s]
2%|▎ | 25/1000 [00:03<02:12, 7.36it/s]
3%|▎ | 26/1000 [00:04<02:35, 6.26it/s]
3%|▎ | 28/1000 [00:04<02:42, 5.99it/s]
3%|▎ | 29/1000 [00:04<02:32, 6.36it/s]
3%|▎ | 30/1000 [00:04<02:42, 5.97it/s]
3%|▎ | 31/1000 [00:04<03:00, 5.35it/s]
3%|▎ | 32/1000 [00:05<02:41, 5.99it/s]
3%|▎ | 33/1000 [00:05<02:48, 5.75it/s]
4%|▎ | 35/1000 [00:05<02:06, 7.66it/s]
4%|▎ | 37/1000 [00:05<01:45, 9.10it/s]
4%|▍ | 39/1000 [00:05<02:06, 7.58it/s]
4%|▍ | 40/1000 [00:05<02:04, 7.74it/s]
4%|▍ | 42/1000 [00:06<01:45, 9.10it/s]
4%|▍ | 44/1000 [00:06<01:32, 10.32it/s]
5%|▍ | 46/1000 [00:06<01:45, 9.05it/s]
5%|▍ | 47/1000 [00:06<02:09, 7.37it/s]
5%|▍ | 49/1000 [00:06<01:48, 8.76it/s]
5%|▌ | 51/1000 [00:07<01:35, 9.92it/s]
5%|▌ | 53/1000 [00:07<01:26, 10.94it/s]
6%|▌ | 55/1000 [00:07<01:27, 10.75it/s]
6%|▌ | 57/1000 [00:07<01:41, 9.30it/s]
6%|▌ | 59/1000 [00:08<01:54, 8.20it/s]
6%|▌ | 61/1000 [00:08<01:40, 9.34it/s]
6%|▋ | 63/1000 [00:08<01:36, 9.75it/s]
6%|▋ | 65/1000 [00:08<01:51, 8.36it/s]
7%|▋ | 67/1000 [00:09<02:03, 7.58it/s]
7%|▋ | 69/1000 [00:09<01:52, 8.27it/s]
7%|▋ | 70/1000 [00:09<02:13, 6.99it/s]
7%|▋ | 72/1000 [00:09<02:18, 6.72it/s]
7%|▋ | 74/1000 [00:09<01:53, 8.13it/s]
8%|▊ | 75/1000 [00:10<02:14, 6.87it/s]
8%|▊ | 76/1000 [00:10<02:18, 6.67it/s]
8%|▊ | 78/1000 [00:10<02:25, 6.32it/s]
8%|▊ | 80/1000 [00:10<01:57, 7.85it/s]
8%|▊ | 82/1000 [00:10<01:39, 9.20it/s]
8%|▊ | 84/1000 [00:11<01:54, 8.02it/s]
8%|▊ | 85/1000 [00:11<02:14, 6.79it/s]
9%|▊ | 86/1000 [00:11<02:33, 5.95it/s]
9%|▊ | 87/1000 [00:11<02:49, 5.38it/s]
9%|▉ | 89/1000 [00:12<02:10, 7.00it/s]
9%|▉ | 90/1000 [00:12<02:05, 7.25it/s]
9%|▉ | 91/1000 [00:12<02:29, 6.08it/s]
9%|▉ | 92/1000 [00:12<02:27, 6.17it/s]
9%|▉ | 93/1000 [00:12<02:36, 5.78it/s]
10%|▉ | 95/1000 [00:13<02:44, 5.52it/s]
10%|▉ | 97/1000 [00:13<02:13, 6.79it/s]
10%|▉ | 99/1000 [00:13<01:47, 8.36it/s]
10%|█ | 101/1000 [00:13<01:33, 9.63it/s]
10%|█ | 103/1000 [00:14<01:56, 7.73it/s]
10%|█ | 104/1000 [00:14<01:54, 7.81it/s]
11%|█ | 106/1000 [00:14<01:35, 9.34it/s]
11%|█ | 108/1000 [00:14<01:25, 10.47it/s]
11%|█ | 110/1000 [00:14<01:19, 11.22it/s]
11%|█ | 112/1000 [00:14<01:13, 12.05it/s]
11%|█▏ | 114/1000 [00:14<01:10, 12.54it/s]
12%|█▏ | 116/1000 [00:15<01:09, 12.81it/s]
12%|█▏ | 118/1000 [00:15<01:06, 13.24it/s]
12%|█▏ | 120/1000 [00:15<02:07, 6.92it/s]
12%|█▏ | 122/1000 [00:15<01:48, 8.08it/s]
12%|█▏ | 124/1000 [00:16<01:58, 7.42it/s]
12%|█▎ | 125/1000 [00:16<02:32, 5.72it/s]
13%|█▎ | 126/1000 [00:16<02:22, 6.14it/s]
13%|█▎ | 127/1000 [00:16<02:30, 5.80it/s]
13%|█▎ | 128/1000 [00:17<02:45, 5.28it/s]
13%|█▎ | 130/1000 [00:17<02:02, 7.10it/s]
13%|█▎ | 132/1000 [00:17<01:39, 8.71it/s]
13%|█▎ | 134/1000 [00:17<01:25, 10.16it/s]
14%|█▎ | 136/1000 [00:17<01:29, 9.64it/s]
14%|█▍ | 138/1000 [00:18<01:27, 9.88it/s]
14%|█▍ | 140/1000 [00:18<01:26, 9.95it/s]
14%|█▍ | 142/1000 [00:18<01:34, 9.03it/s]
14%|█▍ | 143/1000 [00:18<01:36, 8.89it/s]
14%|█▍ | 145/1000 [00:18<01:24, 10.06it/s]
15%|█▍ | 147/1000 [00:19<01:41, 8.43it/s]
15%|█▍ | 148/1000 [00:19<01:40, 8.49it/s]
15%|█▌ | 150/1000 [00:19<01:25, 9.92it/s]
15%|█▌ | 152/1000 [00:19<01:16, 11.05it/s]
15%|█▌ | 154/1000 [00:19<01:21, 10.43it/s]
16%|█▌ | 156/1000 [00:20<02:06, 6.65it/s]
16%|█▌ | 158/1000 [00:20<01:45, 7.98it/s]
16%|█▌ | 160/1000 [00:20<01:37, 8.61it/s]
16%|█▌ | 162/1000 [00:20<01:47, 7.81it/s]
16%|█▋ | 163/1000 [00:21<01:51, 7.50it/s]
16%|█▋ | 164/1000 [00:21<02:10, 6.40it/s]
16%|█▋ | 165/1000 [00:21<02:27, 5.67it/s]
17%|█▋ | 166/1000 [00:21<02:41, 5.18it/s]
17%|█▋ | 167/1000 [00:21<02:24, 5.77it/s]
17%|█▋ | 169/1000 [00:22<01:46, 7.84it/s]
17%|█▋ | 171/1000 [00:22<01:55, 7.15it/s]
17%|█▋ | 172/1000 [00:22<02:14, 6.15it/s]
17%|█▋ | 173/1000 [00:22<02:12, 6.22it/s]
17%|█▋ | 174/1000 [00:22<02:02, 6.73it/s]
18%|█▊ | 176/1000 [00:23<01:37, 8.45it/s]
18%|█▊ | 177/1000 [00:23<02:00, 6.81it/s]
18%|█▊ | 179/1000 [00:23<01:35, 8.58it/s]
18%|█▊ | 180/1000 [00:23<01:36, 8.52it/s]
18%|█▊ | 181/1000 [00:23<02:01, 6.76it/s]
18%|█▊ | 182/1000 [00:24<02:23, 5.72it/s]
18%|█▊ | 183/1000 [00:24<02:21, 5.79it/s]
18%|█▊ | 185/1000 [00:24<01:45, 7.74it/s]
19%|█▊ | 186/1000 [00:24<01:43, 7.90it/s]
19%|█▊ | 187/1000 [00:24<02:07, 6.39it/s]
19%|█▉ | 189/1000 [00:24<01:39, 8.12it/s]
19%|█▉ | 190/1000 [00:25<02:01, 6.64it/s]
19%|█▉ | 192/1000 [00:25<02:04, 6.49it/s]
19%|█▉ | 193/1000 [00:25<01:54, 7.02it/s]
19%|█▉ | 194/1000 [00:25<02:14, 6.00it/s]
20%|█▉ | 196/1000 [00:25<01:44, 7.72it/s]
20%|█▉ | 198/1000 [00:26<01:25, 9.37it/s]
20%|██ | 200/1000 [00:26<01:12, 10.96it/s]
20%|██ | 202/1000 [00:26<01:30, 8.79it/s]
20%|██ | 204/1000 [00:26<01:32, 8.65it/s]
21%|██ | 206/1000 [00:26<01:19, 9.99it/s]
21%|██ | 208/1000 [00:27<01:32, 8.53it/s]
21%|██ | 210/1000 [00:27<01:33, 8.48it/s]
21%|██ | 212/1000 [00:27<01:21, 9.69it/s]
21%|██▏ | 214/1000 [00:27<01:29, 8.73it/s]
22%|██▏ | 216/1000 [00:28<01:25, 9.15it/s]
22%|██▏ | 217/1000 [00:28<01:44, 7.49it/s]
22%|██▏ | 219/1000 [00:28<01:28, 8.78it/s]
22%|██▏ | 220/1000 [00:28<02:03, 6.30it/s]
22%|██▏ | 221/1000 [00:28<02:03, 6.29it/s]
22%|██▏ | 223/1000 [00:29<02:20, 5.55it/s]
22%|██▏ | 224/1000 [00:29<02:08, 6.05it/s]
22%|██▎ | 225/1000 [00:29<02:07, 6.10it/s]
23%|██▎ | 226/1000 [00:29<02:23, 5.41it/s]
23%|██▎ | 228/1000 [00:30<01:53, 6.81it/s]
23%|██▎ | 229/1000 [00:30<02:10, 5.90it/s]
23%|██▎ | 230/1000 [00:30<02:00, 6.37it/s]
23%|██▎ | 232/1000 [00:30<01:35, 8.02it/s]
23%|██▎ | 233/1000 [00:30<01:33, 8.21it/s]
24%|██▎ | 235/1000 [00:30<01:16, 9.96it/s]
24%|██▎ | 237/1000 [00:31<01:20, 9.46it/s]
24%|██▍ | 239/1000 [00:31<01:25, 8.88it/s]
24%|██▍ | 241/1000 [00:31<01:31, 8.30it/s]
24%|██▍ | 242/1000 [00:31<02:06, 6.00it/s]
24%|██▍ | 243/1000 [00:32<02:19, 5.44it/s]
24%|██▍ | 245/1000 [00:32<01:53, 6.63it/s]
25%|██▍ | 247/1000 [00:32<01:31, 8.22it/s]
25%|██▍ | 248/1000 [00:32<01:49, 6.84it/s]
25%|██▍ | 249/1000 [00:33<02:06, 5.95it/s]
25%|██▌ | 250/1000 [00:33<02:07, 5.86it/s]
25%|██▌ | 252/1000 [00:33<02:04, 6.02it/s]
25%|██▌ | 253/1000 [00:33<02:10, 5.74it/s]
26%|██▌ | 255/1000 [00:33<01:41, 7.36it/s]
26%|██▌ | 256/1000 [00:33<01:36, 7.69it/s]
26%|██▌ | 258/1000 [00:34<01:24, 8.74it/s]
26%|██▌ | 260/1000 [00:34<01:36, 7.68it/s]
26%|██▌ | 261/1000 [00:34<01:53, 6.51it/s]
26%|██▌ | 262/1000 [00:34<01:54, 6.43it/s]
26%|██▋ | 264/1000 [00:35<01:56, 6.33it/s]
26%|██▋ | 265/1000 [00:35<01:51, 6.59it/s]
27%|██▋ | 266/1000 [00:35<01:46, 6.90it/s]
27%|██▋ | 268/1000 [00:35<01:37, 7.53it/s]
27%|██▋ | 270/1000 [00:36<01:43, 7.02it/s]
27%|██▋ | 271/1000 [00:36<02:14, 5.43it/s]
27%|██▋ | 273/1000 [00:36<02:07, 5.69it/s]
28%|██▊ | 275/1000 [00:36<01:48, 6.70it/s]
28%|██▊ | 277/1000 [00:37<01:29, 8.05it/s]
28%|██▊ | 278/1000 [00:37<01:46, 6.80it/s]
28%|██▊ | 280/1000 [00:37<01:48, 6.61it/s]
28%|██▊ | 282/1000 [00:37<01:29, 8.02it/s]
28%|██▊ | 283/1000 [00:38<02:02, 5.85it/s]
28%|██▊ | 284/1000 [00:38<02:05, 5.70it/s]
29%|██▊ | 286/1000 [00:38<01:36, 7.42it/s]
29%|██▉ | 288/1000 [00:38<01:21, 8.73it/s]
29%|██▉ | 290/1000 [00:38<01:31, 7.77it/s]
29%|██▉ | 291/1000 [00:39<01:41, 7.00it/s]
29%|██▉ | 292/1000 [00:39<01:56, 6.07it/s]
29%|██▉ | 294/1000 [00:39<01:38, 7.19it/s]
30%|██▉ | 296/1000 [00:39<01:42, 6.89it/s]
30%|██▉ | 298/1000 [00:39<01:25, 8.19it/s]
30%|██▉ | 299/1000 [00:40<01:48, 6.47it/s]
30%|███ | 300/1000 [00:40<01:42, 6.86it/s]
30%|███ | 301/1000 [00:40<01:38, 7.12it/s]
30%|███ | 303/1000 [00:40<01:19, 8.75it/s]
30%|███ | 304/1000 [00:40<01:26, 8.07it/s]
30%|███ | 305/1000 [00:40<01:25, 8.14it/s]
31%|███ | 306/1000 [00:41<01:39, 6.94it/s]
31%|███ | 307/1000 [00:41<01:42, 6.78it/s]
31%|███ | 309/1000 [00:41<01:18, 8.80it/s]
31%|███ | 311/1000 [00:41<01:07, 10.20it/s]
31%|███▏ | 313/1000 [00:41<01:00, 11.27it/s]
32%|███▏ | 315/1000 [00:41<01:06, 10.25it/s]
32%|███▏ | 317/1000 [00:42<01:11, 9.57it/s]
32%|███▏ | 319/1000 [00:42<01:34, 7.23it/s]
32%|███▏ | 321/1000 [00:42<01:38, 6.89it/s]
32%|███▏ | 322/1000 [00:43<01:45, 6.43it/s]
32%|███▏ | 324/1000 [00:43<01:27, 7.74it/s]
32%|███▎ | 325/1000 [00:43<01:58, 5.70it/s]
33%|███▎ | 327/1000 [00:43<01:30, 7.41it/s]
33%|███▎ | 328/1000 [00:43<01:33, 7.17it/s]
33%|███▎ | 330/1000 [00:44<01:38, 6.78it/s]
33%|███▎ | 332/1000 [00:44<01:41, 6.58it/s]
33%|███▎ | 333/1000 [00:44<01:35, 6.96it/s]
33%|███▎ | 334/1000 [00:44<01:44, 6.38it/s]
34%|███▎ | 336/1000 [00:45<01:22, 8.05it/s]
34%|███▍ | 338/1000 [00:45<01:15, 8.81it/s]
34%|███▍ | 340/1000 [00:45<01:05, 10.01it/s]
34%|███▍ | 342/1000 [00:45<01:00, 10.87it/s]
34%|███▍ | 344/1000 [00:45<01:26, 7.60it/s]
34%|███▍ | 345/1000 [00:46<01:24, 7.71it/s]
35%|███▍ | 346/1000 [00:46<01:30, 7.20it/s]
35%|███▍ | 347/1000 [00:46<01:28, 7.40it/s]
35%|███▍ | 349/1000 [00:46<01:34, 6.91it/s]
35%|███▌ | 350/1000 [00:46<01:49, 5.96it/s]
35%|███▌ | 352/1000 [00:47<01:24, 7.64it/s]
35%|███▌ | 354/1000 [00:47<01:25, 7.55it/s]
36%|███▌ | 355/1000 [00:47<01:27, 7.36it/s]
36%|███▌ | 357/1000 [00:47<01:11, 8.95it/s]
36%|███▌ | 359/1000 [00:47<01:00, 10.54it/s]
36%|███▌ | 361/1000 [00:48<01:08, 9.39it/s]
36%|███▋ | 363/1000 [00:48<01:28, 7.17it/s]
36%|███▋ | 364/1000 [00:48<01:41, 6.27it/s]
36%|███▋ | 365/1000 [00:49<02:09, 4.92it/s]
37%|███▋ | 367/1000 [00:49<01:57, 5.37it/s]
37%|███▋ | 368/1000 [00:49<02:05, 5.02it/s]
37%|███▋ | 369/1000 [00:49<01:52, 5.60it/s]
37%|███▋ | 371/1000 [00:49<01:23, 7.55it/s]
37%|███▋ | 372/1000 [00:50<01:21, 7.73it/s]
37%|███▋ | 374/1000 [00:50<01:17, 8.08it/s]
38%|███▊ | 375/1000 [00:50<01:40, 6.21it/s]
38%|███▊ | 376/1000 [00:50<01:53, 5.48it/s]
38%|███▊ | 378/1000 [00:50<01:29, 6.92it/s]
38%|███▊ | 380/1000 [00:51<01:10, 8.78it/s]
38%|███▊ | 382/1000 [00:51<01:18, 7.91it/s]
38%|███▊ | 384/1000 [00:51<01:06, 9.21it/s]
39%|███▊ | 386/1000 [00:51<01:06, 9.18it/s]
39%|███▉ | 388/1000 [00:52<01:25, 7.15it/s]
39%|███▉ | 390/1000 [00:52<01:19, 7.65it/s]
39%|███▉ | 391/1000 [00:52<01:22, 7.37it/s]
39%|███▉ | 393/1000 [00:52<01:09, 8.78it/s]
40%|███▉ | 395/1000 [00:53<01:20, 7.47it/s]
40%|███▉ | 397/1000 [00:53<01:08, 8.75it/s]
40%|███▉ | 399/1000 [00:53<01:36, 6.22it/s]
40%|████ | 400/1000 [00:53<01:45, 5.68it/s]
40%|████ | 402/1000 [00:54<01:41, 5.92it/s]
40%|████ | 404/1000 [00:54<01:22, 7.23it/s]
41%|████ | 406/1000 [00:54<01:10, 8.48it/s]
41%|████ | 408/1000 [00:55<01:32, 6.39it/s]
41%|████ | 410/1000 [00:55<01:31, 6.44it/s]
41%|████ | 411/1000 [00:55<01:41, 5.82it/s]
41%|████ | 412/1000 [00:55<01:49, 5.36it/s]
41%|████▏ | 414/1000 [00:55<01:23, 7.05it/s]
42%|████▏ | 416/1000 [00:56<01:25, 6.81it/s]
42%|████▏ | 418/1000 [00:56<01:10, 8.25it/s]
42%|████▏ | 420/1000 [00:56<01:08, 8.43it/s]
42%|████▏ | 421/1000 [00:56<01:17, 7.50it/s]
42%|████▏ | 423/1000 [00:57<01:26, 6.69it/s]
42%|████▏ | 424/1000 [00:57<01:37, 5.93it/s]
42%|████▎ | 425/1000 [00:57<01:30, 6.36it/s]
43%|████▎ | 427/1000 [00:57<01:12, 7.94it/s]
43%|████▎ | 428/1000 [00:57<01:16, 7.52it/s]
43%|████▎ | 429/1000 [00:57<01:12, 7.83it/s]
43%|████▎ | 431/1000 [00:58<00:59, 9.54it/s]
43%|████▎ | 433/1000 [00:58<00:51, 11.00it/s]
44%|████▎ | 435/1000 [00:58<00:48, 11.76it/s]
44%|████▎ | 437/1000 [00:58<00:53, 10.48it/s]
44%|████▍ | 439/1000 [00:59<01:09, 8.07it/s]
44%|████▍ | 441/1000 [00:59<01:00, 9.30it/s]
44%|████▍ | 443/1000 [00:59<01:08, 8.10it/s]
44%|████▍ | 444/1000 [00:59<01:16, 7.25it/s]
45%|████▍ | 446/1000 [00:59<01:03, 8.72it/s]
45%|████▍ | 448/1000 [01:00<01:13, 7.49it/s]
45%|████▌ | 450/1000 [01:00<01:18, 7.02it/s]
45%|████▌ | 451/1000 [01:00<01:28, 6.18it/s]
45%|████▌ | 452/1000 [01:00<01:38, 5.58it/s]
45%|████▌ | 454/1000 [01:01<01:15, 7.19it/s]
46%|████▌ | 456/1000 [01:01<01:03, 8.50it/s]
46%|████▌ | 457/1000 [01:01<01:09, 7.81it/s]
46%|████▌ | 459/1000 [01:01<00:58, 9.27it/s]
46%|████▌ | 461/1000 [01:01<00:49, 10.84it/s]
46%|████▋ | 463/1000 [01:02<01:10, 7.62it/s]
46%|████▋ | 465/1000 [01:02<01:19, 6.75it/s]
47%|████▋ | 466/1000 [01:02<01:28, 6.01it/s]
47%|████▋ | 467/1000 [01:03<01:50, 4.82it/s]
47%|████▋ | 469/1000 [01:03<01:24, 6.31it/s]
47%|████▋ | 471/1000 [01:03<01:07, 7.86it/s]
47%|████▋ | 472/1000 [01:03<01:04, 8.20it/s]
47%|████▋ | 473/1000 [01:03<01:11, 7.36it/s]
47%|████▋ | 474/1000 [01:03<01:25, 6.17it/s]
48%|████▊ | 476/1000 [01:04<01:24, 6.18it/s]
48%|████▊ | 477/1000 [01:04<01:38, 5.29it/s]
48%|████▊ | 479/1000 [01:04<01:15, 6.86it/s]
48%|████▊ | 480/1000 [01:04<01:21, 6.37it/s]
48%|████▊ | 482/1000 [01:05<01:05, 7.92it/s]
48%|████▊ | 484/1000 [01:05<01:11, 7.25it/s]
48%|████▊ | 485/1000 [01:05<01:22, 6.25it/s]
49%|████▊ | 486/1000 [01:05<01:22, 6.24it/s]
49%|████▉ | 488/1000 [01:05<01:04, 7.96it/s]
49%|████▉ | 489/1000 [01:06<01:17, 6.60it/s]
49%|████▉ | 491/1000 [01:06<01:02, 8.19it/s]
49%|████▉ | 492/1000 [01:06<01:01, 8.27it/s]
49%|████▉ | 494/1000 [01:06<00:50, 9.97it/s]
50%|████▉ | 496/1000 [01:06<01:00, 8.39it/s]
50%|████▉ | 498/1000 [01:07<00:59, 8.42it/s]
50%|████▉ | 499/1000 [01:07<01:15, 6.65it/s]
50%|█████ | 500/1000 [01:07<01:24, 5.92it/s]
50%|█████ | 502/1000 [01:07<01:06, 7.54it/s]
50%|█████ | 503/1000 [01:07<01:13, 6.80it/s]
50%|█████ | 505/1000 [01:08<01:15, 6.55it/s]
51%|█████ | 506/1000 [01:08<01:25, 5.81it/s]
51%|█████ | 508/1000 [01:08<01:06, 7.43it/s]
51%|█████ | 510/1000 [01:08<00:55, 8.79it/s]
51%|█████ | 512/1000 [01:08<00:49, 9.83it/s]
51%|█████▏ | 514/1000 [01:09<01:07, 7.23it/s]
52%|█████▏ | 515/1000 [01:09<01:04, 7.49it/s]
52%|█████▏ | 516/1000 [01:09<01:08, 7.06it/s]
52%|█████▏ | 518/1000 [01:09<00:59, 8.04it/s]
52%|█████▏ | 519/1000 [01:10<01:15, 6.36it/s]
52%|█████▏ | 521/1000 [01:10<00:59, 8.02it/s]
52%|█████▏ | 522/1000 [01:10<01:11, 6.68it/s]
52%|█████▏ | 523/1000 [01:10<01:22, 5.80it/s]
52%|█████▏ | 524/1000 [01:11<01:25, 5.55it/s]
53%|█████▎ | 526/1000 [01:11<01:11, 6.58it/s]
53%|█████▎ | 528/1000 [01:11<01:12, 6.54it/s]
53%|█████▎ | 529/1000 [01:11<01:13, 6.40it/s]
53%|█████▎ | 531/1000 [01:11<00:57, 8.13it/s]
53%|█████▎ | 533/1000 [01:11<00:47, 9.75it/s]
54%|█████▎ | 535/1000 [01:12<01:09, 6.70it/s]
54%|█████▎ | 536/1000 [01:12<01:12, 6.37it/s]
54%|█████▎ | 537/1000 [01:12<01:21, 5.66it/s]
54%|█████▍ | 539/1000 [01:13<01:17, 5.93it/s]
54%|█████▍ | 540/1000 [01:13<01:19, 5.76it/s]
54%|█████▍ | 541/1000 [01:13<01:27, 5.25it/s]
54%|█████▍ | 543/1000 [01:13<01:05, 6.93it/s]
55%|█████▍ | 545/1000 [01:14<01:04, 7.06it/s]
55%|█████▍ | 546/1000 [01:14<01:09, 6.49it/s]
55%|█████▍ | 547/1000 [01:14<01:19, 5.69it/s]
55%|█████▍ | 549/1000 [01:14<01:16, 5.91it/s]
55%|█████▌ | 551/1000 [01:14<00:59, 7.51it/s]
55%|█████▌ | 552/1000 [01:15<01:01, 7.26it/s]
55%|█████▌ | 553/1000 [01:15<01:12, 6.18it/s]
55%|█████▌ | 554/1000 [01:15<01:14, 5.95it/s]
56%|█████▌ | 556/1000 [01:15<00:57, 7.76it/s]
56%|█████▌ | 557/1000 [01:15<01:03, 7.02it/s]
56%|█████▌ | 559/1000 [01:16<00:49, 8.85it/s]
56%|█████▌ | 561/1000 [01:16<00:43, 10.04it/s]
56%|█████▋ | 563/1000 [01:16<00:52, 8.36it/s]
56%|█████▋ | 565/1000 [01:16<00:54, 7.97it/s]
57%|█████▋ | 566/1000 [01:17<01:04, 6.74it/s]
57%|█████▋ | 568/1000 [01:17<01:05, 6.55it/s]
57%|█████▋ | 569/1000 [01:17<01:06, 6.45it/s]
57%|█████▋ | 571/1000 [01:17<01:06, 6.44it/s]
57%|█████▋ | 572/1000 [01:17<01:07, 6.30it/s]
57%|█████▋ | 574/1000 [01:18<01:07, 6.34it/s]
58%|█████▊ | 576/1000 [01:18<00:54, 7.83it/s]
58%|█████▊ | 577/1000 [01:18<01:13, 5.73it/s]
58%|█████▊ | 578/1000 [01:19<01:20, 5.25it/s]
58%|█████▊ | 580/1000 [01:19<01:00, 6.98it/s]
58%|█████▊ | 582/1000 [01:19<00:48, 8.56it/s]
58%|█████▊ | 584/1000 [01:19<00:54, 7.58it/s]
58%|█████▊ | 585/1000 [01:19<01:00, 6.90it/s]
59%|█████▊ | 587/1000 [01:20<00:57, 7.15it/s]
59%|█████▉ | 589/1000 [01:20<00:48, 8.53it/s]
59%|█████▉ | 590/1000 [01:20<01:00, 6.75it/s]
59%|█████▉ | 592/1000 [01:20<00:49, 8.17it/s]
59%|█████▉ | 593/1000 [01:20<00:59, 6.80it/s]
60%|█████▉ | 595/1000 [01:21<00:48, 8.38it/s]
60%|█████▉ | 596/1000 [01:21<00:58, 6.88it/s]
60%|█████▉ | 597/1000 [01:21<01:00, 6.67it/s]
60%|█████▉ | 599/1000 [01:21<01:01, 6.47it/s]
60%|██████ | 601/1000 [01:22<01:02, 6.39it/s]
60%|██████ | 602/1000 [01:22<00:59, 6.71it/s]
60%|██████ | 604/1000 [01:22<01:09, 5.69it/s]
61%|██████ | 606/1000 [01:22<00:55, 7.10it/s]
61%|██████ | 608/1000 [01:23<00:50, 7.84it/s]
61%|██████ | 610/1000 [01:23<00:46, 8.46it/s]
61%|██████ | 612/1000 [01:23<00:39, 9.72it/s]
61%|██████▏ | 614/1000 [01:23<00:35, 10.79it/s]
62%|██████▏ | 616/1000 [01:23<00:50, 7.61it/s]
62%|██████▏ | 617/1000 [01:24<00:49, 7.74it/s]
62%|██████▏ | 619/1000 [01:24<00:41, 9.09it/s]
62%|██████▏ | 621/1000 [01:24<00:47, 8.02it/s]
62%|██████▏ | 623/1000 [01:24<00:46, 8.19it/s]
62%|██████▎ | 625/1000 [01:25<00:50, 7.45it/s]
63%|██████▎ | 627/1000 [01:25<00:43, 8.57it/s]
63%|██████▎ | 628/1000 [01:25<00:52, 7.15it/s]
63%|██████▎ | 629/1000 [01:25<00:59, 6.19it/s]
63%|██████▎ | 631/1000 [01:25<00:47, 7.82it/s]
63%|██████▎ | 633/1000 [01:26<00:39, 9.40it/s]
64%|██████▎ | 635/1000 [01:26<00:54, 6.71it/s]
64%|██████▎ | 636/1000 [01:26<00:51, 7.06it/s]
64%|██████▍ | 638/1000 [01:26<00:45, 7.94it/s]
64%|██████▍ | 640/1000 [01:26<00:39, 9.16it/s]
64%|██████▍ | 642/1000 [01:27<00:45, 7.94it/s]
64%|██████▍ | 643/1000 [01:27<00:47, 7.58it/s]
64%|██████▍ | 645/1000 [01:27<00:50, 7.09it/s]
65%|██████▍ | 647/1000 [01:27<00:46, 7.57it/s]
65%|██████▍ | 648/1000 [01:28<00:54, 6.50it/s]
65%|██████▌ | 650/1000 [01:28<00:53, 6.56it/s]
65%|██████▌ | 652/1000 [01:28<00:55, 6.32it/s]
65%|██████▌ | 654/1000 [01:28<00:44, 7.70it/s]
66%|██████▌ | 656/1000 [01:29<00:38, 8.91it/s]
66%|██████▌ | 658/1000 [01:29<00:42, 8.12it/s]
66%|██████▌ | 659/1000 [01:29<00:56, 6.01it/s]
66%|██████▌ | 661/1000 [01:29<00:44, 7.57it/s]
66%|██████▌ | 662/1000 [01:30<00:52, 6.49it/s]
66%|██████▋ | 664/1000 [01:30<00:58, 5.77it/s]
66%|██████▋ | 665/1000 [01:30<01:02, 5.32it/s]
67%|██████▋ | 667/1000 [01:31<00:59, 5.61it/s]
67%|██████▋ | 668/1000 [01:31<01:03, 5.19it/s]
67%|██████▋ | 669/1000 [01:31<00:58, 5.70it/s]
67%|██████▋ | 671/1000 [01:31<00:55, 5.89it/s]
67%|██████▋ | 673/1000 [01:32<00:49, 6.64it/s]
68%|██████▊ | 675/1000 [01:32<00:44, 7.27it/s]
68%|██████▊ | 677/1000 [01:32<00:37, 8.65it/s]
68%|██████▊ | 679/1000 [01:32<00:33, 9.69it/s]
68%|██████▊ | 681/1000 [01:32<00:29, 10.99it/s]
68%|██████▊ | 683/1000 [01:33<00:35, 8.92it/s]
68%|██████▊ | 685/1000 [01:33<00:31, 9.89it/s]
69%|██████▊ | 687/1000 [01:33<00:45, 6.86it/s]
69%|██████▉ | 688/1000 [01:33<00:43, 7.16it/s]
69%|██████▉ | 690/1000 [01:34<00:45, 6.81it/s]
69%|██████▉ | 692/1000 [01:34<00:39, 7.84it/s]
69%|██████▉ | 694/1000 [01:34<00:42, 7.26it/s]
70%|██████▉ | 695/1000 [01:34<00:41, 7.42it/s]
70%|██████▉ | 696/1000 [01:34<00:47, 6.34it/s]
70%|██████▉ | 698/1000 [01:35<00:43, 6.95it/s]
70%|██████▉ | 699/1000 [01:35<00:49, 6.04it/s]
70%|███████ | 701/1000 [01:35<00:39, 7.49it/s]
70%|███████ | 702/1000 [01:35<00:53, 5.57it/s]
70%|███████ | 704/1000 [01:36<00:41, 7.17it/s]
70%|███████ | 705/1000 [01:36<00:54, 5.38it/s]
71%|███████ | 707/1000 [01:36<00:41, 6.99it/s]
71%|███████ | 709/1000 [01:36<00:38, 7.60it/s]
71%|███████ | 710/1000 [01:37<00:44, 6.49it/s]
71%|███████ | 712/1000 [01:37<00:37, 7.68it/s]
71%|███████▏ | 713/1000 [01:37<00:36, 7.83it/s]
72%|███████▏ | 715/1000 [01:37<00:30, 9.34it/s]
72%|███████▏ | 717/1000 [01:37<00:35, 8.04it/s]
72%|███████▏ | 718/1000 [01:38<00:41, 6.79it/s]
72%|███████▏ | 719/1000 [01:38<00:47, 5.93it/s]
72%|███████▏ | 720/1000 [01:38<00:43, 6.46it/s]
72%|███████▏ | 722/1000 [01:38<00:34, 8.16it/s]
72%|███████▏ | 723/1000 [01:38<00:33, 8.23it/s]
72%|███████▏ | 724/1000 [01:38<00:33, 8.24it/s]
72%|███████▎ | 725/1000 [01:38<00:33, 8.31it/s]
73%|███████▎ | 727/1000 [01:39<00:26, 10.13it/s]
73%|███████▎ | 729/1000 [01:39<00:24, 11.04it/s]
73%|███████▎ | 731/1000 [01:39<00:33, 8.14it/s]
73%|███████▎ | 733/1000 [01:39<00:28, 9.37it/s]
74%|███████▎ | 735/1000 [01:39<00:27, 9.80it/s]
74%|███████▎ | 737/1000 [01:40<00:27, 9.43it/s]
74%|███████▍ | 739/1000 [01:40<00:26, 9.69it/s]
74%|███████▍ | 741/1000 [01:40<00:31, 8.27it/s]
74%|███████▍ | 743/1000 [01:40<00:30, 8.33it/s]
74%|███████▍ | 745/1000 [01:41<00:26, 9.58it/s]
75%|███████▍ | 747/1000 [01:41<00:24, 10.41it/s]
75%|███████▍ | 749/1000 [01:41<00:29, 8.62it/s]
75%|███████▌ | 750/1000 [01:41<00:32, 7.66it/s]
75%|███████▌ | 751/1000 [01:42<00:40, 6.16it/s]
75%|███████▌ | 753/1000 [01:42<00:34, 7.23it/s]
75%|███████▌ | 754/1000 [01:42<00:39, 6.22it/s]
76%|███████▌ | 756/1000 [01:42<00:38, 6.40it/s]
76%|███████▌ | 758/1000 [01:42<00:31, 7.60it/s]
76%|███████▌ | 759/1000 [01:43<00:32, 7.31it/s]
76%|███████▌ | 761/1000 [01:43<00:27, 8.69it/s]
76%|███████▋ | 763/1000 [01:43<00:31, 7.64it/s]
76%|███████▋ | 764/1000 [01:43<00:35, 6.59it/s]
77%|███████▋ | 766/1000 [01:44<00:36, 6.46it/s]
77%|███████▋ | 768/1000 [01:44<00:29, 7.78it/s]
77%|███████▋ | 769/1000 [01:44<00:34, 6.63it/s]
77%|███████▋ | 770/1000 [01:44<00:35, 6.55it/s]
77%|███████▋ | 772/1000 [01:44<00:28, 8.12it/s]
77%|███████▋ | 773/1000 [01:45<00:35, 6.39it/s]
77%|███████▋ | 774/1000 [01:45<00:33, 6.79it/s]
78%|███████▊ | 776/1000 [01:45<00:28, 7.90it/s]
78%|███████▊ | 778/1000 [01:45<00:23, 9.62it/s]
78%|███████▊ | 780/1000 [01:45<00:31, 6.94it/s]
78%|███████▊ | 782/1000 [01:46<00:26, 8.37it/s]
78%|███████▊ | 784/1000 [01:46<00:30, 7.16it/s]
79%|███████▊ | 786/1000 [01:46<00:28, 7.53it/s]
79%|███████▉ | 788/1000 [01:46<00:25, 8.36it/s]
79%|███████▉ | 790/1000 [01:47<00:23, 8.99it/s]
79%|███████▉ | 791/1000 [01:47<00:25, 8.22it/s]
79%|███████▉ | 792/1000 [01:47<00:26, 7.73it/s]
79%|███████▉ | 793/1000 [01:47<00:25, 7.97it/s]
80%|███████▉ | 795/1000 [01:47<00:28, 7.19it/s]
80%|███████▉ | 797/1000 [01:48<00:29, 6.86it/s]
80%|███████▉ | 798/1000 [01:48<00:33, 6.01it/s]
80%|████████ | 800/1000 [01:48<00:29, 6.72it/s]
80%|████████ | 802/1000 [01:48<00:25, 7.64it/s]
80%|████████ | 804/1000 [01:49<00:25, 7.84it/s]
81%|████████ | 806/1000 [01:49<00:21, 9.18it/s]
81%|████████ | 807/1000 [01:49<00:21, 8.97it/s]
81%|████████ | 809/1000 [01:49<00:18, 10.19it/s]
81%|████████ | 811/1000 [01:49<00:16, 11.21it/s]
81%|████████▏ | 813/1000 [01:49<00:20, 9.06it/s]
82%|████████▏ | 815/1000 [01:50<00:19, 9.32it/s]
82%|████████▏ | 817/1000 [01:50<00:22, 8.13it/s]
82%|████████▏ | 819/1000 [01:50<00:19, 9.20it/s]
82%|████████▏ | 821/1000 [01:50<00:22, 7.87it/s]
82%|████████▏ | 823/1000 [01:51<00:22, 7.73it/s]
82%|████████▏ | 824/1000 [01:51<00:26, 6.67it/s]
82%|████████▎ | 825/1000 [01:51<00:25, 6.93it/s]
83%|████████▎ | 826/1000 [01:51<00:30, 5.73it/s]
83%|████████▎ | 828/1000 [01:52<00:33, 5.21it/s]
83%|████████▎ | 829/1000 [01:52<00:29, 5.71it/s]
83%|████████▎ | 831/1000 [01:52<00:24, 6.99it/s]
83%|████████▎ | 832/1000 [01:52<00:29, 5.73it/s]
83%|████████▎ | 833/1000 [01:53<00:26, 6.22it/s]
83%|████████▎ | 834/1000 [01:53<00:27, 6.00it/s]
84%|████████▎ | 835/1000 [01:53<00:25, 6.52it/s]
84%|████████▎ | 836/1000 [01:53<00:26, 6.08it/s]
84%|████████▍ | 838/1000 [01:53<00:21, 7.43it/s]
84%|████████▍ | 840/1000 [01:54<00:24, 6.61it/s]
84%|████████▍ | 842/1000 [01:54<00:19, 8.14it/s]
84%|████████▍ | 844/1000 [01:54<00:24, 6.41it/s]
84%|████████▍ | 845/1000 [01:54<00:26, 5.77it/s]
85%|████████▍ | 847/1000 [01:55<00:24, 6.25it/s]
85%|████████▍ | 849/1000 [01:55<00:19, 7.55it/s]
85%|████████▌ | 850/1000 [01:55<00:23, 6.49it/s]
85%|████████▌ | 851/1000 [01:55<00:21, 6.87it/s]
85%|████████▌ | 853/1000 [01:55<00:17, 8.46it/s]
86%|████████▌ | 855/1000 [01:55<00:14, 10.03it/s]
86%|████████▌ | 857/1000 [01:56<00:14, 10.20it/s]
86%|████████▌ | 859/1000 [01:56<00:16, 8.51it/s]
86%|████████▌ | 861/1000 [01:56<00:14, 9.75it/s]
86%|████████▋ | 863/1000 [01:56<00:12, 10.61it/s]
86%|████████▋ | 865/1000 [01:56<00:11, 11.68it/s]
87%|████████▋ | 867/1000 [01:57<00:14, 9.30it/s]
87%|████████▋ | 869/1000 [01:57<00:12, 10.26it/s]
87%|████████▋ | 871/1000 [01:57<00:11, 11.26it/s]
87%|████████▋ | 873/1000 [01:57<00:16, 7.77it/s]
88%|████████▊ | 875/1000 [01:58<00:16, 7.56it/s]
88%|████████▊ | 877/1000 [01:58<00:14, 8.77it/s]
88%|████████▊ | 879/1000 [01:58<00:17, 6.84it/s]
88%|████████▊ | 881/1000 [01:58<00:15, 7.57it/s]
88%|████████▊ | 882/1000 [01:59<00:18, 6.52it/s]
88%|████████▊ | 884/1000 [01:59<00:14, 7.93it/s]
89%|████████▊ | 886/1000 [01:59<00:12, 9.15it/s]
89%|████████▉ | 888/1000 [01:59<00:10, 10.34it/s]
89%|████████▉ | 890/1000 [01:59<00:11, 9.78it/s]
89%|████████▉ | 892/1000 [02:00<00:10, 10.77it/s]
89%|████████▉ | 894/1000 [02:00<00:13, 7.61it/s]
90%|████████▉ | 896/1000 [02:00<00:11, 8.84it/s]
90%|████████▉ | 898/1000 [02:01<00:15, 6.54it/s]
90%|█████████ | 900/1000 [02:01<00:12, 7.71it/s]
90%|█████████ | 902/1000 [02:01<00:12, 7.86it/s]
90%|█████████ | 904/1000 [02:01<00:10, 9.06it/s]
91%|█████████ | 906/1000 [02:02<00:13, 7.04it/s]
91%|█████████ | 908/1000 [02:02<00:11, 8.31it/s]
91%|█████████ | 910/1000 [02:02<00:11, 7.58it/s]
91%|█████████ | 912/1000 [02:02<00:10, 8.77it/s]
91%|█████████▏| 914/1000 [02:03<00:11, 7.39it/s]
92%|█████████▏| 916/1000 [02:03<00:11, 7.08it/s]
92%|█████████▏| 917/1000 [02:03<00:11, 7.36it/s]
92%|█████████▏| 918/1000 [02:03<00:14, 5.60it/s]
92%|█████████▏| 919/1000 [02:03<00:14, 5.71it/s]
92%|█████████▏| 921/1000 [02:04<00:14, 5.58it/s]
92%|█████████▏| 922/1000 [02:04<00:13, 5.93it/s]
92%|█████████▏| 924/1000 [02:04<00:10, 7.17it/s]
93%|█████████▎| 926/1000 [02:04<00:08, 8.67it/s]
93%|█████████▎| 927/1000 [02:04<00:09, 8.10it/s]
93%|█████████▎| 928/1000 [02:05<00:10, 6.65it/s]
93%|█████████▎| 930/1000 [02:05<00:10, 6.48it/s]
93%|█████████▎| 931/1000 [02:05<00:10, 6.83it/s]
93%|█████████▎| 933/1000 [02:05<00:10, 6.61it/s]
93%|█████████▎| 934/1000 [02:06<00:10, 6.17it/s]
94%|█████████▎| 936/1000 [02:06<00:08, 7.30it/s]
94%|█████████▍| 938/1000 [02:06<00:07, 8.83it/s]
94%|█████████▍| 939/1000 [02:06<00:07, 8.05it/s]
94%|█████████▍| 940/1000 [02:06<00:07, 8.14it/s]
94%|█████████▍| 942/1000 [02:07<00:09, 6.34it/s]
94%|█████████▍| 944/1000 [02:07<00:07, 7.07it/s]
95%|█████████▍| 946/1000 [02:07<00:06, 8.38it/s]
95%|█████████▍| 948/1000 [02:07<00:05, 9.72it/s]
95%|█████████▌| 950/1000 [02:08<00:05, 8.83it/s]
95%|█████████▌| 952/1000 [02:08<00:06, 7.41it/s]
95%|█████████▌| 954/1000 [02:08<00:07, 6.17it/s]
96%|█████████▌| 956/1000 [02:08<00:05, 7.40it/s]
96%|█████████▌| 957/1000 [02:09<00:06, 6.40it/s]
96%|█████████▌| 959/1000 [02:09<00:07, 5.78it/s]
96%|█████████▌| 961/1000 [02:09<00:05, 6.82it/s]
96%|█████████▌| 962/1000 [02:10<00:06, 6.05it/s]
96%|█████████▋| 964/1000 [02:10<00:04, 7.50it/s]
96%|█████████▋| 965/1000 [02:10<00:05, 6.45it/s]
97%|█████████▋| 966/1000 [02:10<00:05, 6.34it/s]
97%|█████████▋| 968/1000 [02:10<00:03, 8.03it/s]
97%|█████████▋| 970/1000 [02:10<00:03, 9.44it/s]
97%|█████████▋| 972/1000 [02:11<00:03, 8.04it/s]
97%|█████████▋| 974/1000 [02:11<00:02, 9.22it/s]
98%|█████████▊| 976/1000 [02:11<00:02, 9.81it/s]
98%|█████████▊| 978/1000 [02:11<00:02, 10.82it/s]
98%|█████████▊| 980/1000 [02:12<00:02, 8.44it/s]
98%|█████████▊| 981/1000 [02:12<00:02, 7.07it/s]
98%|█████████▊| 982/1000 [02:12<00:03, 5.44it/s]
98%|█████████▊| 984/1000 [02:12<00:02, 6.92it/s]
99%|█████████▊| 986/1000 [02:12<00:01, 8.37it/s]
99%|█████████▉| 988/1000 [02:13<00:01, 6.74it/s]
99%|█████████▉| 989/1000 [02:13<00:01, 5.99it/s]
99%|█████████▉| 991/1000 [02:13<00:01, 6.15it/s]
99%|█████████▉| 992/1000 [02:14<00:01, 4.98it/s]
99%|█████████▉| 994/1000 [02:14<00:00, 6.55it/s]
100%|█████████▉| 995/1000 [02:14<00:00, 5.53it/s]
100%|█████████▉| 997/1000 [02:14<00:00, 7.06it/s]
100%|█████████▉| 999/1000 [02:15<00:00, 6.77it/s]
100%|██████████| 1000/1000 [02:15<00:00, 6.68it/s]
{'eval_loss': '0.8436', 'eval_runtime': '135.6', 'eval_samples_per_second': '7.377', 'eval_steps_per_second': '7.377', 'epoch': '0.1655', 'num_input_tokens_seen': 1988312}
17%|█▋ | 300/1813 [33:07<2:31:21, 6.00s/it]
100%|██████████| 1000/1000 [02:15<00:00, 6.68it/s]

17%|█▋ | 301/1813 [33:12<19:31:38, 46.49s/it]
17%|█▋ | 302/1813 [33:17<14:16:47, 34.02s/it]
17%|█▋ | 303/1813 [33:24<10:51:23, 25.88s/it]
17%|█▋ | 304/1813 [33:32<8:33:20, 20.41s/it]
17%|█▋ | 305/1813 [33:38<6:47:00, 16.19s/it]
17%|█▋ | 306/1813 [33:44<5:30:29, 13.16s/it]
17%|█▋ | 307/1813 [33:50<4:34:20, 10.93s/it]
17%|█▋ | 308/1813 [33:55<3:54:17, 9.34s/it]
17%|█▋ | 309/1813 [34:02<3:32:45, 8.49s/it]
17%|█▋ | 310/1813 [34:07<3:07:45, 7.50s/it]
{'loss': '0.9655', 'grad_norm': '1.183', 'learning_rate': '0.0001955', 'epoch': '0.171', 'num_input_tokens_seen': 2050672, 'train_runtime': '2047', 'train_tokens_per_second': '1002'}
17%|█▋ | 310/1813 [34:07<3:07:45, 7.50s/it]
17%|█▋ | 311/1813 [34:14<3:05:34, 7.41s/it]
17%|█▋ | 312/1813 [34:22<3:06:09, 7.44s/it]
17%|█▋ | 313/1813 [34:29<3:01:22, 7.26s/it]
17%|█▋ | 314/1813 [34:34<2:48:01, 6.73s/it]
17%|█▋ | 315/1813 [34:41<2:48:27, 6.75s/it]
17%|█▋ | 316/1813 [34:47<2:44:45, 6.60s/it]
17%|█▋ | 317/1813 [34:53<2:38:04, 6.34s/it]
18%|█▊ | 318/1813 [34:58<2:30:22, 6.04s/it]
18%|█▊ | 319/1813 [35:03<2:20:27, 5.64s/it]
18%|█▊ | 320/1813 [35:09<2:21:23, 5.68s/it]
{'loss': '1.047', 'grad_norm': '0.6493', 'learning_rate': '0.0001949', 'epoch': '0.1766', 'num_input_tokens_seen': 2118000, 'train_runtime': '2109', 'train_tokens_per_second': '1004'}
18%|█▊ | 320/1813 [35:09<2:21:23, 5.68s/it]
18%|█▊ | 321/1813 [35:14<2:22:20, 5.72s/it]
18%|█▊ | 322/1813 [35:20<2:22:29, 5.73s/it]
18%|█▊ | 323/1813 [35:26<2:26:05, 5.88s/it]
18%|█▊ | 324/1813 [35:34<2:35:18, 6.26s/it]
18%|█▊ | 325/1813 [35:41<2:41:16, 6.50s/it]
18%|█▊ | 326/1813 [35:47<2:38:49, 6.41s/it]
18%|█▊ | 327/1813 [35:53<2:34:59, 6.26s/it]
18%|█▊ | 328/1813 [35:59<2:38:12, 6.39s/it]
18%|█▊ | 329/1813 [36:05<2:35:09, 6.27s/it]
18%|█▊ | 330/1813 [36:11<2:31:47, 6.14s/it]
{'loss': '0.9619', 'grad_norm': '0.995', 'learning_rate': '0.0001943', 'epoch': '0.1821', 'num_input_tokens_seen': 2184640, 'train_runtime': '2172', 'train_tokens_per_second': '1006'}
18%|█▊ | 330/1813 [36:11<2:31:47, 6.14s/it]
18%|█▊ | 331/1813 [36:18<2:34:05, 6.24s/it]
18%|█▊ | 332/1813 [36:23<2:27:01, 5.96s/it]
18%|█▊ | 333/1813 [36:29<2:27:53, 6.00s/it]
18%|█▊ | 334/1813 [36:35<2:26:11, 5.93s/it]
18%|█▊ | 335/1813 [36:43<2:39:57, 6.49s/it]
19%|█▊ | 336/1813 [36:50<2:44:21, 6.68s/it]
19%|█▊ | 337/1813 [36:55<2:36:05, 6.35s/it]
19%|█▊ | 338/1813 [37:01<2:34:10, 6.27s/it]
19%|█▊ | 339/1813 [37:07<2:28:00, 6.02s/it]
19%|█▉ | 340/1813 [37:14<2:34:53, 6.31s/it]
{'loss': '0.9429', 'grad_norm': '1.139', 'learning_rate': '0.0001937', 'epoch': '0.1876', 'num_input_tokens_seen': 2251392, 'train_runtime': '2234', 'train_tokens_per_second': '1008'}
19%|█▉ | 340/1813 [37:14<2:34:53, 6.31s/it]
19%|█▉ | 341/1813 [37:20<2:34:15, 6.29s/it]
19%|█▉ | 342/1813 [37:28<2:42:05, 6.61s/it]
19%|█▉ | 343/1813 [37:33<2:34:45, 6.32s/it]
19%|█▉ | 344/1813 [37:39<2:29:06, 6.09s/it]
19%|█▉ | 345/1813 [37:46<2:38:00, 6.46s/it]
19%|█▉ | 346/1813 [37:53<2:38:06, 6.47s/it]
19%|█▉ | 347/1813 [37:58<2:28:01, 6.06s/it]
19%|█▉ | 348/1813 [38:04<2:32:11, 6.23s/it]
19%|█▉ | 349/1813 [38:13<2:48:21, 6.90s/it]
19%|█▉ | 350/1813 [38:21<2:54:58, 7.18s/it]
{'loss': '1.059', 'grad_norm': '0.858', 'learning_rate': '0.000193', 'epoch': '0.1931', 'num_input_tokens_seen': 2324712, 'train_runtime': '2301', 'train_tokens_per_second': '1010'}
19%|█▉ | 350/1813 [38:21<2:54:58, 7.18s/it]
19%|█▉ | 351/1813 [38:28<2:53:56, 7.14s/it]
19%|█▉ | 352/1813 [38:34<2:45:44, 6.81s/it]
19%|█▉ | 353/1813 [38:39<2:37:19, 6.47s/it]
20%|█▉ | 354/1813 [38:45<2:32:29, 6.27s/it]
20%|█▉ | 355/1813 [38:51<2:31:04, 6.22s/it]
20%|█▉ | 356/1813 [38:58<2:36:25, 6.44s/it]
20%|█▉ | 357/1813 [39:04<2:32:48, 6.30s/it]
20%|█▉ | 358/1813 [39:11<2:33:58, 6.35s/it]
20%|█▉ | 359/1813 [39:17<2:30:50, 6.22s/it]
20%|█▉ | 360/1813 [39:24<2:36:36, 6.47s/it]
{'loss': '1.002', 'grad_norm': '0.8958', 'learning_rate': '0.0001923', 'epoch': '0.1986', 'num_input_tokens_seen': 2390776, 'train_runtime': '2364', 'train_tokens_per_second': '1011'}
20%|█▉ | 360/1813 [39:24<2:36:36, 6.47s/it]
20%|█▉ | 361/1813 [39:29<2:28:32, 6.14s/it]
20%|█▉ | 362/1813 [39:35<2:25:38, 6.02s/it]
20%|██ | 363/1813 [39:42<2:33:52, 6.37s/it]
20%|██ | 364/1813 [39:49<2:36:43, 6.49s/it]
20%|██ | 365/1813 [39:55<2:33:46, 6.37s/it]
20%|██ | 366/1813 [40:02<2:38:04, 6.55s/it]
20%|██ | 367/1813 [40:08<2:34:03, 6.39s/it]
20%|██ | 368/1813 [40:13<2:27:38, 6.13s/it]
20%|██ | 369/1813 [40:18<2:18:34, 5.76s/it]
20%|██ | 370/1813 [40:24<2:21:15, 5.87s/it]
{'loss': '0.9964', 'grad_norm': '1.142', 'learning_rate': '0.0001916', 'epoch': '0.2041', 'num_input_tokens_seen': 2454808, 'train_runtime': '2425', 'train_tokens_per_second': '1012'}
20%|██ | 370/1813 [40:24<2:21:15, 5.87s/it]
20%|██ | 371/1813 [40:30<2:16:49, 5.69s/it]
21%|██ | 372/1813 [40:38<2:35:06, 6.46s/it]
21%|██ | 373/1813 [40:44<2:34:36, 6.44s/it]
21%|██ | 374/1813 [40:52<2:41:23, 6.73s/it]
21%|██ | 375/1813 [40:59<2:42:49, 6.79s/it]
21%|██ | 376/1813 [41:04<2:32:41, 6.38s/it]
21%|██ | 377/1813 [41:10<2:30:17, 6.28s/it]
21%|██ | 378/1813 [41:16<2:29:30, 6.25s/it]
21%|██ | 379/1813 [41:22<2:23:38, 6.01s/it]
21%|██ | 380/1813 [41:27<2:16:44, 5.73s/it]
{'loss': '0.9651', 'grad_norm': '1.171', 'learning_rate': '0.0001908', 'epoch': '0.2097', 'num_input_tokens_seen': 2520472, 'train_runtime': '2487', 'train_tokens_per_second': '1013'}
21%|██ | 380/1813 [41:27<2:16:44, 5.73s/it]
21%|██ | 381/1813 [41:34<2:26:00, 6.12s/it]
21%|██ | 382/1813 [41:41<2:31:58, 6.37s/it]
21%|██ | 383/1813 [41:47<2:30:47, 6.33s/it]
21%|██ | 384/1813 [41:53<2:29:58, 6.30s/it]
21%|██ | 385/1813 [41:59<2:29:47, 6.29s/it]
21%|██▏ | 386/1813 [42:04<2:18:44, 5.83s/it]
21%|██▏ | 387/1813 [42:10<2:21:18, 5.95s/it]
21%|██▏ | 388/1813 [42:18<2:30:08, 6.32s/it]
21%|██▏ | 389/1813 [42:25<2:41:02, 6.79s/it]
22%|██▏ | 390/1813 [42:32<2:40:49, 6.78s/it]
{'loss': '1.001', 'grad_norm': '0.851', 'learning_rate': '0.00019', 'epoch': '0.2152', 'num_input_tokens_seen': 2591512, 'train_runtime': '2553', 'train_tokens_per_second': '1015'}
22%|██▏ | 390/1813 [42:32<2:40:49, 6.78s/it]
22%|██▏ | 391/1813 [42:38<2:36:06, 6.59s/it]
22%|██▏ | 392/1813 [42:45<2:34:45, 6.53s/it]
22%|██▏ | 393/1813 [42:51<2:35:12, 6.56s/it]
22%|██▏ | 394/1813 [42:56<2:23:56, 6.09s/it]
22%|██▏ | 395/1813 [43:02<2:20:33, 5.95s/it]
22%|██▏ | 396/1813 [43:08<2:24:22, 6.11s/it]
22%|██▏ | 397/1813 [43:13<2:16:01, 5.76s/it]
22%|██▏ | 398/1813 [43:20<2:19:08, 5.90s/it]
22%|██▏ | 399/1813 [43:27<2:31:14, 6.42s/it]
22%|██▏ | 400/1813 [43:36<2:43:51, 6.96s/it]
{'loss': '0.9838', 'grad_norm': '0.9736', 'learning_rate': '0.0001891', 'epoch': '0.2207', 'num_input_tokens_seen': 2660336, 'train_runtime': '2616', 'train_tokens_per_second': '1017'}
22%|██▏ | 400/1813 [43:36<2:43:51, 6.96s/it]
22%|██▏ | 401/1813 [43:43<2:46:08, 7.06s/it]
22%|██▏ | 402/1813 [43:48<2:30:23, 6.39s/it]
22%|██▏ | 403/1813 [43:54<2:27:37, 6.28s/it]
22%|██▏ | 404/1813 [44:01<2:31:44, 6.46s/it]
22%|██▏ | 405/1813 [44:08<2:35:59, 6.65s/it]
22%|██▏ | 406/1813 [44:12<2:22:51, 6.09s/it]
22%|██▏ | 407/1813 [44:17<2:10:16, 5.56s/it]
23%|██▎ | 408/1813 [44:22<2:11:35, 5.62s/it]
23%|██▎ | 409/1813 [44:29<2:15:48, 5.80s/it]
23%|██▎ | 410/1813 [44:34<2:14:09, 5.74s/it]
{'loss': '1.012', 'grad_norm': '1.155', 'learning_rate': '0.0001883', 'epoch': '0.2262', 'num_input_tokens_seen': 2722056, 'train_runtime': '2675', 'train_tokens_per_second': '1018'}
23%|██▎ | 410/1813 [44:34<2:14:09, 5.74s/it]
23%|██▎ | 411/1813 [44:41<2:18:13, 5.92s/it]
23%|██▎ | 412/1813 [44:47<2:22:28, 6.10s/it]
23%|██▎ | 413/1813 [44:55<2:30:58, 6.47s/it]
23%|██▎ | 414/1813 [45:00<2:23:59, 6.18s/it]
23%|██▎ | 415/1813 [45:06<2:25:34, 6.25s/it]
23%|██▎ | 416/1813 [45:13<2:27:57, 6.35s/it]
23%|██▎ | 417/1813 [45:21<2:35:58, 6.70s/it]
23%|██▎ | 418/1813 [45:26<2:29:04, 6.41s/it]
23%|██▎ | 419/1813 [45:33<2:29:32, 6.44s/it]
23%|██▎ | 420/1813 [45:39<2:25:09, 6.25s/it]
{'loss': '1.003', 'grad_norm': '0.8105', 'learning_rate': '0.0001874', 'epoch': '0.2317', 'num_input_tokens_seen': 2790960, 'train_runtime': '2739', 'train_tokens_per_second': '1019'}
23%|██▎ | 420/1813 [45:39<2:25:09, 6.25s/it]
23%|██▎ | 421/1813 [45:45<2:25:54, 6.29s/it]
23%|██▎ | 422/1813 [45:52<2:33:01, 6.60s/it]
23%|██▎ | 423/1813 [45:58<2:29:28, 6.45s/it]
23%|██▎ | 424/1813 [46:05<2:27:12, 6.36s/it]
23%|██▎ | 425/1813 [46:10<2:20:56, 6.09s/it]
23%|██▎ | 426/1813 [46:17<2:28:39, 6.43s/it]
24%|██▎ | 427/1813 [46:23<2:24:45, 6.27s/it]
24%|██▎ | 428/1813 [46:29<2:24:02, 6.24s/it]
24%|██▎ | 429/1813 [46:35<2:17:15, 5.95s/it]
24%|██▎ | 430/1813 [46:42<2:27:37, 6.40s/it]
{'loss': '0.9886', 'grad_norm': '0.8128', 'learning_rate': '0.0001864', 'epoch': '0.2372', 'num_input_tokens_seen': 2860096, 'train_runtime': '2803', 'train_tokens_per_second': '1021'}
24%|██▎ | 430/1813 [46:42<2:27:37, 6.40s/it]
24%|██▍ | 431/1813 [46:48<2:24:43, 6.28s/it]
24%|██▍ | 432/1813 [46:54<2:21:05, 6.13s/it]
24%|██▍ | 433/1813 [46:59<2:15:31, 5.89s/it]
24%|██▍ | 434/1813 [47:06<2:19:29, 6.07s/it]
24%|██▍ | 435/1813 [47:12<2:18:06, 6.01s/it]
24%|██▍ | 436/1813 [47:18<2:20:30, 6.12s/it]
24%|██▍ | 437/1813 [47:24<2:17:34, 6.00s/it]
24%|██▍ | 438/1813 [47:30<2:19:46, 6.10s/it]
24%|██▍ | 439/1813 [47:36<2:20:00, 6.11s/it]
24%|██▍ | 440/1813 [47:43<2:22:07, 6.21s/it]
{'loss': '0.9073', 'grad_norm': '1.271', 'learning_rate': '0.0001855', 'epoch': '0.2428', 'num_input_tokens_seen': 2924856, 'train_runtime': '2863', 'train_tokens_per_second': '1022'}
24%|██▍ | 440/1813 [47:43<2:22:07, 6.21s/it]
24%|██▍ | 441/1813 [47:49<2:20:35, 6.15s/it]
24%|██▍ | 442/1813 [47:55<2:20:55, 6.17s/it]
24%|██▍ | 443/1813 [48:02<2:25:15, 6.36s/it]
24%|██▍ | 444/1813 [48:07<2:20:00, 6.14s/it]
25%|██▍ | 445/1813 [48:14<2:27:59, 6.49s/it]
25%|██▍ | 446/1813 [48:21<2:28:15, 6.51s/it]
25%|██▍ | 447/1813 [48:27<2:26:33, 6.44s/it]
25%|██▍ | 448/1813 [48:34<2:26:22, 6.43s/it]
25%|██▍ | 449/1813 [48:39<2:19:35, 6.14s/it]
25%|██▍ | 450/1813 [48:45<2:16:04, 5.99s/it]
{'loss': '1.023', 'grad_norm': '1.042', 'learning_rate': '0.0001845', 'epoch': '0.2483', 'num_input_tokens_seen': 2990040, 'train_runtime': '2925', 'train_tokens_per_second': '1022'}
25%|██▍ | 450/1813 [48:45<2:16:04, 5.99s/it]
25%|██▍ | 451/1813 [48:52<2:26:21, 6.45s/it]
25%|██▍ | 452/1813 [48:58<2:21:12, 6.22s/it]
25%|██▍ | 453/1813 [49:03<2:12:53, 5.86s/it]
25%|██▌ | 454/1813 [49:10<2:20:04, 6.18s/it]
25%|██▌ | 455/1813 [49:17<2:22:40, 6.30s/it]
25%|██▌ | 456/1813 [49:21<2:11:48, 5.83s/it]
25%|██▌ | 457/1813 [49:27<2:14:03, 5.93s/it]
25%|██▌ | 458/1813 [49:35<2:27:33, 6.53s/it]
25%|██▌ | 459/1813 [49:42<2:29:39, 6.63s/it]
25%|██▌ | 460/1813 [49:49<2:27:56, 6.56s/it]
{'loss': '1.088', 'grad_norm': '0.9134', 'learning_rate': '0.0001834', 'epoch': '0.2538', 'num_input_tokens_seen': 3058848, 'train_runtime': '2989', 'train_tokens_per_second': '1023'}
25%|██▌ | 460/1813 [49:49<2:27:56, 6.56s/it]
25%|██▌ | 461/1813 [49:55<2:23:45, 6.38s/it]
25%|██▌ | 462/1813 [50:02<2:30:37, 6.69s/it]
26%|██▌ | 463/1813 [50:08<2:25:04, 6.45s/it]
26%|██▌ | 464/1813 [50:13<2:15:20, 6.02s/it]
26%|██▌ | 465/1813 [50:19<2:12:19, 5.89s/it]
26%|██▌ | 466/1813 [50:25<2:18:12, 6.16s/it]
26%|██▌ | 467/1813 [50:31<2:17:04, 6.11s/it]
26%|██▌ | 468/1813 [50:38<2:20:24, 6.26s/it]
26%|██▌ | 469/1813 [50:44<2:21:49, 6.33s/it]
26%|██▌ | 470/1813 [50:51<2:23:09, 6.40s/it]
{'loss': '0.9592', 'grad_norm': '0.7299', 'learning_rate': '0.0001824', 'epoch': '0.2593', 'num_input_tokens_seen': 3126680, 'train_runtime': '3051', 'train_tokens_per_second': '1025'}
26%|██▌ | 470/1813 [50:51<2:23:09, 6.40s/it]
26%|██▌ | 471/1813 [50:57<2:18:18, 6.18s/it]
26%|██▌ | 472/1813 [51:03<2:20:38, 6.29s/it]
26%|██▌ | 473/1813 [51:10<2:24:29, 6.47s/it]
26%|██▌ | 474/1813 [51:16<2:22:42, 6.40s/it]
26%|██▌ | 475/1813 [51:22<2:16:00, 6.10s/it]
26%|██▋ | 476/1813 [51:28<2:16:31, 6.13s/it]
26%|██▋ | 477/1813 [51:35<2:20:15, 6.30s/it]
26%|██▋ | 478/1813 [51:42<2:25:58, 6.56s/it]
26%|██▋ | 479/1813 [51:48<2:20:47, 6.33s/it]
26%|██▋ | 480/1813 [51:54<2:23:36, 6.46s/it]
{'loss': '1.067', 'grad_norm': '1.134', 'learning_rate': '0.0001813', 'epoch': '0.2648', 'num_input_tokens_seen': 3193704, 'train_runtime': '3115', 'train_tokens_per_second': '1025'}
26%|██▋ | 480/1813 [51:54<2:23:36, 6.46s/it]
27%|██▋ | 481/1813 [52:01<2:24:13, 6.50s/it]
27%|██▋ | 482/1813 [52:08<2:27:29, 6.65s/it]
27%|██▋ | 483/1813 [52:16<2:35:05, 7.00s/it]
27%|██▋ | 484/1813 [52:22<2:27:08, 6.64s/it]
27%|██▋ | 485/1813 [52:29<2:34:09, 6.96s/it]
27%|██▋ | 486/1813 [52:36<2:29:32, 6.76s/it]
27%|██▋ | 487/1813 [52:43<2:31:32, 6.86s/it]
27%|██▋ | 488/1813 [52:49<2:25:17, 6.58s/it]
27%|██▋ | 489/1813 [52:56<2:28:46, 6.74s/it]
27%|██▋ | 490/1813 [53:02<2:26:02, 6.62s/it]
{'loss': '1.012', 'grad_norm': '1.279', 'learning_rate': '0.0001802', 'epoch': '0.2703', 'num_input_tokens_seen': 3268064, 'train_runtime': '3183', 'train_tokens_per_second': '1027'}
27%|██▋ | 490/1813 [53:02<2:26:02, 6.62s/it]
27%|██▋ | 491/1813 [53:09<2:28:00, 6.72s/it]
27%|██▋ | 492/1813 [53:17<2:34:06, 7.00s/it]
27%|██▋ | 493/1813 [53:22<2:24:47, 6.58s/it]
27%|██▋ | 494/1813 [53:28<2:19:37, 6.35s/it]
27%|██▋ | 495/1813 [53:35<2:25:27, 6.62s/it]
27%|██▋ | 496/1813 [53:42<2:23:56, 6.56s/it]
27%|██▋ | 497/1813 [53:47<2:17:21, 6.26s/it]
27%|██▋ | 498/1813 [53:54<2:23:03, 6.53s/it]
28%|██▊ | 499/1813 [54:01<2:20:30, 6.42s/it]
28%|██▊ | 500/1813 [54:10<2:38:18, 7.23s/it]
{'loss': '1.085', 'grad_norm': '0.8142', 'learning_rate': '0.000179', 'epoch': '0.2759', 'num_input_tokens_seen': 3341536, 'train_runtime': '3250', 'train_tokens_per_second': '1028'}
28%|██▊ | 500/1813 [54:10<2:38:18, 7.23s/it]
28%|██▊ | 501/1813 [54:16<2:32:23, 6.97s/it]
28%|██▊ | 502/1813 [54:22<2:22:48, 6.54s/it]
28%|██▊ | 503/1813 [54:27<2:12:20, 6.06s/it]
28%|██▊ | 504/1813 [54:33<2:11:58, 6.05s/it]
28%|██▊ | 505/1813 [54:40<2:18:55, 6.37s/it]
28%|██▊ | 506/1813 [54:46<2:15:58, 6.24s/it]
28%|██▊ | 507/1813 [54:53<2:22:28, 6.55s/it]
28%|██▊ | 508/1813 [54:58<2:13:00, 6.12s/it]
28%|██▊ | 509/1813 [55:03<2:07:03, 5.85s/it]
28%|██▊ | 510/1813 [55:09<2:04:07, 5.72s/it]
{'loss': '0.9232', 'grad_norm': '1.323', 'learning_rate': '0.0001779', 'epoch': '0.2814', 'num_input_tokens_seen': 3402712, 'train_runtime': '3309', 'train_tokens_per_second': '1028'}
28%|██▊ | 510/1813 [55:09<2:04:07, 5.72s/it]
28%|██▊ | 511/1813 [55:14<2:01:53, 5.62s/it]
28%|██▊ | 512/1813 [55:21<2:09:49, 5.99s/it]
28%|██▊ | 513/1813 [55:28<2:18:21, 6.39s/it]
28%|██▊ | 514/1813 [55:35<2:21:45, 6.55s/it]
28%|██▊ | 515/1813 [55:40<2:13:59, 6.19s/it]
28%|██▊ | 516/1813 [55:46<2:11:41, 6.09s/it]
29%|██▊ | 517/1813 [55:53<2:15:12, 6.26s/it]
29%|██▊ | 518/1813 [55:59<2:14:41, 6.24s/it]
29%|██▊ | 519/1813 [56:05<2:13:39, 6.20s/it]
29%|██▊ | 520/1813 [56:12<2:16:59, 6.36s/it]
{'loss': '0.9762', 'grad_norm': '1.003', 'learning_rate': '0.0001767', 'epoch': '0.2869', 'num_input_tokens_seen': 3469624, 'train_runtime': '3372', 'train_tokens_per_second': '1029'}
29%|██▊ | 520/1813 [56:12<2:16:59, 6.36s/it]
29%|██▊ | 521/1813 [56:16<2:01:45, 5.65s/it]
29%|██▉ | 522/1813 [56:22<2:03:40, 5.75s/it]
29%|██▉ | 523/1813 [56:28<2:07:39, 5.94s/it]
29%|██▉ | 524/1813 [56:35<2:10:23, 6.07s/it]
29%|██▉ | 525/1813 [56:40<2:03:27, 5.75s/it]
29%|██▉ | 526/1813 [56:46<2:09:40, 6.05s/it]
29%|██▉ | 527/1813 [56:53<2:14:30, 6.28s/it]
29%|██▉ | 528/1813 [57:01<2:20:28, 6.56s/it]
29%|██▉ | 529/1813 [57:08<2:24:18, 6.74s/it]
29%|██▉ | 530/1813 [57:14<2:19:58, 6.55s/it]
{'loss': '0.9689', 'grad_norm': '1.2', 'learning_rate': '0.0001754', 'epoch': '0.2924', 'num_input_tokens_seen': 3534904, 'train_runtime': '3434', 'train_tokens_per_second': '1029'}
29%|██▉ | 530/1813 [57:14<2:19:58, 6.55s/it]
29%|██▉ | 531/1813 [57:22<2:30:46, 7.06s/it]
29%|██▉ | 532/1813 [57:28<2:25:40, 6.82s/it]
29%|██▉ | 533/1813 [57:36<2:28:04, 6.94s/it]
29%|██▉ | 534/1813 [57:43<2:29:46, 7.03s/it]
30%|██▉ | 535/1813 [57:47<2:12:55, 6.24s/it]
30%|██▉ | 536/1813 [57:52<2:05:40, 5.91s/it]
30%|██▉ | 537/1813 [57:59<2:09:51, 6.11s/it]
30%|██▉ | 538/1813 [58:04<2:05:13, 5.89s/it]
30%|██▉ | 539/1813 [58:10<2:06:45, 5.97s/it]
30%|██▉ | 540/1813 [58:16<2:06:53, 5.98s/it]
{'loss': '0.9774', 'grad_norm': '0.8625', 'learning_rate': '0.0001742', 'epoch': '0.2979', 'num_input_tokens_seen': 3603488, 'train_runtime': '3497', 'train_tokens_per_second': '1030'}
30%|██▉ | 540/1813 [58:16<2:06:53, 5.98s/it]
30%|██▉ | 541/1813 [58:21<2:01:07, 5.71s/it]
30%|██▉ | 542/1813 [58:27<1:59:31, 5.64s/it]
30%|██▉ | 543/1813 [58:34<2:09:27, 6.12s/it]
30%|███ | 544/1813 [58:43<2:23:39, 6.79s/it]
30%|███ | 545/1813 [58:49<2:22:40, 6.75s/it]
30%|███ | 546/1813 [58:56<2:21:51, 6.72s/it]
30%|███ | 547/1813 [59:04<2:28:40, 7.05s/it]
30%|███ | 548/1813 [59:11<2:32:13, 7.22s/it]
30%|███ | 549/1813 [59:17<2:23:27, 6.81s/it]
30%|███ | 550/1813 [59:23<2:17:01, 6.51s/it]
{'loss': '0.9111', 'grad_norm': '1.151', 'learning_rate': '0.0001729', 'epoch': '0.3034', 'num_input_tokens_seen': 3676576, 'train_runtime': '3563', 'train_tokens_per_second': '1032'}
30%|███ | 550/1813 [59:23<2:17:01, 6.51s/it]
30%|███ | 551/1813 [59:29<2:14:09, 6.38s/it]
30%|███ | 552/1813 [59:34<2:08:07, 6.10s/it]
31%|███ | 553/1813 [59:39<2:00:07, 5.72s/it]
31%|███ | 554/1813 [59:46<2:06:22, 6.02s/it]
31%|███ | 555/1813 [59:51<1:59:22, 5.69s/it]
31%|███ | 556/1813 [59:57<2:01:11, 5.78s/it]
31%|███ | 557/1813 [1:00:04<2:07:19, 6.08s/it]
31%|███ | 558/1813 [1:00:09<2:04:39, 5.96s/it]
31%|███ | 559/1813 [1:00:15<1:59:25, 5.71s/it]
31%|███ | 560/1813 [1:00:21<2:03:51, 5.93s/it]
{'loss': '0.979', 'grad_norm': '0.739', 'learning_rate': '0.0001716', 'epoch': '0.309', 'num_input_tokens_seen': 3738056, 'train_runtime': '3621', 'train_tokens_per_second': '1032'}
31%|███ | 560/1813 [1:00:21<2:03:51, 5.93s/it]
31%|███ | 561/1813 [1:00:27<2:03:35, 5.92s/it]
31%|███ | 562/1813 [1:00:34<2:07:52, 6.13s/it]
31%|███ | 563/1813 [1:00:40<2:13:00, 6.38s/it]
31%|███ | 564/1813 [1:00:46<2:10:06, 6.25s/it]
31%|███ | 565/1813 [1:00:52<2:06:35, 6.09s/it]
31%|███ | 566/1813 [1:00:59<2:09:51, 6.25s/it]
31%|███▏ | 567/1813 [1:01:04<2:05:02, 6.02s/it]
31%|███▏ | 568/1813 [1:01:11<2:10:55, 6.31s/it]
31%|███▏ | 569/1813 [1:01:19<2:18:39, 6.69s/it]
31%|███▏ | 570/1813 [1:01:26<2:22:43, 6.89s/it]
{'loss': '0.9748', 'grad_norm': '0.7982', 'learning_rate': '0.0001703', 'epoch': '0.3145', 'num_input_tokens_seen': 3808208, 'train_runtime': '3687', 'train_tokens_per_second': '1033'}
31%|███▏ | 570/1813 [1:01:26<2:22:43, 6.89s/it]
31%|███▏ | 571/1813 [1:01:33<2:22:01, 6.86s/it]
32%|███▏ | 572/1813 [1:01:39<2:17:55, 6.67s/it]
32%|███▏ | 573/1813 [1:01:45<2:09:47, 6.28s/it]
32%|███▏ | 574/1813 [1:01:50<2:07:29, 6.17s/it]
32%|███▏ | 575/1813 [1:01:57<2:10:14, 6.31s/it]
32%|███▏ | 576/1813 [1:02:02<2:00:51, 5.86s/it]
32%|███▏ | 577/1813 [1:02:09<2:06:17, 6.13s/it]
32%|███▏ | 578/1813 [1:02:15<2:06:44, 6.16s/it]
32%|███▏ | 579/1813 [1:02:21<2:07:53, 6.22s/it]
32%|███▏ | 580/1813 [1:02:28<2:08:25, 6.25s/it]
{'loss': '0.9811', 'grad_norm': '0.9324', 'learning_rate': '0.0001689', 'epoch': '0.32', 'num_input_tokens_seen': 3872328, 'train_runtime': '3748', 'train_tokens_per_second': '1033'}
32%|███▏ | 580/1813 [1:02:28<2:08:25, 6.25s/it]
32%|███▏ | 581/1813 [1:02:33<2:05:45, 6.12s/it]
32%|███▏ | 582/1813 [1:02:39<2:01:43, 5.93s/it]
32%|███▏ | 583/1813 [1:02:45<2:00:15, 5.87s/it]
32%|███▏ | 584/1813 [1:02:51<2:03:23, 6.02s/it]
32%|███▏ | 585/1813 [1:02:57<2:02:48, 6.00s/it]
32%|███▏ | 586/1813 [1:03:03<2:04:30, 6.09s/it]
32%|███▏ | 587/1813 [1:03:09<2:02:57, 6.02s/it]
32%|███▏ | 588/1813 [1:03:15<2:05:08, 6.13s/it]
32%|███▏ | 589/1813 [1:03:22<2:07:10, 6.23s/it]
33%|███▎ | 590/1813 [1:03:28<2:06:08, 6.19s/it]
{'loss': '0.898', 'grad_norm': '1.095', 'learning_rate': '0.0001675', 'epoch': '0.3255', 'num_input_tokens_seen': 3936024, 'train_runtime': '3809', 'train_tokens_per_second': '1033'}
33%|███▎ | 590/1813 [1:03:28<2:06:08, 6.19s/it]
33%|███▎ | 591/1813 [1:03:33<2:01:05, 5.95s/it]
33%|███▎ | 592/1813 [1:03:39<2:00:35, 5.93s/it]
33%|███▎ | 593/1813 [1:03:46<2:04:03, 6.10s/it]
33%|███▎ | 594/1813 [1:03:52<2:03:30, 6.08s/it]
33%|███▎ | 595/1813 [1:03:57<1:59:58, 5.91s/it]
33%|███▎ | 596/1813 [1:04:03<1:58:27, 5.84s/it]
33%|███▎ | 597/1813 [1:04:08<1:55:17, 5.69s/it]
33%|███▎ | 598/1813 [1:04:14<1:54:21, 5.65s/it]
33%|███▎ | 599/1813 [1:04:20<1:56:29, 5.76s/it]
33%|███▎ | 600/1813 [1:04:27<2:03:21, 6.10s/it]
{'loss': '0.9298', 'grad_norm': '0.9432', 'learning_rate': '0.0001661', 'epoch': '0.331', 'num_input_tokens_seen': 3999176, 'train_runtime': '3867', 'train_tokens_per_second': '1034'}
33%|███▎ | 600/1813 [1:04:27<2:03:21, 6.10s/it]
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:03, 15.71it/s]
0%| | 5/1000 [00:00<02:18, 7.21it/s]
1%| | 7/1000 [00:00<01:59, 8.31it/s]
1%| | 9/1000 [00:01<02:33, 6.47it/s]
1%| | 11/1000 [00:01<02:02, 8.08it/s]
1%|▏ | 13/1000 [00:01<02:21, 7.00it/s]
1%|▏ | 14/1000 [00:01<02:24, 6.83it/s]
2%|▏ | 15/1000 [00:02<02:45, 5.97it/s]
2%|▏ | 16/1000 [00:02<02:52, 5.72it/s]
2%|▏ | 18/1000 [00:02<02:42, 6.05it/s]
2%|▏ | 19/1000 [00:02<03:10, 5.14it/s]
2%|▏ | 20/1000 [00:03<03:33, 4.60it/s]
2%|▏ | 22/1000 [00:03<02:36, 6.24it/s]
2%|▏ | 23/1000 [00:03<02:54, 5.59it/s]
2%|▎ | 25/1000 [00:03<02:12, 7.36it/s]
3%|▎ | 26/1000 [00:04<02:35, 6.26it/s]
3%|▎ | 28/1000 [00:04<02:42, 5.99it/s]
3%|▎ | 29/1000 [00:04<02:32, 6.35it/s]
3%|▎ | 30/1000 [00:04<02:42, 5.96it/s]
3%|▎ | 31/1000 [00:04<03:01, 5.34it/s]
3%|▎ | 32/1000 [00:05<02:41, 5.98it/s]
3%|▎ | 33/1000 [00:05<02:48, 5.75it/s]
4%|▎ | 35/1000 [00:05<02:06, 7.66it/s]
4%|▎ | 37/1000 [00:05<01:45, 9.10it/s]
4%|▍ | 39/1000 [00:05<02:06, 7.58it/s]
4%|▍ | 40/1000 [00:06<02:03, 7.74it/s]
4%|▍ | 42/1000 [00:06<01:45, 9.07it/s]
4%|▍ | 44/1000 [00:06<01:32, 10.30it/s]
5%|▍ | 46/1000 [00:06<01:45, 9.03it/s]
5%|▍ | 47/1000 [00:06<02:09, 7.35it/s]
5%|▍ | 49/1000 [00:06<01:48, 8.73it/s]
5%|▌ | 51/1000 [00:07<01:35, 9.89it/s]
5%|▌ | 53/1000 [00:07<01:26, 10.93it/s]
6%|▌ | 55/1000 [00:07<01:27, 10.75it/s]
6%|▌ | 57/1000 [00:07<01:41, 9.31it/s]
6%|▌ | 59/1000 [00:08<01:55, 8.18it/s]
6%|▌ | 61/1000 [00:08<01:40, 9.33it/s]
6%|▋ | 63/1000 [00:08<01:36, 9.75it/s]
6%|▋ | 65/1000 [00:08<01:51, 8.37it/s]
7%|▋ | 67/1000 [00:09<02:03, 7.57it/s]
7%|▋ | 69/1000 [00:09<01:52, 8.26it/s]
7%|▋ | 70/1000 [00:09<02:12, 7.00it/s]
7%|▋ | 72/1000 [00:09<02:18, 6.72it/s]
7%|▋ | 74/1000 [00:09<01:54, 8.11it/s]
8%|▊ | 75/1000 [00:10<02:14, 6.86it/s]
8%|▊ | 76/1000 [00:10<02:18, 6.65it/s]
8%|▊ | 78/1000 [00:10<02:26, 6.31it/s]
8%|▊ | 80/1000 [00:10<01:57, 7.85it/s]
8%|▊ | 82/1000 [00:10<01:39, 9.18it/s]
8%|▊ | 84/1000 [00:11<01:54, 8.01it/s]
8%|▊ | 85/1000 [00:11<02:14, 6.78it/s]
9%|▊ | 86/1000 [00:11<02:33, 5.94it/s]
9%|▊ | 87/1000 [00:12<02:49, 5.38it/s]
9%|▉ | 89/1000 [00:12<02:10, 7.00it/s]
9%|▉ | 90/1000 [00:12<02:05, 7.25it/s]
9%|▉ | 91/1000 [00:12<02:29, 6.07it/s]
9%|▉ | 92/1000 [00:12<02:27, 6.17it/s]
9%|▉ | 93/1000 [00:12<02:36, 5.78it/s]
10%|▉ | 95/1000 [00:13<02:43, 5.52it/s]
10%|▉ | 97/1000 [00:13<02:13, 6.79it/s]
10%|▉ | 99/1000 [00:13<01:47, 8.36it/s]
10%|█ | 101/1000 [00:13<01:33, 9.62it/s]
10%|█ | 103/1000 [00:14<01:55, 7.75it/s]
10%|█ | 104/1000 [00:14<01:54, 7.83it/s]
11%|█ | 106/1000 [00:14<01:35, 9.33it/s]
11%|█ | 108/1000 [00:14<01:25, 10.44it/s]
11%|█ | 110/1000 [00:14<01:19, 11.20it/s]
11%|█ | 112/1000 [00:14<01:13, 12.03it/s]
11%|█▏ | 114/1000 [00:14<01:10, 12.51it/s]
12%|█▏ | 116/1000 [00:15<01:09, 12.77it/s]
12%|█▏ | 118/1000 [00:15<01:06, 13.19it/s]
12%|█▏ | 120/1000 [00:15<02:07, 6.90it/s]
12%|█▏ | 122/1000 [00:15<01:48, 8.07it/s]
12%|█▏ | 124/1000 [00:16<01:58, 7.42it/s]
12%|█▎ | 125/1000 [00:16<02:33, 5.71it/s]
13%|█▎ | 126/1000 [00:16<02:22, 6.14it/s]
13%|█▎ | 127/1000 [00:16<02:30, 5.79it/s]
13%|█▎ | 128/1000 [00:17<02:45, 5.28it/s]
13%|█▎ | 130/1000 [00:17<02:02, 7.10it/s]
13%|█▎ | 132/1000 [00:17<01:39, 8.71it/s]
13%|█▎ | 134/1000 [00:17<01:25, 10.15it/s]
14%|█▎ | 136/1000 [00:17<01:29, 9.63it/s]
14%|█▍ | 138/1000 [00:18<01:27, 9.87it/s]
14%|█▍ | 140/1000 [00:18<01:26, 9.95it/s]
14%|█▍ | 142/1000 [00:18<01:35, 9.03it/s]
14%|█▍ | 143/1000 [00:18<01:36, 8.88it/s]
14%|█▍ | 145/1000 [00:18<01:28, 9.67it/s]
15%|█▍ | 147/1000 [00:19<01:43, 8.25it/s]
15%|█▍ | 148/1000 [00:19<01:41, 8.36it/s]
15%|█▌ | 150/1000 [00:19<01:26, 9.80it/s]
15%|█▌ | 152/1000 [00:19<01:18, 10.81it/s]
15%|█▌ | 154/1000 [00:19<01:22, 10.25it/s]
16%|█▌ | 156/1000 [00:20<02:07, 6.60it/s]
16%|█▌ | 158/1000 [00:20<01:46, 7.92it/s]
16%|█▌ | 160/1000 [00:20<01:38, 8.55it/s]
16%|█▌ | 162/1000 [00:20<01:47, 7.77it/s]
16%|█▋ | 163/1000 [00:21<01:51, 7.47it/s]
16%|█▋ | 164/1000 [00:21<02:10, 6.39it/s]
16%|█▋ | 165/1000 [00:21<02:27, 5.66it/s]
17%|█▋ | 166/1000 [00:21<02:41, 5.17it/s]
17%|█▋ | 167/1000 [00:21<02:24, 5.77it/s]
17%|█▋ | 169/1000 [00:22<01:46, 7.83it/s]
17%|█▋ | 171/1000 [00:22<01:56, 7.14it/s]
17%|█▋ | 172/1000 [00:22<02:14, 6.14it/s]
17%|█▋ | 173/1000 [00:22<02:13, 6.21it/s]
17%|█▋ | 174/1000 [00:22<02:02, 6.73it/s]
18%|█▊ | 176/1000 [00:23<01:37, 8.44it/s]
18%|█▊ | 177/1000 [00:23<02:00, 6.80it/s]
18%|█▊ | 179/1000 [00:23<01:35, 8.58it/s]
18%|█▊ | 180/1000 [00:23<01:36, 8.50it/s]
18%|█▊ | 181/1000 [00:23<02:01, 6.75it/s]
18%|█▊ | 182/1000 [00:24<02:23, 5.72it/s]
18%|█▊ | 183/1000 [00:24<02:20, 5.80it/s]
18%|█▊ | 185/1000 [00:24<01:45, 7.75it/s]
19%|█▊ | 186/1000 [00:24<01:43, 7.89it/s]
19%|█▊ | 187/1000 [00:24<02:07, 6.38it/s]
19%|█▉ | 189/1000 [00:24<01:39, 8.11it/s]
19%|█▉ | 190/1000 [00:25<02:02, 6.63it/s]
19%|█▉ | 192/1000 [00:25<02:04, 6.48it/s]
19%|█▉ | 194/1000 [00:25<02:06, 6.38it/s]
20%|█▉ | 196/1000 [00:25<01:43, 7.74it/s]
20%|█▉ | 198/1000 [00:26<01:27, 9.19it/s]
20%|██ | 200/1000 [00:26<01:14, 10.70it/s]
20%|██ | 202/1000 [00:26<01:31, 8.74it/s]
20%|██ | 204/1000 [00:26<01:32, 8.60it/s]
21%|██ | 206/1000 [00:26<01:20, 9.89it/s]
21%|██ | 208/1000 [00:27<01:33, 8.51it/s]
21%|██ | 210/1000 [00:27<01:33, 8.47it/s]
21%|██ | 212/1000 [00:27<01:21, 9.68it/s]
21%|██▏ | 214/1000 [00:27<01:30, 8.72it/s]
22%|██▏ | 216/1000 [00:28<01:25, 9.13it/s]
22%|██▏ | 217/1000 [00:28<01:44, 7.50it/s]
22%|██▏ | 219/1000 [00:28<01:28, 8.78it/s]
22%|██▏ | 220/1000 [00:28<02:03, 6.31it/s]
22%|██▏ | 221/1000 [00:28<02:03, 6.29it/s]
22%|██▏ | 223/1000 [00:29<02:20, 5.55it/s]
22%|██▏ | 224/1000 [00:29<02:08, 6.04it/s]
22%|██▎ | 225/1000 [00:29<02:07, 6.10it/s]
23%|██▎ | 226/1000 [00:29<02:22, 5.41it/s]
23%|██▎ | 228/1000 [00:30<01:53, 6.82it/s]
23%|██▎ | 229/1000 [00:30<02:10, 5.90it/s]
23%|██▎ | 230/1000 [00:30<02:00, 6.36it/s]
23%|██▎ | 232/1000 [00:30<01:35, 8.03it/s]
23%|██▎ | 233/1000 [00:30<01:33, 8.21it/s]
24%|██▎ | 235/1000 [00:30<01:17, 9.92it/s]
24%|██▎ | 237/1000 [00:31<01:20, 9.44it/s]
24%|██▍ | 239/1000 [00:31<01:25, 8.94it/s]
24%|██▍ | 241/1000 [00:31<01:31, 8.33it/s]
24%|██▍ | 242/1000 [00:31<02:06, 6.00it/s]
24%|██▍ | 243/1000 [00:32<02:18, 5.46it/s]
24%|██▍ | 245/1000 [00:32<01:53, 6.65it/s]
25%|██▍ | 247/1000 [00:32<01:31, 8.26it/s]
25%|██▍ | 248/1000 [00:32<01:49, 6.85it/s]
25%|██▍ | 249/1000 [00:33<02:06, 5.95it/s]
25%|██▌ | 250/1000 [00:33<02:07, 5.87it/s]
25%|██▌ | 252/1000 [00:33<02:04, 6.03it/s]
25%|██▌ | 253/1000 [00:33<02:10, 5.74it/s]
26%|██▌ | 255/1000 [00:33<01:41, 7.37it/s]
26%|██▌ | 256/1000 [00:33<01:36, 7.69it/s]
26%|██▌ | 258/1000 [00:34<01:24, 8.75it/s]
26%|██▌ | 260/1000 [00:34<01:36, 7.69it/s]
26%|██▌ | 261/1000 [00:34<01:53, 6.52it/s]
26%|██▌ | 262/1000 [00:34<01:54, 6.43it/s]
26%|██▋ | 264/1000 [00:35<01:56, 6.33it/s]
26%|██▋ | 265/1000 [00:35<01:51, 6.60it/s]
27%|██▋ | 266/1000 [00:35<01:46, 6.91it/s]
27%|██▋ | 268/1000 [00:35<01:37, 7.54it/s]
27%|██▋ | 270/1000 [00:36<01:43, 7.03it/s]
27%|██▋ | 271/1000 [00:36<02:14, 5.44it/s]
27%|██▋ | 273/1000 [00:36<02:07, 5.69it/s]
28%|██▊ | 275/1000 [00:36<01:48, 6.69it/s]
28%|██▊ | 277/1000 [00:37<01:29, 8.04it/s]
28%|██▊ | 278/1000 [00:37<01:46, 6.80it/s]
28%|██▊ | 280/1000 [00:37<01:48, 6.62it/s]
28%|██▊ | 282/1000 [00:37<01:29, 8.02it/s]
28%|██▊ | 283/1000 [00:38<02:02, 5.85it/s]
28%|██▊ | 284/1000 [00:38<02:05, 5.70it/s]
29%|██▊ | 286/1000 [00:38<01:36, 7.44it/s]
29%|██▉ | 288/1000 [00:38<01:21, 8.75it/s]
29%|██▉ | 290/1000 [00:38<01:31, 7.76it/s]
29%|██▉ | 291/1000 [00:39<01:41, 6.99it/s]
29%|██▉ | 292/1000 [00:39<01:56, 6.08it/s]
29%|██▉ | 294/1000 [00:39<01:38, 7.19it/s]
30%|██▉ | 296/1000 [00:39<01:42, 6.89it/s]
30%|██▉ | 298/1000 [00:40<01:25, 8.18it/s]
30%|██▉ | 299/1000 [00:40<01:48, 6.46it/s]
30%|███ | 300/1000 [00:40<01:42, 6.84it/s]
30%|███ | 301/1000 [00:40<01:38, 7.12it/s]
30%|███ | 303/1000 [00:40<01:19, 8.76it/s]
30%|███ | 304/1000 [00:40<01:26, 8.08it/s]
30%|███ | 305/1000 [00:40<01:25, 8.14it/s]
31%|███ | 306/1000 [00:41<01:39, 6.95it/s]
31%|███ | 307/1000 [00:41<01:42, 6.78it/s]
31%|███ | 309/1000 [00:41<01:18, 8.79it/s]
31%|███ | 311/1000 [00:41<01:07, 10.19it/s]
31%|███▏ | 313/1000 [00:41<01:01, 11.24it/s]
32%|███▏ | 315/1000 [00:41<01:07, 10.21it/s]
32%|███▏ | 317/1000 [00:42<01:11, 9.56it/s]
32%|███▏ | 319/1000 [00:42<01:34, 7.23it/s]
32%|███▏ | 321/1000 [00:42<01:38, 6.88it/s]
32%|███▏ | 322/1000 [00:43<01:45, 6.44it/s]
32%|███▏ | 324/1000 [00:43<01:27, 7.75it/s]
32%|███▎ | 325/1000 [00:43<01:58, 5.70it/s]
33%|███▎ | 327/1000 [00:43<01:30, 7.41it/s]
33%|███▎ | 328/1000 [00:43<01:33, 7.17it/s]
33%|███▎ | 330/1000 [00:44<01:38, 6.79it/s]
33%|███▎ | 332/1000 [00:44<01:41, 6.58it/s]
33%|███▎ | 333/1000 [00:44<01:35, 6.96it/s]
33%|███▎ | 334/1000 [00:44<01:44, 6.38it/s]
34%|███▎ | 336/1000 [00:45<01:22, 8.04it/s]
34%|███▍ | 338/1000 [00:45<01:14, 8.84it/s]
34%|███▍ | 340/1000 [00:45<01:05, 10.05it/s]
34%|███▍ | 342/1000 [00:45<01:00, 10.91it/s]
34%|███▍ | 344/1000 [00:45<01:26, 7.60it/s]
34%|███▍ | 345/1000 [00:46<01:24, 7.72it/s]
35%|███▍ | 346/1000 [00:46<01:30, 7.23it/s]
35%|███▍ | 347/1000 [00:46<01:27, 7.42it/s]
35%|███▍ | 349/1000 [00:46<01:34, 6.92it/s]
35%|███▌ | 350/1000 [00:46<01:49, 5.95it/s]
35%|███▌ | 352/1000 [00:47<01:25, 7.62it/s]
35%|███▌ | 354/1000 [00:47<01:25, 7.55it/s]
36%|███▌ | 355/1000 [00:47<01:27, 7.36it/s]
36%|███▌ | 357/1000 [00:47<01:11, 8.96it/s]
36%|███▌ | 359/1000 [00:47<01:00, 10.54it/s]
36%|███▌ | 361/1000 [00:48<01:08, 9.39it/s]
36%|███▋ | 363/1000 [00:48<01:28, 7.17it/s]
36%|███▋ | 364/1000 [00:48<01:41, 6.26it/s]
36%|███▋ | 365/1000 [00:49<02:09, 4.91it/s]
37%|███▋ | 367/1000 [00:49<01:58, 5.35it/s]
37%|███▋ | 368/1000 [00:49<02:05, 5.02it/s]
37%|███▋ | 369/1000 [00:49<01:52, 5.59it/s]
37%|███▋ | 371/1000 [00:49<01:23, 7.54it/s]
37%|███▋ | 372/1000 [00:50<01:21, 7.72it/s]
37%|███▋ | 374/1000 [00:50<01:17, 8.07it/s]
38%|███▊ | 375/1000 [00:50<01:40, 6.20it/s]
38%|███▊ | 376/1000 [00:50<01:53, 5.47it/s]
38%|███▊ | 378/1000 [00:50<01:29, 6.92it/s]
38%|███▊ | 380/1000 [00:51<01:10, 8.77it/s]
38%|███▊ | 382/1000 [00:51<01:18, 7.91it/s]
38%|███▊ | 384/1000 [00:51<01:06, 9.21it/s]
39%|███▊ | 386/1000 [00:51<01:06, 9.17it/s]
39%|███▉ | 388/1000 [00:52<01:25, 7.14it/s]
39%|███▉ | 390/1000 [00:52<01:19, 7.65it/s]
39%|███▉ | 391/1000 [00:52<01:22, 7.37it/s]
39%|███▉ | 393/1000 [00:52<01:09, 8.79it/s]
40%|███▉ | 395/1000 [00:53<01:21, 7.45it/s]
40%|███▉ | 397/1000 [00:53<01:09, 8.73it/s]
40%|███▉ | 399/1000 [00:53<01:36, 6.24it/s]
40%|████ | 400/1000 [00:53<01:45, 5.68it/s]
40%|████ | 402/1000 [00:54<01:41, 5.92it/s]
40%|████ | 404/1000 [00:54<01:22, 7.24it/s]
41%|████ | 406/1000 [00:54<01:09, 8.49it/s]
41%|████ | 408/1000 [00:55<01:32, 6.39it/s]
41%|████ | 410/1000 [00:55<01:31, 6.45it/s]
41%|████ | 411/1000 [00:55<01:40, 5.83it/s]
41%|████ | 412/1000 [00:55<01:49, 5.36it/s]
41%|████▏ | 414/1000 [00:55<01:22, 7.06it/s]
42%|████▏ | 416/1000 [00:56<01:25, 6.82it/s]
42%|████▏ | 418/1000 [00:56<01:13, 7.91it/s]
42%|████▏ | 420/1000 [00:56<01:10, 8.22it/s]
42%|████▏ | 421/1000 [00:56<01:18, 7.36it/s]
42%|████▏ | 423/1000 [00:57<01:27, 6.62it/s]
42%|████▏ | 424/1000 [00:57<01:38, 5.86it/s]
42%|████▎ | 425/1000 [00:57<01:31, 6.30it/s]
43%|████▎ | 427/1000 [00:57<01:12, 7.88it/s]
43%|████▎ | 428/1000 [00:57<01:16, 7.49it/s]
43%|████▎ | 429/1000 [00:58<01:13, 7.80it/s]
43%|████▎ | 431/1000 [00:58<00:59, 9.53it/s]
43%|████▎ | 433/1000 [00:58<00:51, 11.00it/s]
44%|████▎ | 435/1000 [00:58<00:48, 11.76it/s]
44%|████▎ | 437/1000 [00:58<00:53, 10.47it/s]
44%|████▍ | 439/1000 [00:59<01:09, 8.08it/s]
44%|████▍ | 441/1000 [00:59<01:00, 9.31it/s]
44%|████▍ | 443/1000 [00:59<01:08, 8.08it/s]
44%|████▍ | 444/1000 [00:59<01:16, 7.24it/s]
45%|████▍ | 446/1000 [00:59<01:03, 8.72it/s]
45%|████▍ | 448/1000 [01:00<01:13, 7.48it/s]
45%|████▌ | 450/1000 [01:00<01:18, 7.01it/s]
45%|████▌ | 451/1000 [01:00<01:28, 6.18it/s]
45%|████▌ | 452/1000 [01:01<01:38, 5.58it/s]
45%|████▌ | 454/1000 [01:01<01:16, 7.18it/s]
46%|████▌ | 456/1000 [01:01<01:04, 8.50it/s]
46%|████▌ | 457/1000 [01:01<01:09, 7.81it/s]
46%|████▌ | 459/1000 [01:01<00:58, 9.26it/s]
46%|████▌ | 461/1000 [01:01<00:49, 10.82it/s]
46%|████▋ | 463/1000 [01:02<01:10, 7.61it/s]
46%|████▋ | 465/1000 [01:02<01:19, 6.75it/s]
47%|████▋ | 466/1000 [01:02<01:29, 6.00it/s]
47%|████▋ | 467/1000 [01:03<01:50, 4.81it/s]
47%|████▋ | 469/1000 [01:03<01:24, 6.30it/s]
47%|████▋ | 471/1000 [01:03<01:07, 7.85it/s]
47%|████▋ | 473/1000 [01:03<01:09, 7.56it/s]
47%|████▋ | 474/1000 [01:03<01:20, 6.50it/s]
48%|████▊ | 476/1000 [01:04<01:22, 6.39it/s]
48%|████▊ | 477/1000 [01:04<01:35, 5.50it/s]
48%|████▊ | 479/1000 [01:04<01:12, 7.15it/s]
48%|████▊ | 480/1000 [01:04<01:19, 6.58it/s]
48%|████▊ | 482/1000 [01:05<01:04, 8.06it/s]
48%|████▊ | 484/1000 [01:05<01:10, 7.31it/s]
48%|████▊ | 485/1000 [01:05<01:21, 6.31it/s]
49%|████▊ | 486/1000 [01:05<01:21, 6.30it/s]
49%|████▉ | 488/1000 [01:05<01:04, 8.00it/s]
49%|████▉ | 489/1000 [01:06<01:17, 6.63it/s]
49%|████▉ | 491/1000 [01:06<01:01, 8.22it/s]
49%|████▉ | 492/1000 [01:06<01:01, 8.29it/s]
49%|████▉ | 494/1000 [01:06<00:50, 9.99it/s]
50%|████▉ | 496/1000 [01:06<00:59, 8.40it/s]
50%|████▉ | 498/1000 [01:07<00:59, 8.43it/s]
50%|████▉ | 499/1000 [01:07<01:15, 6.65it/s]
50%|█████ | 500/1000 [01:07<01:24, 5.93it/s]
50%|█████ | 502/1000 [01:07<01:06, 7.54it/s]
50%|█████ | 503/1000 [01:08<01:13, 6.79it/s]
50%|█████ | 505/1000 [01:08<01:15, 6.54it/s]
51%|█████ | 506/1000 [01:08<01:25, 5.80it/s]
51%|█████ | 508/1000 [01:08<01:06, 7.42it/s]
51%|█████ | 510/1000 [01:08<00:54, 8.95it/s]
51%|█████ | 512/1000 [01:09<00:48, 9.97it/s]
51%|█████▏ | 514/1000 [01:09<01:06, 7.28it/s]
52%|█████▏ | 515/1000 [01:09<01:04, 7.53it/s]
52%|█████▏ | 516/1000 [01:09<01:08, 7.11it/s]
52%|█████▏ | 518/1000 [01:09<00:59, 8.08it/s]
52%|█████▏ | 519/1000 [01:10<01:15, 6.38it/s]
52%|█████▏ | 521/1000 [01:10<00:59, 8.03it/s]
52%|█████▏ | 522/1000 [01:10<01:11, 6.67it/s]
52%|█████▏ | 523/1000 [01:10<01:22, 5.81it/s]
52%|█████▏ | 524/1000 [01:11<01:25, 5.56it/s]
53%|█████▎ | 526/1000 [01:11<01:11, 6.59it/s]
53%|█████▎ | 528/1000 [01:11<01:12, 6.54it/s]
53%|█████▎ | 529/1000 [01:11<01:13, 6.40it/s]
53%|█████▎ | 531/1000 [01:11<00:57, 8.12it/s]
53%|█████▎ | 533/1000 [01:11<00:47, 9.74it/s]
54%|█████▎ | 535/1000 [01:12<01:09, 6.69it/s]
54%|█████▎ | 536/1000 [01:12<01:12, 6.36it/s]
54%|█████▎ | 537/1000 [01:12<01:21, 5.66it/s]
54%|█████▍ | 539/1000 [01:13<01:17, 5.93it/s]
54%|█████▍ | 540/1000 [01:13<01:20, 5.75it/s]
54%|█████▍ | 541/1000 [01:13<01:27, 5.25it/s]
54%|█████▍ | 543/1000 [01:13<01:05, 6.93it/s]
55%|█████▍ | 545/1000 [01:14<01:04, 7.06it/s]
55%|█████▍ | 546/1000 [01:14<01:09, 6.50it/s]
55%|█████▍ | 547/1000 [01:14<01:19, 5.69it/s]
55%|█████▍ | 549/1000 [01:14<01:16, 5.92it/s]
55%|█████▌ | 551/1000 [01:15<00:59, 7.51it/s]
55%|█████▌ | 552/1000 [01:15<01:01, 7.27it/s]
55%|█████▌ | 553/1000 [01:15<01:12, 6.18it/s]
55%|█████▌ | 554/1000 [01:15<01:14, 5.95it/s]
56%|█████▌ | 556/1000 [01:15<00:57, 7.77it/s]
56%|█████▌ | 557/1000 [01:15<01:02, 7.03it/s]
56%|█████▌ | 559/1000 [01:16<00:49, 8.86it/s]
56%|█████▌ | 561/1000 [01:16<00:43, 10.06it/s]
56%|█████▋ | 563/1000 [01:16<00:52, 8.37it/s]
56%|█████▋ | 565/1000 [01:16<00:54, 7.98it/s]
57%|█████▋ | 566/1000 [01:17<01:04, 6.75it/s]
57%|█████▋ | 568/1000 [01:17<01:05, 6.55it/s]
57%|█████▋ | 569/1000 [01:17<01:06, 6.44it/s]
57%|█████▋ | 571/1000 [01:17<01:06, 6.44it/s]
57%|█████▋ | 572/1000 [01:18<01:07, 6.30it/s]
57%|█████▋ | 574/1000 [01:18<01:07, 6.33it/s]
58%|█████▊ | 576/1000 [01:18<00:54, 7.83it/s]
58%|█████▊ | 577/1000 [01:18<01:13, 5.73it/s]
58%|█████▊ | 578/1000 [01:19<01:20, 5.24it/s]
58%|█████▊ | 580/1000 [01:19<01:00, 6.96it/s]
58%|█████▊ | 582/1000 [01:19<00:48, 8.55it/s]
58%|█████▊ | 584/1000 [01:19<00:54, 7.59it/s]
58%|█████▊ | 585/1000 [01:19<00:59, 6.92it/s]
59%|█████▊ | 587/1000 [01:20<00:57, 7.15it/s]
59%|█████▉ | 589/1000 [01:20<00:48, 8.53it/s]
59%|█████▉ | 590/1000 [01:20<01:00, 6.75it/s]
59%|█████▉ | 592/1000 [01:20<00:49, 8.18it/s]
59%|█████▉ | 593/1000 [01:20<00:59, 6.80it/s]
60%|█████▉ | 595/1000 [01:21<00:48, 8.40it/s]
60%|█████▉ | 596/1000 [01:21<00:58, 6.87it/s]
60%|█████▉ | 597/1000 [01:21<01:00, 6.68it/s]
60%|█████▉ | 599/1000 [01:21<01:01, 6.47it/s]
60%|██████ | 601/1000 [01:22<01:02, 6.39it/s]
60%|██████ | 602/1000 [01:22<00:59, 6.70it/s]
60%|██████ | 604/1000 [01:22<01:09, 5.69it/s]
61%|██████ | 606/1000 [01:22<00:55, 7.10it/s]
61%|██████ | 608/1000 [01:23<00:49, 7.84it/s]
61%|██████ | 610/1000 [01:23<00:46, 8.46it/s]
61%|██████ | 612/1000 [01:23<00:39, 9.71it/s]
61%|██████▏ | 614/1000 [01:23<00:35, 10.77it/s]
62%|██████▏ | 616/1000 [01:23<00:50, 7.60it/s]
62%|██████▏ | 617/1000 [01:24<00:49, 7.73it/s]
62%|██████▏ | 619/1000 [01:24<00:42, 9.07it/s]
62%|██████▏ | 621/1000 [01:24<00:47, 8.02it/s]
62%|██████▏ | 623/1000 [01:24<00:45, 8.20it/s]
62%|██████▎ | 625/1000 [01:25<00:50, 7.44it/s]
63%|██████▎ | 627/1000 [01:25<00:43, 8.62it/s]
63%|██████▎ | 628/1000 [01:25<00:51, 7.19it/s]
63%|██████▎ | 629/1000 [01:25<00:59, 6.21it/s]
63%|██████▎ | 631/1000 [01:25<00:46, 7.86it/s]
63%|██████▎ | 633/1000 [01:26<00:38, 9.45it/s]
64%|██████▎ | 635/1000 [01:26<00:54, 6.72it/s]
64%|██████▎ | 636/1000 [01:26<00:51, 7.07it/s]
64%|██████▍ | 638/1000 [01:26<00:45, 7.95it/s]
64%|██████▍ | 640/1000 [01:26<00:39, 9.17it/s]
64%|██████▍ | 642/1000 [01:27<00:45, 7.95it/s]
64%|██████▍ | 643/1000 [01:27<00:47, 7.59it/s]
64%|██████▍ | 645/1000 [01:27<00:50, 7.10it/s]
65%|██████▍ | 647/1000 [01:27<00:46, 7.57it/s]
65%|██████▍ | 648/1000 [01:28<00:54, 6.51it/s]
65%|██████▌ | 650/1000 [01:28<00:53, 6.56it/s]
65%|██████▌ | 652/1000 [01:28<00:55, 6.32it/s]
65%|██████▌ | 654/1000 [01:28<00:44, 7.70it/s]
66%|██████▌ | 656/1000 [01:29<00:38, 8.92it/s]
66%|██████▌ | 658/1000 [01:29<00:42, 8.10it/s]
66%|██████▌ | 659/1000 [01:29<00:56, 5.99it/s]
66%|██████▌ | 661/1000 [01:29<00:44, 7.56it/s]
66%|██████▌ | 662/1000 [01:30<00:52, 6.48it/s]
66%|██████▋ | 664/1000 [01:30<00:58, 5.78it/s]
66%|██████▋ | 665/1000 [01:30<01:02, 5.33it/s]
67%|██████▋ | 667/1000 [01:31<00:59, 5.61it/s]
67%|██████▋ | 668/1000 [01:31<01:03, 5.20it/s]
67%|██████▋ | 669/1000 [01:31<00:58, 5.70it/s]
67%|██████▋ | 671/1000 [01:31<00:55, 5.88it/s]
67%|██████▋ | 673/1000 [01:32<00:49, 6.64it/s]
68%|██████▊ | 675/1000 [01:32<00:44, 7.26it/s]
68%|██████▊ | 677/1000 [01:32<00:37, 8.65it/s]
68%|██████▊ | 679/1000 [01:32<00:33, 9.69it/s]
68%|██████▊ | 681/1000 [01:32<00:29, 10.96it/s]
68%|██████▊ | 683/1000 [01:33<00:35, 8.93it/s]
68%|██████▊ | 685/1000 [01:33<00:31, 9.88it/s]
69%|██████▊ | 687/1000 [01:33<00:45, 6.86it/s]
69%|██████▉ | 688/1000 [01:33<00:43, 7.16it/s]
69%|██████▉ | 690/1000 [01:34<00:45, 6.81it/s]
69%|██████▉ | 692/1000 [01:34<00:39, 7.84it/s]
69%|██████▉ | 694/1000 [01:34<00:42, 7.26it/s]
70%|██████▉ | 695/1000 [01:34<00:41, 7.41it/s]
70%|██████▉ | 696/1000 [01:34<00:48, 6.33it/s]
70%|██████▉ | 698/1000 [01:35<00:43, 6.95it/s]
70%|██████▉ | 699/1000 [01:35<00:49, 6.05it/s]
70%|███████ | 701/1000 [01:35<00:39, 7.60it/s]
70%|███████ | 702/1000 [01:35<00:53, 5.61it/s]
70%|███████ | 704/1000 [01:36<00:41, 7.21it/s]
70%|███████ | 705/1000 [01:36<00:54, 5.42it/s]
71%|███████ | 707/1000 [01:36<00:41, 7.03it/s]
71%|███████ | 709/1000 [01:36<00:38, 7.62it/s]
71%|███████ | 710/1000 [01:37<00:44, 6.49it/s]
71%|███████ | 712/1000 [01:37<00:37, 7.69it/s]
71%|███████▏ | 713/1000 [01:37<00:36, 7.84it/s]
72%|███████▏ | 715/1000 [01:37<00:30, 9.35it/s]
72%|███████▏ | 717/1000 [01:37<00:35, 8.05it/s]
72%|███████▏ | 718/1000 [01:38<00:41, 6.79it/s]
72%|███████▏ | 719/1000 [01:38<00:47, 5.92it/s]
72%|███████▏ | 720/1000 [01:38<00:43, 6.46it/s]
72%|███████▏ | 722/1000 [01:38<00:34, 8.14it/s]
72%|███████▏ | 723/1000 [01:38<00:33, 8.23it/s]
72%|███████▏ | 724/1000 [01:38<00:33, 8.25it/s]
72%|███████▎ | 725/1000 [01:38<00:33, 8.31it/s]
73%|███████▎ | 727/1000 [01:39<00:26, 10.14it/s]
73%|███████▎ | 729/1000 [01:39<00:23, 11.62it/s]
73%|███████▎ | 731/1000 [01:39<00:32, 8.32it/s]
73%|███████▎ | 733/1000 [01:39<00:28, 9.52it/s]
74%|███████▎ | 735/1000 [01:39<00:26, 9.88it/s]
74%|███████▎ | 737/1000 [01:40<00:27, 9.51it/s]
74%|███████▍ | 739/1000 [01:40<00:26, 9.76it/s]
74%|███████▍ | 741/1000 [01:40<00:31, 8.30it/s]
74%|███████▍ | 743/1000 [01:40<00:30, 8.36it/s]
74%|███████▍ | 745/1000 [01:41<00:26, 9.61it/s]
75%|███████▍ | 747/1000 [01:41<00:24, 10.45it/s]
75%|███████▍ | 749/1000 [01:41<00:29, 8.65it/s]
75%|███████▌ | 750/1000 [01:41<00:32, 7.68it/s]
75%|███████▌ | 751/1000 [01:42<00:40, 6.16it/s]
75%|███████▌ | 753/1000 [01:42<00:34, 7.24it/s]
75%|███████▌ | 754/1000 [01:42<00:39, 6.22it/s]
76%|███████▌ | 756/1000 [01:42<00:38, 6.41it/s]
76%|███████▌ | 758/1000 [01:42<00:31, 7.61it/s]
76%|███████▌ | 759/1000 [01:43<00:32, 7.31it/s]
76%|███████▌ | 761/1000 [01:43<00:27, 8.71it/s]
76%|███████▋ | 763/1000 [01:43<00:30, 7.66it/s]
76%|███████▋ | 764/1000 [01:43<00:35, 6.62it/s]
77%|███████▋ | 766/1000 [01:44<00:36, 6.46it/s]
77%|███████▋ | 768/1000 [01:44<00:29, 7.78it/s]
77%|███████▋ | 769/1000 [01:44<00:34, 6.63it/s]
77%|███████▋ | 770/1000 [01:44<00:35, 6.56it/s]
77%|███████▋ | 772/1000 [01:44<00:28, 8.14it/s]
77%|███████▋ | 773/1000 [01:45<00:35, 6.38it/s]
77%|███████▋ | 774/1000 [01:45<00:33, 6.77it/s]
78%|███████▊ | 776/1000 [01:45<00:28, 7.88it/s]
78%|███████▊ | 778/1000 [01:45<00:23, 9.59it/s]
78%|███████▊ | 780/1000 [01:45<00:31, 6.93it/s]
78%|███████▊ | 782/1000 [01:46<00:26, 8.36it/s]
78%|███████▊ | 784/1000 [01:46<00:30, 7.15it/s]
79%|███████▊ | 786/1000 [01:46<00:28, 7.54it/s]
79%|███████▉ | 788/1000 [01:46<00:25, 8.35it/s]
79%|███████▉ | 790/1000 [01:47<00:23, 8.98it/s]
79%|███████▉ | 791/1000 [01:47<00:25, 8.21it/s]
79%|███████▉ | 792/1000 [01:47<00:26, 7.72it/s]
79%|███████▉ | 793/1000 [01:47<00:25, 7.97it/s]
80%|███████▉ | 795/1000 [01:47<00:28, 7.18it/s]
80%|███████▉ | 797/1000 [01:48<00:29, 6.85it/s]
80%|███████▉ | 798/1000 [01:48<00:33, 6.01it/s]
80%|████████ | 800/1000 [01:48<00:29, 6.72it/s]
80%|████████ | 802/1000 [01:48<00:25, 7.63it/s]
80%|████████ | 804/1000 [01:49<00:25, 7.83it/s]
81%|████████ | 806/1000 [01:49<00:21, 9.17it/s]
81%|████████ | 807/1000 [01:49<00:21, 8.97it/s]
81%|████████ | 809/1000 [01:49<00:18, 10.20it/s]
81%|████████ | 811/1000 [01:49<00:16, 11.22it/s]
81%|████████▏ | 813/1000 [01:49<00:20, 9.05it/s]
82%|████████▏ | 815/1000 [01:50<00:19, 9.29it/s]
82%|████████▏ | 817/1000 [01:50<00:22, 8.12it/s]
82%|████████▏ | 819/1000 [01:50<00:19, 9.17it/s]
82%|████████▏ | 821/1000 [01:50<00:22, 8.04it/s]
82%|████████▏ | 823/1000 [01:51<00:22, 7.81it/s]
82%|████████▏ | 824/1000 [01:51<00:26, 6.74it/s]
82%|████████▎ | 825/1000 [01:51<00:25, 6.99it/s]
83%|████████▎ | 826/1000 [01:51<00:30, 5.80it/s]
83%|████████▎ | 828/1000 [01:52<00:32, 5.24it/s]
83%|████████▎ | 829/1000 [01:52<00:29, 5.73it/s]
83%|████████▎ | 831/1000 [01:52<00:24, 6.93it/s]
83%|████████▎ | 832/1000 [01:52<00:29, 5.71it/s]
83%|████████▎ | 833/1000 [01:52<00:26, 6.20it/s]
83%|████████▎ | 834/1000 [01:53<00:27, 5.99it/s]
84%|████████▎ | 835/1000 [01:53<00:25, 6.50it/s]
84%|████████▎ | 836/1000 [01:53<00:26, 6.08it/s]
84%|████████▍ | 838/1000 [01:53<00:21, 7.44it/s]
84%|████████▍ | 840/1000 [01:54<00:24, 6.62it/s]
84%|████████▍ | 842/1000 [01:54<00:19, 8.15it/s]
84%|████████▍ | 844/1000 [01:54<00:24, 6.41it/s]
84%|████████▍ | 845/1000 [01:54<00:26, 5.77it/s]
85%|████████▍ | 847/1000 [01:55<00:24, 6.25it/s]
85%|████████▍ | 849/1000 [01:55<00:20, 7.55it/s]
85%|████████▌ | 850/1000 [01:55<00:23, 6.49it/s]
85%|████████▌ | 851/1000 [01:55<00:21, 6.87it/s]
85%|████████▌ | 853/1000 [01:55<00:17, 8.46it/s]
86%|████████▌ | 855/1000 [01:55<00:14, 10.03it/s]
86%|████████▌ | 857/1000 [01:56<00:14, 10.17it/s]
86%|████████▌ | 859/1000 [01:56<00:16, 8.50it/s]
86%|████████▌ | 861/1000 [01:56<00:14, 9.76it/s]
86%|████████▋ | 863/1000 [01:56<00:12, 10.61it/s]
86%|████████▋ | 865/1000 [01:56<00:11, 11.67it/s]
87%|████████▋ | 867/1000 [01:57<00:14, 9.30it/s]
87%|████████▋ | 869/1000 [01:57<00:12, 10.25it/s]
87%|████████▋ | 871/1000 [01:57<00:11, 11.28it/s]
87%|████████▋ | 873/1000 [01:57<00:16, 7.77it/s]
88%|████████▊ | 875/1000 [01:58<00:16, 7.63it/s]
88%|████████▊ | 877/1000 [01:58<00:14, 8.76it/s]
88%|████████▊ | 879/1000 [01:58<00:17, 6.82it/s]
88%|████████▊ | 881/1000 [01:58<00:15, 7.56it/s]
88%|████████▊ | 882/1000 [01:59<00:18, 6.51it/s]
88%|████████▊ | 884/1000 [01:59<00:14, 7.93it/s]
89%|████████▊ | 886/1000 [01:59<00:12, 9.15it/s]
89%|████████▉ | 888/1000 [01:59<00:10, 10.34it/s]
89%|████████▉ | 890/1000 [01:59<00:11, 9.77it/s]
89%|████████▉ | 892/1000 [02:00<00:10, 10.75it/s]
89%|████████▉ | 894/1000 [02:00<00:13, 7.60it/s]
90%|████████▉ | 896/1000 [02:00<00:11, 8.83it/s]
90%|████████▉ | 898/1000 [02:01<00:15, 6.53it/s]
90%|█████████ | 900/1000 [02:01<00:13, 7.69it/s]
90%|█████████ | 902/1000 [02:01<00:12, 7.84it/s]
90%|█████████ | 904/1000 [02:01<00:10, 9.05it/s]
91%|█████████ | 906/1000 [02:02<00:13, 7.04it/s]
91%|█████████ | 908/1000 [02:02<00:11, 8.30it/s]
91%|█████████ | 910/1000 [02:02<00:11, 7.58it/s]
91%|█████████ | 912/1000 [02:02<00:10, 8.77it/s]
91%|█████████▏| 914/1000 [02:03<00:11, 7.39it/s]
92%|█████████▏| 916/1000 [02:03<00:11, 7.08it/s]
92%|█████████▏| 917/1000 [02:03<00:11, 7.37it/s]
92%|█████████▏| 918/1000 [02:03<00:14, 5.60it/s]
92%|█████████▏| 919/1000 [02:03<00:14, 5.72it/s]
92%|█████████▏| 921/1000 [02:04<00:14, 5.58it/s]
92%|█████████▏| 922/1000 [02:04<00:13, 5.94it/s]
92%|█████████▏| 924/1000 [02:04<00:10, 7.17it/s]
93%|█████████▎| 926/1000 [02:04<00:08, 8.64it/s]
93%|█████████▎| 927/1000 [02:04<00:09, 8.10it/s]
93%|█████████▎| 928/1000 [02:05<00:10, 6.65it/s]
93%|█████████▎| 930/1000 [02:05<00:10, 6.47it/s]
93%|█████████▎| 931/1000 [02:05<00:10, 6.83it/s]
93%|█████████▎| 933/1000 [02:05<00:10, 6.61it/s]
93%|█████████▎| 934/1000 [02:06<00:10, 6.17it/s]
94%|█████████▎| 936/1000 [02:06<00:08, 7.30it/s]
94%|█████████▍| 938/1000 [02:06<00:07, 8.81it/s]
94%|█████████▍| 939/1000 [02:06<00:07, 8.02it/s]
94%|█████████▍| 940/1000 [02:06<00:07, 8.11it/s]
94%|█████████▍| 942/1000 [02:07<00:09, 6.33it/s]
94%|█████████▍| 944/1000 [02:07<00:07, 7.08it/s]
95%|█████████▍| 946/1000 [02:07<00:06, 8.39it/s]
95%|█████████▍| 948/1000 [02:07<00:05, 9.70it/s]
95%|█████████▌| 950/1000 [02:07<00:05, 8.81it/s]
95%|█████████▌| 952/1000 [02:08<00:06, 7.40it/s]
95%|█████████▌| 954/1000 [02:08<00:07, 6.16it/s]
96%|█████████▌| 956/1000 [02:08<00:05, 7.39it/s]
96%|█████████▌| 957/1000 [02:09<00:06, 6.40it/s]
96%|█████████▌| 959/1000 [02:09<00:07, 5.77it/s]
96%|█████████▌| 961/1000 [02:09<00:05, 6.82it/s]
96%|█████████▌| 962/1000 [02:10<00:06, 6.04it/s]
96%|█████████▋| 964/1000 [02:10<00:04, 7.49it/s]
96%|█████████▋| 965/1000 [02:10<00:05, 6.44it/s]
97%|█████████▋| 966/1000 [02:10<00:05, 6.33it/s]
97%|█████████▋| 968/1000 [02:10<00:03, 8.01it/s]
97%|█████████▋| 970/1000 [02:10<00:03, 9.40it/s]
97%|█████████▋| 972/1000 [02:11<00:03, 8.02it/s]
97%|█████████▋| 974/1000 [02:11<00:02, 9.20it/s]
98%|█████████▊| 976/1000 [02:11<00:02, 9.80it/s]
98%|█████████▊| 978/1000 [02:11<00:02, 10.82it/s]
98%|█████████▊| 980/1000 [02:12<00:02, 8.41it/s]
98%|█████████▊| 981/1000 [02:12<00:02, 7.05it/s]
98%|█████████▊| 982/1000 [02:12<00:03, 5.43it/s]
98%|█████████▊| 984/1000 [02:12<00:02, 6.93it/s]
99%|█████████▊| 986/1000 [02:12<00:01, 8.36it/s]
99%|█████████▉| 988/1000 [02:13<00:01, 6.73it/s]
99%|█████████▉| 989/1000 [02:13<00:01, 5.99it/s]
99%|█████████▉| 991/1000 [02:13<00:01, 6.15it/s]
99%|█████████▉| 992/1000 [02:14<00:01, 4.98it/s]
99%|█████████▉| 994/1000 [02:14<00:00, 6.55it/s]
100%|█████████▉| 995/1000 [02:14<00:00, 5.53it/s]
100%|█████████▉| 997/1000 [02:14<00:00, 7.06it/s]
100%|█████████▉| 999/1000 [02:15<00:00, 6.76it/s]
100%|██████████| 1000/1000 [02:15<00:00, 6.67it/s]
{'eval_loss': '0.8095', 'eval_runtime': '135.5', 'eval_samples_per_second': '7.382', 'eval_steps_per_second': '7.382', 'epoch': '0.331', 'num_input_tokens_seen': 3999176}
33%|███▎ | 600/1813 [1:06:42<2:03:21, 6.10s/it]
100%|██████████| 1000/1000 [02:15<00:00, 6.67it/s]

33%|███▎ | 601/1813 [1:06:47<15:36:27, 46.36s/it]
33%|███▎ | 602/1813 [1:06:52<11:25:39, 33.97s/it]
33%|███▎ | 603/1813 [1:06:58<8:33:13, 25.45s/it]
33%|███▎ | 604/1813 [1:07:04<6:35:46, 19.64s/it]
33%|███▎ | 605/1813 [1:07:12<5:25:22, 16.16s/it]
33%|███▎ | 606/1813 [1:07:19<4:32:50, 13.56s/it]
33%|███▎ | 607/1813 [1:07:26<3:49:16, 11.41s/it]
34%|███▎ | 608/1813 [1:07:32<3:19:17, 9.92s/it]
34%|███▎ | 609/1813 [1:07:39<2:58:21, 8.89s/it]
34%|███▎ | 610/1813 [1:07:45<2:44:10, 8.19s/it]
{'loss': '0.976', 'grad_norm': '0.7217', 'learning_rate': '0.0001647', 'epoch': '0.3366', 'num_input_tokens_seen': 4066376, 'train_runtime': '4066', 'train_tokens_per_second': '1000'}
34%|███▎ | 610/1813 [1:07:45<2:44:10, 8.19s/it]
34%|███▎ | 611/1813 [1:07:51<2:26:46, 7.33s/it]
34%|███▍ | 612/1813 [1:07:55<2:07:37, 6.38s/it]
34%|███▍ | 613/1813 [1:08:00<2:03:49, 6.19s/it]
34%|███▍ | 614/1813 [1:08:06<2:02:22, 6.12s/it]
34%|███▍ | 615/1813 [1:08:12<1:57:13, 5.87s/it]
34%|███▍ | 616/1813 [1:08:17<1:51:44, 5.60s/it]
34%|███▍ | 617/1813 [1:08:22<1:51:03, 5.57s/it]
34%|███▍ | 618/1813 [1:08:29<2:00:13, 6.04s/it]
34%|███▍ | 619/1813 [1:08:34<1:53:22, 5.70s/it]
34%|███▍ | 620/1813 [1:08:41<1:58:22, 5.95s/it]
{'loss': '0.8778', 'grad_norm': '1.008', 'learning_rate': '0.0001633', 'epoch': '0.3421', 'num_input_tokens_seen': 4123976, 'train_runtime': '4121', 'train_tokens_per_second': '1001'}
34%|███▍ | 620/1813 [1:08:41<1:58:22, 5.95s/it]
34%|███▍ | 621/1813 [1:08:48<2:03:35, 6.22s/it]
34%|███▍ | 622/1813 [1:08:55<2:11:36, 6.63s/it]
34%|███▍ | 623/1813 [1:09:00<2:01:16, 6.11s/it]
34%|███▍ | 624/1813 [1:09:06<2:02:17, 6.17s/it]
34%|███▍ | 625/1813 [1:09:11<1:54:42, 5.79s/it]
35%|███▍ | 626/1813 [1:09:16<1:45:04, 5.31s/it]
35%|███▍ | 627/1813 [1:09:22<1:49:33, 5.54s/it]
35%|███▍ | 628/1813 [1:09:28<1:52:32, 5.70s/it]
35%|███▍ | 629/1813 [1:09:36<2:07:45, 6.47s/it]
35%|███▍ | 630/1813 [1:09:43<2:09:00, 6.54s/it]
{'loss': '0.9491', 'grad_norm': '0.8515', 'learning_rate': '0.0001618', 'epoch': '0.3476', 'num_input_tokens_seen': 4191992, 'train_runtime': '4183', 'train_tokens_per_second': '1002'}
35%|███▍ | 630/1813 [1:09:43<2:09:00, 6.54s/it]
35%|███▍ | 631/1813 [1:09:49<2:08:05, 6.50s/it]
35%|███▍ | 632/1813 [1:09:55<2:05:00, 6.35s/it]
35%|███▍ | 633/1813 [1:10:01<2:00:59, 6.15s/it]
35%|███▍ | 634/1813 [1:10:08<2:07:25, 6.48s/it]
35%|███▌ | 635/1813 [1:10:15<2:08:10, 6.53s/it]
35%|███▌ | 636/1813 [1:10:20<1:59:38, 6.10s/it]
35%|███▌ | 637/1813 [1:10:27<2:04:32, 6.35s/it]
35%|███▌ | 638/1813 [1:10:32<1:59:40, 6.11s/it]
35%|███▌ | 639/1813 [1:10:37<1:54:13, 5.84s/it]
35%|███▌ | 640/1813 [1:10:43<1:54:55, 5.88s/it]
{'loss': '0.9522', 'grad_norm': '1.237', 'learning_rate': '0.0001603', 'epoch': '0.3531', 'num_input_tokens_seen': 4257760, 'train_runtime': '4244', 'train_tokens_per_second': '1003'}
35%|███▌ | 640/1813 [1:10:43<1:54:55, 5.88s/it]
35%|███▌ | 641/1813 [1:10:49<1:50:17, 5.65s/it]
35%|███▌ | 642/1813 [1:10:56<1:59:38, 6.13s/it]
35%|███▌ | 643/1813 [1:11:02<2:02:40, 6.29s/it]
36%|███▌ | 644/1813 [1:11:08<1:57:25, 6.03s/it]
36%|███▌ | 645/1813 [1:11:14<1:57:11, 6.02s/it]
36%|███▌ | 646/1813 [1:11:20<1:55:50, 5.96s/it]
36%|███▌ | 647/1813 [1:11:26<1:57:24, 6.04s/it]
36%|███▌ | 648/1813 [1:11:33<2:02:48, 6.32s/it]
36%|███▌ | 649/1813 [1:11:39<1:58:43, 6.12s/it]
36%|███▌ | 650/1813 [1:11:44<1:53:33, 5.86s/it]
{'loss': '0.9441', 'grad_norm': '1.01', 'learning_rate': '0.0001588', 'epoch': '0.3586', 'num_input_tokens_seen': 4322136, 'train_runtime': '4304', 'train_tokens_per_second': '1004'}
36%|███▌ | 650/1813 [1:11:44<1:53:33, 5.86s/it]
36%|███▌ | 651/1813 [1:11:50<1:58:13, 6.10s/it]
36%|███▌ | 652/1813 [1:11:57<2:02:44, 6.34s/it]
36%|███▌ | 653/1813 [1:12:03<1:57:57, 6.10s/it]
36%|███▌ | 654/1813 [1:12:08<1:54:27, 5.92s/it]
36%|███▌ | 655/1813 [1:12:15<1:57:52, 6.11s/it]
36%|███▌ | 656/1813 [1:12:21<1:54:45, 5.95s/it]
36%|███▌ | 657/1813 [1:12:26<1:51:47, 5.80s/it]
36%|███▋ | 658/1813 [1:12:33<1:56:55, 6.07s/it]
36%|███▋ | 659/1813 [1:12:39<1:59:48, 6.23s/it]
36%|███▋ | 660/1813 [1:12:45<1:55:52, 6.03s/it]
{'loss': '0.9016', 'grad_norm': '0.9785', 'learning_rate': '0.0001572', 'epoch': '0.3641', 'num_input_tokens_seen': 4385688, 'train_runtime': '4365', 'train_tokens_per_second': '1005'}
36%|███▋ | 660/1813 [1:12:45<1:55:52, 6.03s/it]
36%|███▋ | 661/1813 [1:12:51<1:55:29, 6.02s/it]
37%|███▋ | 662/1813 [1:12:57<1:55:42, 6.03s/it]
37%|███▋ | 663/1813 [1:13:04<2:00:04, 6.27s/it]
37%|███▋ | 664/1813 [1:13:10<2:00:18, 6.28s/it]
37%|███▋ | 665/1813 [1:13:15<1:52:13, 5.87s/it]
37%|███▋ | 666/1813 [1:13:20<1:48:38, 5.68s/it]
37%|███▋ | 667/1813 [1:13:27<1:54:13, 5.98s/it]
37%|███▋ | 668/1813 [1:13:33<1:55:57, 6.08s/it]
37%|███▋ | 669/1813 [1:13:39<1:54:54, 6.03s/it]
37%|███▋ | 670/1813 [1:13:45<1:52:39, 5.91s/it]
{'loss': '0.9796', 'grad_norm': '1.205', 'learning_rate': '0.0001557', 'epoch': '0.3697', 'num_input_tokens_seen': 4449456, 'train_runtime': '4425', 'train_tokens_per_second': '1005'}
37%|███▋ | 670/1813 [1:13:45<1:52:39, 5.91s/it]
37%|███▋ | 671/1813 [1:13:51<1:55:15, 6.06s/it]
37%|███▋ | 672/1813 [1:13:58<1:59:34, 6.29s/it]
37%|███▋ | 673/1813 [1:14:04<2:00:18, 6.33s/it]
37%|███▋ | 674/1813 [1:14:11<2:02:30, 6.45s/it]
37%|███▋ | 675/1813 [1:14:17<1:59:07, 6.28s/it]
37%|███▋ | 676/1813 [1:14:22<1:54:43, 6.05s/it]
37%|███▋ | 677/1813 [1:14:31<2:06:44, 6.69s/it]
37%|███▋ | 678/1813 [1:14:36<1:58:23, 6.26s/it]
37%|███▋ | 679/1813 [1:14:41<1:52:37, 5.96s/it]
38%|███▊ | 680/1813 [1:14:47<1:51:41, 5.92s/it]
{'loss': '0.9305', 'grad_norm': '0.9702', 'learning_rate': '0.0001541', 'epoch': '0.3752', 'num_input_tokens_seen': 4514984, 'train_runtime': '4488', 'train_tokens_per_second': '1006'}
38%|███▊ | 680/1813 [1:14:47<1:51:41, 5.92s/it]
38%|███▊ | 681/1813 [1:14:54<1:54:59, 6.10s/it]
38%|███▊ | 682/1813 [1:14:59<1:50:04, 5.84s/it]
38%|███▊ | 683/1813 [1:15:05<1:51:35, 5.93s/it]
38%|███▊ | 684/1813 [1:15:12<1:55:29, 6.14s/it]
38%|███▊ | 685/1813 [1:15:19<2:03:59, 6.60s/it]
38%|███▊ | 686/1813 [1:15:25<2:02:14, 6.51s/it]
38%|███▊ | 687/1813 [1:15:33<2:09:18, 6.89s/it]
38%|███▊ | 688/1813 [1:15:38<1:57:28, 6.27s/it]
38%|███▊ | 689/1813 [1:15:47<2:11:21, 7.01s/it]
38%|███▊ | 690/1813 [1:15:54<2:12:59, 7.11s/it]
{'loss': '0.9827', 'grad_norm': '1.091', 'learning_rate': '0.0001525', 'epoch': '0.3807', 'num_input_tokens_seen': 4587840, 'train_runtime': '4555', 'train_tokens_per_second': '1007'}
38%|███▊ | 690/1813 [1:15:54<2:12:59, 7.11s/it]
38%|███▊ | 691/1813 [1:16:00<2:04:35, 6.66s/it]
38%|███▊ | 692/1813 [1:16:06<2:01:44, 6.52s/it]
38%|███▊ | 693/1813 [1:16:11<1:55:44, 6.20s/it]
38%|███▊ | 694/1813 [1:16:18<1:56:27, 6.24s/it]
38%|███▊ | 695/1813 [1:16:24<1:56:03, 6.23s/it]
38%|███▊ | 696/1813 [1:16:32<2:05:26, 6.74s/it]
38%|███▊ | 697/1813 [1:16:37<1:54:59, 6.18s/it]
38%|███▊ | 698/1813 [1:16:42<1:51:17, 5.99s/it]
39%|███▊ | 699/1813 [1:16:49<1:56:34, 6.28s/it]
39%|███▊ | 700/1813 [1:16:56<1:58:06, 6.37s/it]
{'loss': '1.005', 'grad_norm': '1.161', 'learning_rate': '0.0001509', 'epoch': '0.3862', 'num_input_tokens_seen': 4653312, 'train_runtime': '4616', 'train_tokens_per_second': '1008'}
39%|███▊ | 700/1813 [1:16:56<1:58:06, 6.37s/it]
39%|███▊ | 701/1813 [1:17:03<2:03:10, 6.65s/it]
39%|███▊ | 702/1813 [1:17:10<2:02:09, 6.60s/it]
39%|███▉ | 703/1813 [1:17:18<2:09:53, 7.02s/it]
39%|███▉ | 704/1813 [1:17:23<2:03:17, 6.67s/it]
39%|███▉ | 705/1813 [1:17:31<2:05:32, 6.80s/it]
39%|███▉ | 706/1813 [1:17:37<2:02:29, 6.64s/it]
39%|███▉ | 707/1813 [1:17:46<2:18:27, 7.51s/it]
39%|███▉ | 708/1813 [1:17:54<2:17:23, 7.46s/it]
39%|███▉ | 709/1813 [1:18:00<2:13:24, 7.25s/it]
39%|███▉ | 710/1813 [1:18:06<2:06:04, 6.86s/it]
{'loss': '0.9653', 'grad_norm': '0.8149', 'learning_rate': '0.0001492', 'epoch': '0.3917', 'num_input_tokens_seen': 4732080, 'train_runtime': '4687', 'train_tokens_per_second': '1010'}
39%|███▉ | 710/1813 [1:18:06<2:06:04, 6.86s/it]
39%|███▉ | 711/1813 [1:18:13<2:05:32, 6.83s/it]
39%|███▉ | 712/1813 [1:18:20<2:04:29, 6.78s/it]
39%|███▉ | 713/1813 [1:18:26<1:59:38, 6.53s/it]
39%|███▉ | 714/1813 [1:18:32<1:57:03, 6.39s/it]
39%|███▉ | 715/1813 [1:18:38<1:58:01, 6.45s/it]
39%|███▉ | 716/1813 [1:18:45<2:00:40, 6.60s/it]
40%|███▉ | 717/1813 [1:18:52<1:58:36, 6.49s/it]
40%|███▉ | 718/1813 [1:18:58<1:58:45, 6.51s/it]
40%|███▉ | 719/1813 [1:19:04<1:52:28, 6.17s/it]
40%|███▉ | 720/1813 [1:19:10<1:53:18, 6.22s/it]
{'loss': '0.9908', 'grad_norm': '1.018', 'learning_rate': '0.0001476', 'epoch': '0.3972', 'num_input_tokens_seen': 4799552, 'train_runtime': '4750', 'train_tokens_per_second': '1010'}
40%|███▉ | 720/1813 [1:19:10<1:53:18, 6.22s/it]
40%|███▉ | 721/1813 [1:19:17<1:55:57, 6.37s/it]
40%|███▉ | 722/1813 [1:19:22<1:50:34, 6.08s/it]
40%|███▉ | 723/1813 [1:19:28<1:47:09, 5.90s/it]
40%|███▉ | 724/1813 [1:19:35<1:58:05, 6.51s/it]
40%|███▉ | 725/1813 [1:19:44<2:08:17, 7.07s/it]
40%|████ | 726/1813 [1:19:50<2:04:51, 6.89s/it]
40%|████ | 727/1813 [1:19:56<1:59:41, 6.61s/it]
40%|████ | 728/1813 [1:20:02<1:52:47, 6.24s/it]
40%|████ | 729/1813 [1:20:07<1:49:51, 6.08s/it]
40%|████ | 730/1813 [1:20:13<1:46:09, 5.88s/it]
{'loss': '0.9616', 'grad_norm': '1.052', 'learning_rate': '0.0001459', 'epoch': '0.4028', 'num_input_tokens_seen': 4866864, 'train_runtime': '4813', 'train_tokens_per_second': '1011'}
40%|████ | 730/1813 [1:20:13<1:46:09, 5.88s/it]
40%|████ | 731/1813 [1:20:20<1:52:27, 6.24s/it]
40%|████ | 732/1813 [1:20:26<1:53:57, 6.33s/it]
40%|████ | 733/1813 [1:20:34<2:00:14, 6.68s/it]
40%|████ | 734/1813 [1:20:41<2:01:48, 6.77s/it]
41%|████ | 735/1813 [1:20:48<2:01:39, 6.77s/it]
41%|████ | 736/1813 [1:20:54<1:56:48, 6.51s/it]
41%|████ | 737/1813 [1:21:00<1:54:00, 6.36s/it]
41%|████ | 738/1813 [1:21:05<1:48:41, 6.07s/it]
41%|████ | 739/1813 [1:21:11<1:47:26, 6.00s/it]
41%|████ | 740/1813 [1:21:17<1:51:13, 6.22s/it]
{'loss': '0.8881', 'grad_norm': '0.8816', 'learning_rate': '0.0001442', 'epoch': '0.4083', 'num_input_tokens_seen': 4936352, 'train_runtime': '4878', 'train_tokens_per_second': '1012'}
41%|████ | 740/1813 [1:21:17<1:51:13, 6.22s/it]
41%|████ | 741/1813 [1:21:24<1:53:28, 6.35s/it]
41%|████ | 742/1813 [1:21:32<1:59:42, 6.71s/it]
41%|████ | 743/1813 [1:21:39<2:03:48, 6.94s/it]
41%|████ | 744/1813 [1:21:46<2:02:49, 6.89s/it]
41%|████ | 745/1813 [1:21:53<2:04:06, 6.97s/it]
41%|████ | 746/1813 [1:21:59<2:00:14, 6.76s/it]
41%|████ | 747/1813 [1:22:07<2:06:29, 7.12s/it]
41%|████▏ | 748/1813 [1:22:13<1:57:34, 6.62s/it]
41%|████▏ | 749/1813 [1:22:19<1:55:56, 6.54s/it]
41%|████▏ | 750/1813 [1:22:25<1:51:44, 6.31s/it]
{'loss': '0.9725', 'grad_norm': '0.8841', 'learning_rate': '0.0001425', 'epoch': '0.4138', 'num_input_tokens_seen': 5011064, 'train_runtime': '4945', 'train_tokens_per_second': '1013'}
41%|████▏ | 750/1813 [1:22:25<1:51:44, 6.31s/it]
41%|████▏ | 751/1813 [1:22:31<1:50:20, 6.23s/it]
41%|████▏ | 752/1813 [1:22:37<1:48:41, 6.15s/it]
42%|████▏ | 753/1813 [1:22:43<1:50:47, 6.27s/it]
42%|████▏ | 754/1813 [1:22:52<2:02:28, 6.94s/it]
42%|████▏ | 755/1813 [1:22:57<1:51:24, 6.32s/it]
42%|████▏ | 756/1813 [1:23:02<1:46:46, 6.06s/it]
42%|████▏ | 757/1813 [1:23:08<1:45:04, 5.97s/it]
42%|████▏ | 758/1813 [1:23:15<1:48:12, 6.15s/it]
42%|████▏ | 759/1813 [1:23:22<1:52:31, 6.41s/it]
42%|████▏ | 760/1813 [1:23:28<1:49:59, 6.27s/it]
{'loss': '1.003', 'grad_norm': '1.215', 'learning_rate': '0.0001408', 'epoch': '0.4193', 'num_input_tokens_seen': 5078960, 'train_runtime': '5008', 'train_tokens_per_second': '1014'}
42%|████▏ | 760/1813 [1:23:28<1:49:59, 6.27s/it]
42%|████▏ | 761/1813 [1:23:34<1:51:58, 6.39s/it]
42%|████▏ | 762/1813 [1:23:41<1:52:59, 6.45s/it]
42%|████▏ | 763/1813 [1:23:48<1:55:42, 6.61s/it]
42%|████▏ | 764/1813 [1:23:55<1:57:09, 6.70s/it]
42%|████▏ | 765/1813 [1:24:02<2:00:54, 6.92s/it]
42%|████▏ | 766/1813 [1:24:09<1:58:48, 6.81s/it]
42%|████▏ | 767/1813 [1:24:14<1:51:27, 6.39s/it]
42%|████▏ | 768/1813 [1:24:19<1:41:20, 5.82s/it]
42%|████▏ | 769/1813 [1:24:25<1:46:15, 6.11s/it]
42%|████▏ | 770/1813 [1:24:32<1:47:15, 6.17s/it]
{'loss': '0.9154', 'grad_norm': '1.08', 'learning_rate': '0.0001391', 'epoch': '0.4248', 'num_input_tokens_seen': 5148504, 'train_runtime': '5072', 'train_tokens_per_second': '1015'}
42%|████▏ | 770/1813 [1:24:32<1:47:15, 6.17s/it]
43%|████▎ | 771/1813 [1:24:38<1:49:28, 6.30s/it]
43%|████▎ | 772/1813 [1:24:46<1:54:17, 6.59s/it]
43%|████▎ | 773/1813 [1:24:52<1:51:12, 6.42s/it]
43%|████▎ | 774/1813 [1:24:57<1:45:12, 6.08s/it]
43%|████▎ | 775/1813 [1:25:03<1:45:15, 6.08s/it]
43%|████▎ | 776/1813 [1:25:10<1:48:35, 6.28s/it]
43%|████▎ | 777/1813 [1:25:17<1:55:47, 6.71s/it]
43%|████▎ | 778/1813 [1:25:23<1:47:53, 6.25s/it]
43%|████▎ | 779/1813 [1:25:28<1:43:11, 5.99s/it]
43%|████▎ | 780/1813 [1:25:35<1:47:11, 6.23s/it]
{'loss': '0.8878', 'grad_norm': '1.062', 'learning_rate': '0.0001373', 'epoch': '0.4303', 'num_input_tokens_seen': 5215784, 'train_runtime': '5135', 'train_tokens_per_second': '1016'}
43%|████▎ | 780/1813 [1:25:35<1:47:11, 6.23s/it]
43%|████▎ | 781/1813 [1:25:42<1:49:57, 6.39s/it]
43%|████▎ | 782/1813 [1:25:50<1:58:52, 6.92s/it]
43%|████▎ | 783/1813 [1:25:57<1:59:02, 6.93s/it]
43%|████▎ | 784/1813 [1:26:03<1:53:35, 6.62s/it]
43%|████▎ | 785/1813 [1:26:10<1:56:05, 6.78s/it]
43%|████▎ | 786/1813 [1:26:17<1:58:01, 6.89s/it]
43%|████▎ | 787/1813 [1:26:22<1:48:58, 6.37s/it]
43%|████▎ | 788/1813 [1:26:27<1:43:53, 6.08s/it]
44%|████▎ | 789/1813 [1:26:32<1:38:20, 5.76s/it]
44%|████▎ | 790/1813 [1:26:38<1:37:43, 5.73s/it]
{'loss': '0.9875', 'grad_norm': '0.94', 'learning_rate': '0.0001356', 'epoch': '0.4359', 'num_input_tokens_seen': 5285160, 'train_runtime': '5199', 'train_tokens_per_second': '1017'}
44%|████▎ | 790/1813 [1:26:38<1:37:43, 5.73s/it]
44%|████▎ | 791/1813 [1:26:44<1:39:35, 5.85s/it]
44%|████▎ | 792/1813 [1:26:51<1:46:09, 6.24s/it]
44%|████▎ | 793/1813 [1:26:59<1:51:09, 6.54s/it]
44%|████▍ | 794/1813 [1:27:05<1:50:43, 6.52s/it]
44%|████▍ | 795/1813 [1:27:11<1:47:15, 6.32s/it]
44%|████▍ | 796/1813 [1:27:18<1:49:33, 6.46s/it]
44%|████▍ | 797/1813 [1:27:25<1:55:08, 6.80s/it]
44%|████▍ | 798/1813 [1:27:31<1:51:28, 6.59s/it]
44%|████▍ | 799/1813 [1:27:37<1:48:17, 6.41s/it]
44%|████▍ | 800/1813 [1:27:43<1:46:29, 6.31s/it]
{'loss': '0.9421', 'grad_norm': '0.9114', 'learning_rate': '0.0001338', 'epoch': '0.4414', 'num_input_tokens_seen': 5357720, 'train_runtime': '5264', 'train_tokens_per_second': '1018'}
44%|████▍ | 800/1813 [1:27:43<1:46:29, 6.31s/it]
44%|████▍ | 801/1813 [1:27:49<1:42:10, 6.06s/it]
44%|████▍ | 802/1813 [1:27:55<1:42:49, 6.10s/it]
44%|████▍ | 803/1813 [1:28:03<1:52:26, 6.68s/it]
44%|████▍ | 804/1813 [1:28:10<1:50:42, 6.58s/it]
44%|████▍ | 805/1813 [1:28:16<1:47:39, 6.41s/it]
44%|████▍ | 806/1813 [1:28:22<1:46:15, 6.33s/it]
45%|████▍ | 807/1813 [1:28:27<1:42:40, 6.12s/it]
45%|████▍ | 808/1813 [1:28:35<1:51:00, 6.63s/it]
45%|████▍ | 809/1813 [1:28:42<1:52:03, 6.70s/it]
45%|████▍ | 810/1813 [1:28:50<1:57:15, 7.01s/it]
{'loss': '0.9589', 'grad_norm': '0.8725', 'learning_rate': '0.000132', 'epoch': '0.4469', 'num_input_tokens_seen': 5430288, 'train_runtime': '5330', 'train_tokens_per_second': '1019'}
45%|████▍ | 810/1813 [1:28:50<1:57:15, 7.01s/it]
45%|████▍ | 811/1813 [1:28:57<1:55:47, 6.93s/it]
45%|████▍ | 812/1813 [1:29:02<1:49:40, 6.57s/it]
45%|████▍ | 813/1813 [1:29:08<1:43:53, 6.23s/it]
45%|████▍ | 814/1813 [1:29:14<1:43:25, 6.21s/it]
45%|████▍ | 815/1813 [1:29:19<1:35:45, 5.76s/it]
45%|████▌ | 816/1813 [1:29:25<1:40:30, 6.05s/it]
45%|████▌ | 817/1813 [1:29:31<1:38:46, 5.95s/it]
45%|████▌ | 818/1813 [1:29:38<1:45:24, 6.36s/it]
45%|████▌ | 819/1813 [1:29:45<1:46:08, 6.41s/it]
45%|████▌ | 820/1813 [1:29:52<1:50:58, 6.71s/it]
{'loss': '0.8875', 'grad_norm': '0.9094', 'learning_rate': '0.0001302', 'epoch': '0.4524', 'num_input_tokens_seen': 5497552, 'train_runtime': '5393', 'train_tokens_per_second': '1019'}
45%|████▌ | 820/1813 [1:29:52<1:50:58, 6.71s/it]
45%|████▌ | 821/1813 [1:29:59<1:49:50, 6.64s/it]
45%|████▌ | 822/1813 [1:30:04<1:40:50, 6.11s/it]
45%|████▌ | 823/1813 [1:30:08<1:34:15, 5.71s/it]
45%|████▌ | 824/1813 [1:30:15<1:37:36, 5.92s/it]
46%|████▌ | 825/1813 [1:30:21<1:39:34, 6.05s/it]
46%|████▌ | 826/1813 [1:30:28<1:43:31, 6.29s/it]
46%|████▌ | 827/1813 [1:30:34<1:40:52, 6.14s/it]
46%|████▌ | 828/1813 [1:30:40<1:39:39, 6.07s/it]
46%|████▌ | 829/1813 [1:30:45<1:37:51, 5.97s/it]
46%|████▌ | 830/1813 [1:30:53<1:44:55, 6.40s/it]
{'loss': '0.7936', 'grad_norm': '0.8778', 'learning_rate': '0.0001284', 'epoch': '0.4579', 'num_input_tokens_seen': 5563144, 'train_runtime': '5453', 'train_tokens_per_second': '1020'}
46%|████▌ | 830/1813 [1:30:53<1:44:55, 6.40s/it]
46%|████▌ | 831/1813 [1:30:59<1:43:57, 6.35s/it]
46%|████▌ | 832/1813 [1:31:06<1:49:02, 6.67s/it]
46%|████▌ | 833/1813 [1:31:13<1:47:24, 6.58s/it]
46%|████▌ | 834/1813 [1:31:19<1:47:21, 6.58s/it]
46%|████▌ | 835/1813 [1:31:25<1:44:19, 6.40s/it]
46%|████▌ | 836/1813 [1:31:32<1:46:46, 6.56s/it]
46%|████▌ | 837/1813 [1:31:40<1:52:58, 6.95s/it]
46%|████▌ | 838/1813 [1:31:46<1:48:00, 6.65s/it]
46%|████▋ | 839/1813 [1:31:52<1:45:41, 6.51s/it]
46%|████▋ | 840/1813 [1:31:58<1:42:24, 6.31s/it]
{'loss': '0.9675', 'grad_norm': '1.183', 'learning_rate': '0.0001266', 'epoch': '0.4634', 'num_input_tokens_seen': 5634104, 'train_runtime': '5519', 'train_tokens_per_second': '1021'}
46%|████▋ | 840/1813 [1:31:58<1:42:24, 6.31s/it]
46%|████▋ | 841/1813 [1:32:04<1:40:32, 6.21s/it]
46%|████▋ | 842/1813 [1:32:11<1:43:36, 6.40s/it]
46%|████▋ | 843/1813 [1:32:17<1:42:14, 6.32s/it]
47%|████▋ | 844/1813 [1:32:23<1:39:16, 6.15s/it]
47%|████▋ | 845/1813 [1:32:29<1:40:18, 6.22s/it]
47%|████▋ | 846/1813 [1:32:36<1:42:48, 6.38s/it]
47%|████▋ | 847/1813 [1:32:43<1:46:06, 6.59s/it]
47%|████▋ | 848/1813 [1:32:50<1:49:50, 6.83s/it]
47%|████▋ | 849/1813 [1:32:56<1:43:00, 6.41s/it]
47%|████▋ | 850/1813 [1:33:04<1:52:25, 7.00s/it]
{'loss': '0.922', 'grad_norm': '0.8316', 'learning_rate': '0.0001248', 'epoch': '0.469', 'num_input_tokens_seen': 5704744, 'train_runtime': '5585', 'train_tokens_per_second': '1021'}
47%|████▋ | 850/1813 [1:33:04<1:52:25, 7.00s/it]
47%|████▋ | 851/1813 [1:33:11<1:51:24, 6.95s/it]
47%|████▋ | 852/1813 [1:33:16<1:41:57, 6.37s/it]
47%|████▋ | 853/1813 [1:33:22<1:41:18, 6.33s/it]
47%|████▋ | 854/1813 [1:33:29<1:44:23, 6.53s/it]
47%|████▋ | 855/1813 [1:33:36<1:42:30, 6.42s/it]
47%|████▋ | 856/1813 [1:33:42<1:41:07, 6.34s/it]
47%|████▋ | 857/1813 [1:33:47<1:35:34, 6.00s/it]
47%|████▋ | 858/1813 [1:33:51<1:25:05, 5.35s/it]
47%|████▋ | 859/1813 [1:33:57<1:28:40, 5.58s/it]
47%|████▋ | 860/1813 [1:34:03<1:32:48, 5.84s/it]
{'loss': '0.9451', 'grad_norm': '1.165', 'learning_rate': '0.0001229', 'epoch': '0.4745', 'num_input_tokens_seen': 5766424, 'train_runtime': '5644', 'train_tokens_per_second': '1022'}
47%|████▋ | 860/1813 [1:34:03<1:32:48, 5.84s/it]
47%|████▋ | 861/1813 [1:34:09<1:30:01, 5.67s/it]
48%|████▊ | 862/1813 [1:34:15<1:35:44, 6.04s/it]
48%|████▊ | 863/1813 [1:34:22<1:36:57, 6.12s/it]
48%|████▊ | 864/1813 [1:34:26<1:29:07, 5.63s/it]
48%|████▊ | 865/1813 [1:34:33<1:35:33, 6.05s/it]
48%|████▊ | 866/1813 [1:34:39<1:35:32, 6.05s/it]
48%|████▊ | 867/1813 [1:34:45<1:33:29, 5.93s/it]
48%|████▊ | 868/1813 [1:34:51<1:31:38, 5.82s/it]
48%|████▊ | 869/1813 [1:34:58<1:38:43, 6.28s/it]
48%|████▊ | 870/1813 [1:35:06<1:45:51, 6.73s/it]
{'loss': '0.9045', 'grad_norm': '0.8641', 'learning_rate': '0.0001211', 'epoch': '0.48', 'num_input_tokens_seen': 5831352, 'train_runtime': '5706', 'train_tokens_per_second': '1022'}
48%|████▊ | 870/1813 [1:35:06<1:45:51, 6.73s/it]
48%|████▊ | 871/1813 [1:35:11<1:39:57, 6.37s/it]
48%|████▊ | 872/1813 [1:35:19<1:44:40, 6.67s/it]
48%|████▊ | 873/1813 [1:35:25<1:44:30, 6.67s/it]
48%|████▊ | 874/1813 [1:35:33<1:48:36, 6.94s/it]
48%|████▊ | 875/1813 [1:35:41<1:52:54, 7.22s/it]
48%|████▊ | 876/1813 [1:35:48<1:51:38, 7.15s/it]
48%|████▊ | 877/1813 [1:35:56<1:55:35, 7.41s/it]
48%|████▊ | 878/1813 [1:36:02<1:51:23, 7.15s/it]
48%|████▊ | 879/1813 [1:36:10<1:52:59, 7.26s/it]
49%|████▊ | 880/1813 [1:36:14<1:41:02, 6.50s/it]
{'loss': '0.9384', 'grad_norm': '1.411', 'learning_rate': '0.0001192', 'epoch': '0.4855', 'num_input_tokens_seen': 5907208, 'train_runtime': '5775', 'train_tokens_per_second': '1023'}
49%|████▊ | 880/1813 [1:36:14<1:41:02, 6.50s/it]
49%|████▊ | 881/1813 [1:36:20<1:36:25, 6.21s/it]
49%|████▊ | 882/1813 [1:36:26<1:36:32, 6.22s/it]
49%|████▊ | 883/1813 [1:36:33<1:39:20, 6.41s/it]
49%|████▉ | 884/1813 [1:36:39<1:38:21, 6.35s/it]
49%|████▉ | 885/1813 [1:36:45<1:37:20, 6.29s/it]
49%|████▉ | 886/1813 [1:36:52<1:38:06, 6.35s/it]
49%|████▉ | 887/1813 [1:37:00<1:45:43, 6.85s/it]
49%|████▉ | 888/1813 [1:37:07<1:45:11, 6.82s/it]
49%|████▉ | 889/1813 [1:37:14<1:47:27, 6.98s/it]
49%|████▉ | 890/1813 [1:37:20<1:44:21, 6.78s/it]
{'loss': '0.9001', 'grad_norm': '0.9493', 'learning_rate': '0.0001174', 'epoch': '0.491', 'num_input_tokens_seen': 5978048, 'train_runtime': '5841', 'train_tokens_per_second': '1023'}
49%|████▉ | 890/1813 [1:37:20<1:44:21, 6.78s/it]
49%|████▉ | 891/1813 [1:37:27<1:41:02, 6.58s/it]
49%|████▉ | 892/1813 [1:37:34<1:45:15, 6.86s/it]
49%|████▉ | 893/1813 [1:37:40<1:42:14, 6.67s/it]
49%|████▉ | 894/1813 [1:37:46<1:37:46, 6.38s/it]
49%|████▉ | 895/1813 [1:37:53<1:42:45, 6.72s/it]
49%|████▉ | 896/1813 [1:37:59<1:36:36, 6.32s/it]
49%|████▉ | 897/1813 [1:38:05<1:34:23, 6.18s/it]
50%|████▉ | 898/1813 [1:38:12<1:38:26, 6.46s/it]
50%|████▉ | 899/1813 [1:38:19<1:42:05, 6.70s/it]
50%|████▉ | 900/1813 [1:38:27<1:47:00, 7.03s/it]
{'loss': '0.9884', 'grad_norm': '1.043', 'learning_rate': '0.0001155', 'epoch': '0.4966', 'num_input_tokens_seen': 6050856, 'train_runtime': '5907', 'train_tokens_per_second': '1024'}
50%|████▉ | 900/1813 [1:38:27<1:47:00, 7.03s/it]
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:03, 15.68it/s]
0%| | 5/1000 [00:00<02:17, 7.21it/s]
1%| | 7/1000 [00:00<01:59, 8.30it/s]
1%| | 9/1000 [00:01<02:33, 6.45it/s]
1%| | 11/1000 [00:01<02:02, 8.05it/s]
1%|▏ | 13/1000 [00:01<02:21, 6.99it/s]
1%|▏ | 14/1000 [00:01<02:24, 6.82it/s]
2%|▏ | 15/1000 [00:02<02:45, 5.96it/s]
2%|▏ | 16/1000 [00:02<02:52, 5.71it/s]
2%|▏ | 18/1000 [00:02<02:42, 6.04it/s]
2%|▏ | 19/1000 [00:02<03:10, 5.14it/s]
2%|▏ | 20/1000 [00:03<03:33, 4.59it/s]
2%|▏ | 22/1000 [00:03<02:36, 6.23it/s]
2%|▏ | 23/1000 [00:03<02:54, 5.58it/s]
2%|▎ | 25/1000 [00:03<02:12, 7.35it/s]
3%|▎ | 26/1000 [00:04<02:35, 6.25it/s]
3%|▎ | 28/1000 [00:04<02:42, 5.98it/s]
3%|▎ | 29/1000 [00:04<02:32, 6.35it/s]
3%|▎ | 30/1000 [00:04<02:42, 5.97it/s]
3%|▎ | 31/1000 [00:04<03:01, 5.34it/s]
3%|▎ | 32/1000 [00:05<02:41, 5.98it/s]
3%|▎ | 33/1000 [00:05<02:48, 5.74it/s]
4%|▎ | 35/1000 [00:05<02:06, 7.65it/s]
4%|▎ | 37/1000 [00:05<01:45, 9.10it/s]
4%|▍ | 39/1000 [00:05<02:06, 7.58it/s]
4%|▍ | 40/1000 [00:06<02:04, 7.74it/s]
4%|▍ | 42/1000 [00:06<01:45, 9.09it/s]
4%|▍ | 44/1000 [00:06<01:32, 10.30it/s]
5%|▍ | 46/1000 [00:06<01:45, 9.03it/s]
5%|▍ | 47/1000 [00:06<02:09, 7.36it/s]
5%|▍ | 49/1000 [00:06<01:48, 8.73it/s]
5%|▌ | 51/1000 [00:07<01:35, 9.89it/s]
5%|▌ | 53/1000 [00:07<01:26, 10.91it/s]
6%|▌ | 55/1000 [00:07<01:28, 10.72it/s]
6%|▌ | 57/1000 [00:07<01:43, 9.15it/s]
6%|▌ | 59/1000 [00:08<01:55, 8.12it/s]
6%|▌ | 61/1000 [00:08<01:41, 9.26it/s]
6%|▋ | 63/1000 [00:08<01:36, 9.68it/s]
6%|▋ | 65/1000 [00:08<01:52, 8.32it/s]
7%|▋ | 67/1000 [00:09<02:03, 7.55it/s]
7%|▋ | 69/1000 [00:09<01:53, 8.23it/s]
7%|▋ | 70/1000 [00:09<02:13, 6.97it/s]
7%|▋ | 72/1000 [00:09<02:18, 6.70it/s]
7%|▋ | 74/1000 [00:09<01:54, 8.10it/s]
8%|▊ | 75/1000 [00:10<02:15, 6.85it/s]
8%|▊ | 76/1000 [00:10<02:18, 6.65it/s]
8%|▊ | 78/1000 [00:10<02:26, 6.31it/s]
8%|▊ | 80/1000 [00:10<01:57, 7.84it/s]
8%|▊ | 82/1000 [00:10<01:39, 9.19it/s]
8%|▊ | 84/1000 [00:11<01:54, 8.00it/s]
8%|▊ | 85/1000 [00:11<02:14, 6.78it/s]
9%|▊ | 86/1000 [00:11<02:33, 5.94it/s]
9%|▊ | 87/1000 [00:12<02:49, 5.38it/s]
9%|▉ | 89/1000 [00:12<02:10, 6.99it/s]
9%|▉ | 90/1000 [00:12<02:05, 7.23it/s]
9%|▉ | 91/1000 [00:12<02:29, 6.07it/s]
9%|▉ | 92/1000 [00:12<02:27, 6.16it/s]
9%|▉ | 93/1000 [00:12<02:36, 5.78it/s]
10%|▉ | 95/1000 [00:13<02:43, 5.52it/s]
10%|▉ | 97/1000 [00:13<02:13, 6.77it/s]
10%|▉ | 99/1000 [00:13<01:47, 8.34it/s]
10%|█ | 101/1000 [00:13<01:33, 9.62it/s]
10%|█ | 103/1000 [00:14<01:55, 7.74it/s]
10%|█ | 104/1000 [00:14<01:54, 7.80it/s]
11%|█ | 106/1000 [00:14<01:36, 9.30it/s]
11%|█ | 108/1000 [00:14<01:25, 10.44it/s]
11%|█ | 110/1000 [00:14<01:19, 11.19it/s]
11%|█ | 112/1000 [00:14<01:14, 11.91it/s]
11%|█▏ | 114/1000 [00:14<01:11, 12.41it/s]
12%|█▏ | 116/1000 [00:15<01:09, 12.73it/s]
12%|█▏ | 118/1000 [00:15<01:06, 13.18it/s]
12%|█▏ | 120/1000 [00:15<02:07, 6.90it/s]
12%|█▏ | 122/1000 [00:16<01:48, 8.07it/s]
12%|█▏ | 124/1000 [00:16<01:58, 7.42it/s]
12%|█▎ | 125/1000 [00:16<02:33, 5.71it/s]
13%|█▎ | 126/1000 [00:16<02:22, 6.13it/s]
13%|█▎ | 127/1000 [00:17<02:30, 5.78it/s]
13%|█▎ | 128/1000 [00:17<02:45, 5.27it/s]
13%|█▎ | 130/1000 [00:17<02:02, 7.08it/s]
13%|█▎ | 132/1000 [00:17<01:39, 8.70it/s]
13%|█▎ | 134/1000 [00:17<01:25, 10.11it/s]
14%|█▎ | 136/1000 [00:17<01:29, 9.62it/s]
14%|█▍ | 138/1000 [00:18<01:27, 9.88it/s]
14%|█▍ | 140/1000 [00:18<01:26, 9.93it/s]
14%|█▍ | 142/1000 [00:18<01:35, 9.01it/s]
14%|█▍ | 143/1000 [00:18<01:36, 8.88it/s]
14%|█▍ | 145/1000 [00:18<01:24, 10.07it/s]
15%|█▍ | 147/1000 [00:19<01:41, 8.43it/s]
15%|█▍ | 148/1000 [00:19<01:40, 8.47it/s]
15%|█▌ | 150/1000 [00:19<01:25, 9.89it/s]
15%|█▌ | 152/1000 [00:19<01:17, 11.01it/s]
15%|█▌ | 154/1000 [00:19<01:21, 10.36it/s]
16%|█▌ | 156/1000 [00:20<02:07, 6.63it/s]
16%|█▌ | 158/1000 [00:20<01:46, 7.94it/s]
16%|█▌ | 160/1000 [00:20<01:37, 8.58it/s]
16%|█▌ | 162/1000 [00:20<01:47, 7.80it/s]
16%|█▋ | 163/1000 [00:21<01:51, 7.48it/s]
16%|█▋ | 164/1000 [00:21<02:10, 6.39it/s]
16%|█▋ | 165/1000 [00:21<02:27, 5.66it/s]
17%|█▋ | 166/1000 [00:21<02:41, 5.17it/s]
17%|█▋ | 167/1000 [00:21<02:24, 5.77it/s]
17%|█▋ | 169/1000 [00:22<01:46, 7.83it/s]
17%|█▋ | 171/1000 [00:22<01:56, 7.13it/s]
17%|█▋ | 172/1000 [00:22<02:15, 6.13it/s]
17%|█▋ | 173/1000 [00:22<02:13, 6.21it/s]
17%|█▋ | 174/1000 [00:22<02:02, 6.73it/s]
18%|█▊ | 176/1000 [00:23<01:37, 8.45it/s]
18%|█▊ | 177/1000 [00:23<02:01, 6.80it/s]
18%|█▊ | 179/1000 [00:23<01:36, 8.55it/s]
18%|█▊ | 180/1000 [00:23<01:36, 8.47it/s]
18%|█▊ | 181/1000 [00:23<02:01, 6.74it/s]
18%|█▊ | 182/1000 [00:24<02:23, 5.71it/s]
18%|█▊ | 183/1000 [00:24<02:21, 5.79it/s]
18%|█▊ | 185/1000 [00:24<01:45, 7.74it/s]
19%|█▊ | 186/1000 [00:24<01:43, 7.88it/s]
19%|█▊ | 187/1000 [00:24<02:07, 6.37it/s]
19%|█▉ | 189/1000 [00:24<01:40, 8.10it/s]
19%|█▉ | 190/1000 [00:25<02:02, 6.63it/s]
19%|█▉ | 192/1000 [00:25<02:04, 6.48it/s]
19%|█▉ | 194/1000 [00:25<02:06, 6.37it/s]
20%|█▉ | 196/1000 [00:25<01:43, 7.74it/s]
20%|█▉ | 198/1000 [00:26<01:27, 9.18it/s]
20%|██ | 200/1000 [00:26<01:15, 10.67it/s]
20%|██ | 202/1000 [00:26<01:30, 8.77it/s]
20%|██ | 204/1000 [00:26<01:32, 8.63it/s]
21%|██ | 206/1000 [00:26<01:20, 9.88it/s]
21%|██ | 208/1000 [00:27<01:33, 8.48it/s]
21%|██ | 210/1000 [00:27<01:33, 8.46it/s]
21%|██ | 212/1000 [00:27<01:21, 9.66it/s]
21%|██▏ | 214/1000 [00:27<01:30, 8.71it/s]
22%|██▏ | 216/1000 [00:28<01:25, 9.12it/s]
22%|██▏ | 217/1000 [00:28<01:44, 7.49it/s]
22%|██▏ | 219/1000 [00:28<01:29, 8.77it/s]
22%|██▏ | 220/1000 [00:28<02:03, 6.30it/s]
22%|██▏ | 221/1000 [00:28<02:04, 6.28it/s]
22%|██▏ | 223/1000 [00:29<02:20, 5.55it/s]
22%|██▏ | 224/1000 [00:29<02:08, 6.04it/s]
22%|██▎ | 225/1000 [00:29<02:07, 6.09it/s]
23%|██▎ | 226/1000 [00:29<02:23, 5.40it/s]
23%|██▎ | 228/1000 [00:30<01:53, 6.79it/s]
23%|██▎ | 229/1000 [00:30<02:10, 5.89it/s]
23%|██▎ | 230/1000 [00:30<02:01, 6.35it/s]
23%|██▎ | 232/1000 [00:30<01:37, 7.91it/s]
23%|██▎ | 233/1000 [00:30<01:34, 8.10it/s]
24%|██▎ | 235/1000 [00:30<01:18, 9.79it/s]
24%|██▎ | 237/1000 [00:31<01:21, 9.35it/s]
24%|██▍ | 239/1000 [00:31<01:25, 8.90it/s]
24%|██▍ | 241/1000 [00:31<01:31, 8.31it/s]
24%|██▍ | 242/1000 [00:32<02:06, 5.99it/s]
24%|██▍ | 243/1000 [00:32<02:18, 5.45it/s]
24%|██▍ | 245/1000 [00:32<01:53, 6.63it/s]
25%|██▍ | 247/1000 [00:32<01:31, 8.22it/s]
25%|██▍ | 248/1000 [00:32<01:50, 6.83it/s]
25%|██▍ | 249/1000 [00:33<02:06, 5.95it/s]
25%|██▌ | 250/1000 [00:33<02:08, 5.86it/s]
25%|██▌ | 252/1000 [00:33<02:04, 6.01it/s]
25%|██▌ | 253/1000 [00:33<02:10, 5.73it/s]
26%|██▌ | 255/1000 [00:33<01:41, 7.35it/s]
26%|██▌ | 256/1000 [00:34<01:36, 7.68it/s]
26%|██▌ | 258/1000 [00:34<01:25, 8.72it/s]
26%|██▌ | 260/1000 [00:34<01:36, 7.67it/s]
26%|██▌ | 261/1000 [00:34<01:53, 6.51it/s]
26%|██▌ | 262/1000 [00:34<01:55, 6.42it/s]
26%|██▋ | 264/1000 [00:35<01:56, 6.32it/s]
26%|██▋ | 265/1000 [00:35<01:51, 6.58it/s]
27%|██▋ | 266/1000 [00:35<01:46, 6.90it/s]
27%|██▋ | 268/1000 [00:35<01:37, 7.52it/s]
27%|██▋ | 270/1000 [00:36<01:43, 7.02it/s]
27%|██▋ | 271/1000 [00:36<02:14, 5.43it/s]
27%|██▋ | 273/1000 [00:36<02:07, 5.69it/s]
28%|██▊ | 275/1000 [00:36<01:48, 6.69it/s]
28%|██▊ | 277/1000 [00:37<01:29, 8.06it/s]
28%|██▊ | 278/1000 [00:37<01:46, 6.81it/s]
28%|██▊ | 280/1000 [00:37<01:48, 6.61it/s]
28%|██▊ | 282/1000 [00:37<01:29, 8.01it/s]
28%|██▊ | 283/1000 [00:38<02:02, 5.85it/s]
28%|██▊ | 284/1000 [00:38<02:05, 5.71it/s]
29%|██▊ | 286/1000 [00:38<01:36, 7.42it/s]
29%|██▉ | 288/1000 [00:38<01:21, 8.70it/s]
29%|██▉ | 290/1000 [00:38<01:31, 7.74it/s]
29%|██▉ | 291/1000 [00:39<01:41, 6.98it/s]
29%|██▉ | 292/1000 [00:39<01:56, 6.07it/s]
29%|██▉ | 294/1000 [00:39<01:38, 7.18it/s]
30%|██▉ | 296/1000 [00:39<01:42, 6.88it/s]
30%|██▉ | 298/1000 [00:40<01:26, 8.11it/s]
30%|██▉ | 299/1000 [00:40<01:49, 6.43it/s]
30%|███ | 300/1000 [00:40<01:42, 6.82it/s]
30%|███ | 301/1000 [00:40<01:38, 7.10it/s]
30%|███ | 303/1000 [00:40<01:19, 8.76it/s]
30%|███ | 304/1000 [00:40<01:26, 8.07it/s]
30%|███ | 305/1000 [00:41<01:25, 8.11it/s]
31%|███ | 306/1000 [00:41<01:40, 6.93it/s]
31%|███ | 307/1000 [00:41<01:42, 6.78it/s]
31%|███ | 309/1000 [00:41<01:20, 8.57it/s]
31%|███ | 311/1000 [00:41<01:08, 10.04it/s]
31%|███▏ | 313/1000 [00:41<01:01, 11.14it/s]
32%|███▏ | 315/1000 [00:42<01:07, 10.13it/s]
32%|███▏ | 317/1000 [00:42<01:11, 9.50it/s]
32%|███▏ | 319/1000 [00:42<01:34, 7.21it/s]
32%|███▏ | 321/1000 [00:43<01:38, 6.86it/s]
32%|███▏ | 322/1000 [00:43<01:45, 6.41it/s]
32%|███▏ | 324/1000 [00:43<01:27, 7.72it/s]
32%|███▎ | 325/1000 [00:43<01:58, 5.69it/s]
33%|███▎ | 327/1000 [00:43<01:31, 7.39it/s]
33%|███▎ | 328/1000 [00:44<01:33, 7.15it/s]
33%|███▎ | 330/1000 [00:44<01:38, 6.77it/s]
33%|███▎ | 332/1000 [00:44<01:41, 6.57it/s]
33%|███▎ | 333/1000 [00:44<01:36, 6.94it/s]
33%|███▎ | 334/1000 [00:44<01:44, 6.37it/s]
34%|███▎ | 336/1000 [00:45<01:22, 8.03it/s]
34%|███▍ | 338/1000 [00:45<01:15, 8.80it/s]
34%|███▍ | 340/1000 [00:45<01:05, 10.00it/s]
34%|███▍ | 342/1000 [00:45<01:00, 10.85it/s]
34%|███▍ | 344/1000 [00:46<01:26, 7.59it/s]
34%|███▍ | 345/1000 [00:46<01:25, 7.69it/s]
35%|███▍ | 346/1000 [00:46<01:30, 7.20it/s]
35%|███▍ | 347/1000 [00:46<01:28, 7.40it/s]
35%|███▍ | 349/1000 [00:46<01:34, 6.91it/s]
35%|███▌ | 350/1000 [00:47<01:49, 5.95it/s]
35%|███▌ | 352/1000 [00:47<01:24, 7.63it/s]
35%|███▌ | 354/1000 [00:47<01:25, 7.54it/s]
36%|███▌ | 355/1000 [00:47<01:27, 7.35it/s]
36%|███▌ | 357/1000 [00:47<01:11, 8.94it/s]
36%|███▌ | 359/1000 [00:47<01:00, 10.56it/s]
36%|███▌ | 361/1000 [00:48<01:07, 9.40it/s]
36%|███▋ | 363/1000 [00:48<01:28, 7.17it/s]
36%|███▋ | 364/1000 [00:48<01:41, 6.27it/s]
36%|███▋ | 365/1000 [00:49<02:09, 4.92it/s]
37%|███▋ | 367/1000 [00:49<01:58, 5.36it/s]
37%|███▋ | 368/1000 [00:49<02:05, 5.02it/s]
37%|███▋ | 369/1000 [00:49<01:52, 5.59it/s]
37%|███▋ | 371/1000 [00:49<01:23, 7.51it/s]
37%|███▋ | 372/1000 [00:50<01:21, 7.69it/s]
37%|███▋ | 374/1000 [00:50<01:17, 8.06it/s]
38%|███▊ | 375/1000 [00:50<01:40, 6.21it/s]
38%|███▊ | 376/1000 [00:50<01:54, 5.47it/s]
38%|███▊ | 378/1000 [00:51<01:29, 6.91it/s]
38%|███▊ | 380/1000 [00:51<01:10, 8.75it/s]
38%|███▊ | 382/1000 [00:51<01:18, 7.89it/s]
38%|███▊ | 384/1000 [00:51<01:07, 9.19it/s]
39%|███▊ | 386/1000 [00:51<01:06, 9.17it/s]
39%|███▉ | 388/1000 [00:52<01:25, 7.13it/s]
39%|███▉ | 390/1000 [00:52<01:19, 7.64it/s]
39%|███▉ | 391/1000 [00:52<01:22, 7.37it/s]
39%|███▉ | 393/1000 [00:52<01:09, 8.79it/s]
40%|███▉ | 395/1000 [00:53<01:21, 7.46it/s]
40%|███▉ | 397/1000 [00:53<01:09, 8.73it/s]
40%|███▉ | 399/1000 [00:53<01:36, 6.23it/s]
40%|████ | 400/1000 [00:54<01:45, 5.68it/s]
40%|████ | 402/1000 [00:54<01:41, 5.91it/s]
40%|████ | 404/1000 [00:54<01:22, 7.23it/s]
41%|████ | 406/1000 [00:54<01:09, 8.49it/s]
41%|████ | 408/1000 [00:55<01:32, 6.39it/s]
41%|████ | 410/1000 [00:55<01:31, 6.44it/s]
41%|████ | 411/1000 [00:55<01:40, 5.83it/s]
41%|████ | 412/1000 [00:55<01:49, 5.36it/s]
41%|████▏ | 414/1000 [00:56<01:23, 7.05it/s]
42%|████▏ | 416/1000 [00:56<01:25, 6.80it/s]
42%|████▏ | 418/1000 [00:56<01:10, 8.25it/s]
42%|████▏ | 420/1000 [00:56<01:08, 8.45it/s]
42%|████▏ | 421/1000 [00:56<01:17, 7.49it/s]
42%|████▏ | 423/1000 [00:57<01:26, 6.67it/s]
42%|████▏ | 424/1000 [00:57<01:37, 5.92it/s]
42%|████▎ | 425/1000 [00:57<01:30, 6.36it/s]
43%|████▎ | 427/1000 [00:57<01:12, 7.94it/s]
43%|████▎ | 428/1000 [00:57<01:15, 7.53it/s]
43%|████▎ | 429/1000 [00:58<01:12, 7.83it/s]
43%|████▎ | 431/1000 [00:58<00:59, 9.53it/s]
43%|████▎ | 433/1000 [00:58<00:51, 11.00it/s]
44%|████▎ | 435/1000 [00:58<00:47, 11.77it/s]
44%|████▎ | 437/1000 [00:58<00:53, 10.48it/s]
44%|████▍ | 439/1000 [00:59<01:09, 8.06it/s]
44%|████▍ | 441/1000 [00:59<01:00, 9.27it/s]
44%|████▍ | 443/1000 [00:59<01:08, 8.09it/s]
44%|████▍ | 444/1000 [00:59<01:16, 7.24it/s]
45%|████▍ | 446/1000 [00:59<01:03, 8.72it/s]
45%|████▍ | 448/1000 [01:00<01:13, 7.47it/s]
45%|████▌ | 450/1000 [01:00<01:18, 7.01it/s]
45%|████▌ | 451/1000 [01:00<01:28, 6.18it/s]
45%|████▌ | 452/1000 [01:01<01:38, 5.58it/s]
45%|████▌ | 454/1000 [01:01<01:16, 7.18it/s]
46%|████▌ | 456/1000 [01:01<01:04, 8.50it/s]
46%|████▌ | 457/1000 [01:01<01:09, 7.80it/s]
46%|████▌ | 459/1000 [01:01<00:58, 9.22it/s]
46%|████▌ | 461/1000 [01:01<00:49, 10.79it/s]
46%|████▋ | 463/1000 [01:02<01:10, 7.62it/s]
46%|████▋ | 465/1000 [01:02<01:19, 6.74it/s]
47%|████▋ | 466/1000 [01:02<01:28, 6.00it/s]
47%|████▋ | 467/1000 [01:03<01:50, 4.82it/s]
47%|████▋ | 469/1000 [01:03<01:24, 6.30it/s]
47%|████▋ | 471/1000 [01:03<01:07, 7.85it/s]
47%|████▋ | 473/1000 [01:03<01:09, 7.56it/s]
47%|████▋ | 474/1000 [01:04<01:21, 6.49it/s]
48%|████▊ | 476/1000 [01:04<01:22, 6.38it/s]
48%|████▊ | 477/1000 [01:04<01:35, 5.49it/s]
48%|████▊ | 479/1000 [01:04<01:12, 7.14it/s]
48%|████▊ | 480/1000 [01:04<01:19, 6.57it/s]
48%|████▊ | 482/1000 [01:05<01:04, 8.04it/s]
48%|████▊ | 484/1000 [01:05<01:10, 7.31it/s]
48%|████▊ | 485/1000 [01:05<01:21, 6.32it/s]
49%|████▊ | 486/1000 [01:05<01:21, 6.30it/s]
49%|████▉ | 488/1000 [01:05<01:04, 7.99it/s]
49%|████▉ | 489/1000 [01:06<01:17, 6.63it/s]
49%|████▉ | 491/1000 [01:06<01:02, 8.20it/s]
49%|████▉ | 492/1000 [01:06<01:01, 8.27it/s]
49%|████▉ | 494/1000 [01:06<00:50, 9.97it/s]
50%|████▉ | 496/1000 [01:06<01:00, 8.40it/s]
50%|████▉ | 498/1000 [01:07<00:59, 8.42it/s]
50%|████▉ | 499/1000 [01:07<01:15, 6.65it/s]
50%|█████ | 500/1000 [01:07<01:24, 5.93it/s]
50%|█████ | 502/1000 [01:07<01:06, 7.54it/s]
50%|█████ | 503/1000 [01:08<01:13, 6.80it/s]
50%|█████ | 505/1000 [01:08<01:15, 6.55it/s]
51%|█████ | 506/1000 [01:08<01:25, 5.80it/s]
51%|█████ | 508/1000 [01:08<01:06, 7.43it/s]
51%|█████ | 510/1000 [01:08<00:55, 8.84it/s]
51%|█████ | 512/1000 [01:09<00:49, 9.87it/s]
51%|█████▏ | 514/1000 [01:09<01:07, 7.25it/s]
52%|█████▏ | 515/1000 [01:09<01:04, 7.50it/s]
52%|█████▏ | 516/1000 [01:09<01:08, 7.08it/s]
52%|█████▏ | 518/1000 [01:09<00:59, 8.04it/s]
52%|█████▏ | 519/1000 [01:10<01:15, 6.37it/s]
52%|█████▏ | 521/1000 [01:10<00:59, 8.02it/s]
52%|█████▏ | 522/1000 [01:10<01:11, 6.67it/s]
52%|█████▏ | 523/1000 [01:10<01:22, 5.80it/s]
52%|█████▏ | 524/1000 [01:11<01:25, 5.56it/s]
53%|█████▎ | 526/1000 [01:11<01:11, 6.59it/s]
53%|█████▎ | 528/1000 [01:11<01:12, 6.54it/s]
53%|█████▎ | 529/1000 [01:11<01:13, 6.39it/s]
53%|█████▎ | 531/1000 [01:11<00:57, 8.12it/s]
53%|█████▎ | 533/1000 [01:12<00:48, 9.68it/s]
54%|█████▎ | 535/1000 [01:12<01:09, 6.69it/s]
54%|█████▎ | 536/1000 [01:12<01:12, 6.36it/s]
54%|█████▎ | 537/1000 [01:12<01:21, 5.65it/s]
54%|█████▍ | 539/1000 [01:13<01:17, 5.93it/s]
54%|█████▍ | 540/1000 [01:13<01:19, 5.76it/s]
54%|█████▍ | 541/1000 [01:13<01:27, 5.26it/s]
54%|█████▍ | 543/1000 [01:13<01:05, 6.93it/s]
55%|█████▍ | 545/1000 [01:14<01:04, 7.06it/s]
55%|█████▍ | 546/1000 [01:14<01:09, 6.50it/s]
55%|█████▍ | 547/1000 [01:14<01:19, 5.69it/s]
55%|█████▍ | 549/1000 [01:14<01:16, 5.91it/s]
55%|█████▌ | 551/1000 [01:15<00:59, 7.50it/s]
55%|█████▌ | 552/1000 [01:15<01:01, 7.26it/s]
55%|█████▌ | 553/1000 [01:15<01:12, 6.17it/s]
55%|█████▌ | 554/1000 [01:15<01:14, 5.95it/s]
56%|█████▌ | 556/1000 [01:15<00:57, 7.75it/s]
56%|█████▌ | 557/1000 [01:15<01:03, 7.02it/s]
56%|█████▌ | 559/1000 [01:16<00:49, 8.83it/s]
56%|█████▌ | 561/1000 [01:16<00:43, 10.04it/s]
56%|█████▋ | 563/1000 [01:16<00:52, 8.37it/s]
56%|█████▋ | 565/1000 [01:16<00:54, 7.97it/s]
57%|█████▋ | 566/1000 [01:17<01:04, 6.74it/s]
57%|█████▋ | 568/1000 [01:17<01:05, 6.56it/s]
57%|█████▋ | 569/1000 [01:17<01:06, 6.45it/s]
57%|█████▋ | 571/1000 [01:17<01:06, 6.44it/s]
57%|█████▋ | 572/1000 [01:18<01:07, 6.30it/s]
57%|█████▋ | 574/1000 [01:18<01:07, 6.34it/s]
58%|█████▊ | 576/1000 [01:18<00:54, 7.83it/s]
58%|█████▊ | 577/1000 [01:18<01:13, 5.73it/s]
58%|█████▊ | 578/1000 [01:19<01:20, 5.25it/s]
58%|█████▊ | 580/1000 [01:19<01:00, 6.96it/s]
58%|█████▊ | 582/1000 [01:19<00:48, 8.56it/s]
58%|█████▊ | 584/1000 [01:19<00:54, 7.60it/s]
58%|█████▊ | 585/1000 [01:19<01:00, 6.92it/s]
59%|█████▊ | 587/1000 [01:20<00:57, 7.14it/s]
59%|█████▉ | 589/1000 [01:20<00:48, 8.51it/s]
59%|█████▉ | 590/1000 [01:20<01:00, 6.75it/s]
59%|█████▉ | 592/1000 [01:20<00:50, 8.16it/s]
59%|█████▉ | 593/1000 [01:21<01:00, 6.78it/s]
60%|█████▉ | 595/1000 [01:21<00:48, 8.38it/s]
60%|█████▉ | 596/1000 [01:21<00:58, 6.86it/s]
60%|█████▉ | 597/1000 [01:21<01:00, 6.66it/s]
60%|█████▉ | 599/1000 [01:21<01:03, 6.36it/s]
60%|██████ | 601/1000 [01:22<01:03, 6.33it/s]
60%|██████ | 602/1000 [01:22<00:59, 6.65it/s]
60%|██████ | 604/1000 [01:22<01:10, 5.65it/s]
61%|██████ | 606/1000 [01:22<00:55, 7.06it/s]
61%|██████ | 608/1000 [01:23<00:50, 7.83it/s]
61%|██████ | 610/1000 [01:23<00:46, 8.46it/s]
61%|██████ | 612/1000 [01:23<00:39, 9.72it/s]
61%|██████▏ | 614/1000 [01:23<00:35, 10.78it/s]
62%|██████▏ | 616/1000 [01:24<00:50, 7.60it/s]
62%|██████▏ | 617/1000 [01:24<00:49, 7.75it/s]
62%|██████▏ | 619/1000 [01:24<00:41, 9.10it/s]
62%|██████▏ | 621/1000 [01:24<00:47, 8.03it/s]
62%|██████▏ | 623/1000 [01:24<00:45, 8.20it/s]
62%|██████▎ | 625/1000 [01:25<00:50, 7.45it/s]
63%|██████▎ | 627/1000 [01:25<00:44, 8.42it/s]
63%|██████▎ | 628/1000 [01:25<00:52, 7.09it/s]
63%|██████▎ | 629/1000 [01:25<01:00, 6.16it/s]
63%|██████▎ | 631/1000 [01:25<00:47, 7.80it/s]
63%|██████▎ | 633/1000 [01:26<00:39, 9.37it/s]
64%|██████▎ | 635/1000 [01:26<00:54, 6.68it/s]
64%|██████▎ | 636/1000 [01:26<00:51, 7.04it/s]
64%|██████▍ | 638/1000 [01:26<00:45, 7.93it/s]
64%|██████▍ | 640/1000 [01:27<00:39, 9.13it/s]
64%|██████▍ | 642/1000 [01:27<00:45, 7.94it/s]
64%|██████▍ | 643/1000 [01:27<00:47, 7.57it/s]
64%|██████▍ | 645/1000 [01:27<00:50, 7.09it/s]
65%|██████▍ | 647/1000 [01:28<00:48, 7.35it/s]
65%|██████▍ | 648/1000 [01:28<00:55, 6.39it/s]
65%|██████▌ | 650/1000 [01:28<00:54, 6.46it/s]
65%|██████▌ | 652/1000 [01:28<00:56, 6.20it/s]
65%|██████▌ | 654/1000 [01:29<00:45, 7.59it/s]
66%|██████▌ | 656/1000 [01:29<00:39, 8.81it/s]
66%|██████▌ | 658/1000 [01:29<00:42, 8.05it/s]
66%|██████▌ | 659/1000 [01:29<00:57, 5.96it/s]
66%|██████▌ | 661/1000 [01:30<00:45, 7.52it/s]
66%|██████▌ | 662/1000 [01:30<00:52, 6.46it/s]
66%|██████▋ | 664/1000 [01:30<00:58, 5.75it/s]
66%|██████▋ | 665/1000 [01:30<01:03, 5.31it/s]
67%|██████▋ | 667/1000 [01:31<00:59, 5.60it/s]
67%|██████▋ | 668/1000 [01:31<01:04, 5.19it/s]
67%|██████▋ | 669/1000 [01:31<00:58, 5.69it/s]
67%|██████▋ | 671/1000 [01:31<00:55, 5.88it/s]
67%|██████▋ | 673/1000 [01:32<00:49, 6.62it/s]
68%|██████▊ | 675/1000 [01:32<00:44, 7.25it/s]
68%|██████▊ | 677/1000 [01:32<00:37, 8.64it/s]
68%|██████▊ | 679/1000 [01:32<00:33, 9.67it/s]
68%|██████▊ | 681/1000 [01:32<00:29, 10.94it/s]
68%|██████▊ | 683/1000 [01:33<00:35, 8.90it/s]
68%|██████▊ | 685/1000 [01:33<00:31, 9.86it/s]
69%|██████▊ | 687/1000 [01:33<00:45, 6.85it/s]
69%|██████▉ | 688/1000 [01:33<00:43, 7.15it/s]
69%|██████▉ | 690/1000 [01:34<00:45, 6.80it/s]
69%|██████▉ | 692/1000 [01:34<00:39, 7.83it/s]
69%|██████▉ | 694/1000 [01:34<00:42, 7.22it/s]
70%|██████▉ | 695/1000 [01:34<00:41, 7.37it/s]
70%|██████▉ | 696/1000 [01:35<00:48, 6.31it/s]
70%|██████▉ | 698/1000 [01:35<00:43, 6.92it/s]
70%|██████▉ | 699/1000 [01:35<00:49, 6.03it/s]
70%|███████ | 701/1000 [01:35<00:40, 7.45it/s]
70%|███████ | 702/1000 [01:36<00:53, 5.56it/s]
70%|███████ | 704/1000 [01:36<00:41, 7.16it/s]
70%|███████ | 705/1000 [01:36<00:54, 5.39it/s]
71%|███████ | 707/1000 [01:36<00:42, 6.92it/s]
71%|███████ | 709/1000 [01:37<00:38, 7.55it/s]
71%|███████ | 710/1000 [01:37<00:44, 6.45it/s]
71%|███████ | 712/1000 [01:37<00:37, 7.62it/s]
71%|███████▏ | 713/1000 [01:37<00:36, 7.78it/s]
72%|███████▏ | 715/1000 [01:37<00:30, 9.28it/s]
72%|███████▏ | 717/1000 [01:38<00:35, 7.93it/s]
72%|███████▏ | 718/1000 [01:38<00:41, 6.73it/s]
72%|███████▏ | 719/1000 [01:38<00:47, 5.89it/s]
72%|███████▏ | 720/1000 [01:38<00:43, 6.43it/s]
72%|███████▏ | 722/1000 [01:38<00:34, 8.11it/s]
72%|███████▏ | 723/1000 [01:38<00:33, 8.18it/s]
72%|███████▏ | 724/1000 [01:39<00:33, 8.19it/s]
72%|███████▎ | 725/1000 [01:39<00:33, 8.27it/s]
73%|███████▎ | 727/1000 [01:39<00:27, 10.11it/s]
73%|███████▎ | 729/1000 [01:39<00:23, 11.58it/s]
73%|███████▎ | 731/1000 [01:39<00:32, 8.30it/s]
73%|███████▎ | 733/1000 [01:39<00:28, 9.51it/s]
74%|███████▎ | 735/1000 [01:40<00:26, 9.85it/s]
74%|███████▎ | 737/1000 [01:40<00:27, 9.50it/s]
74%|███████▍ | 739/1000 [01:40<00:26, 9.75it/s]
74%|███████▍ | 741/1000 [01:40<00:31, 8.29it/s]
74%|███████▍ | 743/1000 [01:41<00:30, 8.35it/s]
74%|███████▍ | 745/1000 [01:41<00:26, 9.59it/s]
75%|███████▍ | 747/1000 [01:41<00:24, 10.41it/s]
75%|███████▍ | 749/1000 [01:41<00:29, 8.62it/s]
75%|███████▌ | 750/1000 [01:41<00:32, 7.68it/s]
75%|███████▌ | 751/1000 [01:42<00:40, 6.16it/s]
75%|███████▌ | 753/1000 [01:42<00:34, 7.23it/s]
75%|███████▌ | 754/1000 [01:42<00:39, 6.22it/s]
76%|███████▌ | 756/1000 [01:42<00:38, 6.40it/s]
76%|███████▌ | 758/1000 [01:43<00:32, 7.34it/s]
76%|███████▌ | 759/1000 [01:43<00:33, 7.11it/s]
76%|███████▌ | 761/1000 [01:43<00:28, 8.53it/s]
76%|███████▋ | 763/1000 [01:43<00:31, 7.59it/s]
76%|███████▋ | 764/1000 [01:43<00:36, 6.55it/s]
77%|███████▋ | 766/1000 [01:44<00:36, 6.42it/s]
77%|███████▋ | 768/1000 [01:44<00:30, 7.60it/s]
77%|███████▋ | 769/1000 [01:44<00:35, 6.56it/s]
77%|███████▋ | 770/1000 [01:44<00:35, 6.50it/s]
77%|███████▋ | 772/1000 [01:45<00:28, 8.06it/s]
77%|███████▋ | 773/1000 [01:45<00:35, 6.35it/s]
77%|███████▋ | 774/1000 [01:45<00:33, 6.73it/s]
78%|███████▊ | 776/1000 [01:45<00:28, 7.85it/s]
78%|███████▊ | 778/1000 [01:45<00:23, 9.55it/s]
78%|███████▊ | 780/1000 [01:46<00:31, 6.91it/s]
78%|███████▊ | 782/1000 [01:46<00:26, 8.34it/s]
78%|███████▊ | 784/1000 [01:46<00:30, 7.13it/s]
79%|███████▊ | 786/1000 [01:46<00:28, 7.51it/s]
79%|███████▉ | 788/1000 [01:47<00:25, 8.35it/s]
79%|███████▉ | 790/1000 [01:47<00:23, 8.96it/s]
79%|███████▉ | 791/1000 [01:47<00:25, 8.19it/s]
79%|███████▉ | 792/1000 [01:47<00:27, 7.70it/s]
79%|███████▉ | 793/1000 [01:47<00:26, 7.95it/s]
80%|███████▉ | 795/1000 [01:48<00:28, 7.18it/s]
80%|███████▉ | 797/1000 [01:48<00:29, 6.84it/s]
80%|███████▉ | 798/1000 [01:48<00:33, 6.00it/s]
80%|████████ | 800/1000 [01:48<00:29, 6.71it/s]
80%|████████ | 802/1000 [01:49<00:25, 7.63it/s]
80%|████████ | 804/1000 [01:49<00:25, 7.82it/s]
81%|████████ | 806/1000 [01:49<00:21, 9.15it/s]
81%|████████ | 807/1000 [01:49<00:21, 8.94it/s]
81%|████████ | 809/1000 [01:49<00:18, 10.18it/s]
81%|████████ | 811/1000 [01:49<00:16, 11.20it/s]
81%|████████▏ | 813/1000 [01:50<00:20, 8.92it/s]
82%|████████▏ | 815/1000 [01:50<00:20, 9.22it/s]
82%|████████▏ | 817/1000 [01:50<00:22, 8.08it/s]
82%|████████▏ | 819/1000 [01:50<00:19, 9.12it/s]
82%|████████▏ | 821/1000 [01:51<00:22, 8.01it/s]
82%|████████▏ | 823/1000 [01:51<00:22, 7.80it/s]
82%|████████▏ | 824/1000 [01:51<00:26, 6.73it/s]
82%|████████▎ | 825/1000 [01:51<00:25, 6.97it/s]
83%|████████▎ | 826/1000 [01:52<00:30, 5.77it/s]
83%|████████▎ | 828/1000 [01:52<00:33, 5.14it/s]
83%|████████▎ | 829/1000 [01:52<00:30, 5.65it/s]
83%|████████▎ | 831/1000 [01:52<00:24, 6.92it/s]
83%|████████▎ | 832/1000 [01:53<00:29, 5.69it/s]
83%|████████▎ | 833/1000 [01:53<00:27, 6.17it/s]
83%|████████▎ | 834/1000 [01:53<00:27, 5.98it/s]
84%|████████▎ | 835/1000 [01:53<00:25, 6.50it/s]
84%|████████▎ | 836/1000 [01:53<00:26, 6.10it/s]
84%|████████▍ | 838/1000 [01:53<00:21, 7.43it/s]
84%|████████▍ | 840/1000 [01:54<00:24, 6.60it/s]
84%|████████▍ | 842/1000 [01:54<00:20, 7.82it/s]
84%|████████▍ | 844/1000 [01:54<00:24, 6.31it/s]
84%|████████▍ | 845/1000 [01:55<00:27, 5.70it/s]
85%|████████▍ | 847/1000 [01:55<00:24, 6.13it/s]
85%|████████▍ | 849/1000 [01:55<00:20, 7.43it/s]
85%|████████▌ | 850/1000 [01:55<00:23, 6.44it/s]
85%|████████▌ | 851/1000 [01:55<00:21, 6.83it/s]
85%|████████▌ | 853/1000 [01:56<00:17, 8.41it/s]
86%|████████▌ | 855/1000 [01:56<00:14, 9.99it/s]
86%|████████▌ | 857/1000 [01:56<00:14, 10.13it/s]
86%|████████▌ | 859/1000 [01:56<00:16, 8.47it/s]
86%|████████▌ | 861/1000 [01:56<00:14, 9.74it/s]
86%|████████▋ | 863/1000 [01:56<00:12, 10.61it/s]
86%|████████▋ | 865/1000 [01:57<00:11, 11.62it/s]
87%|████████▋ | 867/1000 [01:57<00:14, 9.25it/s]
87%|████████▋ | 869/1000 [01:57<00:12, 10.20it/s]
87%|████████▋ | 871/1000 [01:57<00:11, 11.20it/s]
87%|████████▋ | 873/1000 [01:58<00:16, 7.77it/s]
88%|████████▊ | 875/1000 [01:58<00:16, 7.61it/s]
88%|████████▊ | 877/1000 [01:58<00:13, 8.86it/s]
88%|████████▊ | 879/1000 [01:59<00:17, 6.83it/s]
88%|████████▊ | 881/1000 [01:59<00:15, 7.57it/s]
88%|████████▊ | 882/1000 [01:59<00:18, 6.52it/s]
88%|████████▊ | 884/1000 [01:59<00:14, 7.89it/s]
89%|████████▊ | 886/1000 [01:59<00:12, 9.10it/s]
89%|████████▉ | 888/1000 [01:59<00:10, 10.29it/s]
89%|████████▉ | 890/1000 [02:00<00:11, 9.73it/s]
89%|████████▉ | 892/1000 [02:00<00:10, 10.73it/s]
89%|████████▉ | 894/1000 [02:00<00:13, 7.58it/s]
90%|████████▉ | 896/1000 [02:00<00:11, 8.81it/s]
90%|████████▉ | 898/1000 [02:01<00:15, 6.53it/s]
90%|█████████ | 900/1000 [02:01<00:12, 7.69it/s]
90%|█████████ | 902/1000 [02:01<00:12, 7.83it/s]
90%|█████████ | 904/1000 [02:01<00:10, 9.04it/s]
91%|█████████ | 906/1000 [02:02<00:13, 7.04it/s]
91%|█████████ | 908/1000 [02:02<00:11, 8.31it/s]
91%|█████████ | 910/1000 [02:02<00:11, 7.57it/s]
91%|█████████ | 912/1000 [02:02<00:10, 8.57it/s]
91%|█████████▏| 914/1000 [02:03<00:11, 7.29it/s]
92%|█████████▏| 916/1000 [02:03<00:11, 7.03it/s]
92%|█████████▏| 917/1000 [02:03<00:11, 7.32it/s]
92%|█████████▏| 918/1000 [02:04<00:14, 5.57it/s]
92%|█████████▏| 919/1000 [02:04<00:14, 5.69it/s]
92%|█████████▏| 921/1000 [02:04<00:14, 5.57it/s]
92%|█████████▏| 922/1000 [02:04<00:13, 5.92it/s]
92%|█████████▏| 924/1000 [02:04<00:10, 7.15it/s]
93%|█████████▎| 926/1000 [02:05<00:08, 8.64it/s]
93%|█████████▎| 927/1000 [02:05<00:09, 8.08it/s]
93%|█████████▎| 928/1000 [02:05<00:10, 6.62it/s]
93%|█████████▎| 930/1000 [02:05<00:10, 6.46it/s]
93%|█████████▎| 931/1000 [02:05<00:10, 6.81it/s]
93%|█████████▎| 933/1000 [02:06<00:10, 6.60it/s]
93%|█████████▎| 934/1000 [02:06<00:10, 6.16it/s]
94%|█████████▎| 936/1000 [02:06<00:08, 7.30it/s]
94%|█████████▍| 938/1000 [02:06<00:07, 8.81it/s]
94%|█████████▍| 939/1000 [02:06<00:07, 8.03it/s]
94%|█████████▍| 940/1000 [02:07<00:07, 8.12it/s]
94%|█████████▍| 942/1000 [02:07<00:09, 6.33it/s]
94%|█████████▍| 944/1000 [02:07<00:07, 7.07it/s]
95%|█████████▍| 946/1000 [02:07<00:06, 8.29it/s]
95%|█████████▍| 948/1000 [02:08<00:05, 9.62it/s]
95%|█████████▌| 950/1000 [02:08<00:05, 8.79it/s]
95%|█████████▌| 952/1000 [02:08<00:06, 7.39it/s]
95%|█████████▌| 954/1000 [02:09<00:07, 6.15it/s]
96%|█████████▌| 956/1000 [02:09<00:05, 7.39it/s]
96%|█████████▌| 957/1000 [02:09<00:06, 6.40it/s]
96%|█████████▌| 959/1000 [02:09<00:07, 5.77it/s]
96%|█████████▌| 961/1000 [02:10<00:05, 6.81it/s]
96%|█████████▌| 962/1000 [02:10<00:06, 6.04it/s]
96%|█████████▋| 964/1000 [02:10<00:04, 7.41it/s]
96%|█████████▋| 965/1000 [02:10<00:05, 6.40it/s]
97%|█████████▋| 966/1000 [02:10<00:05, 6.31it/s]
97%|█████████▋| 968/1000 [02:11<00:04, 7.98it/s]
97%|█████████▋| 970/1000 [02:11<00:03, 9.19it/s]
97%|█████████▋| 972/1000 [02:11<00:03, 7.91it/s]
97%|█████████▋| 974/1000 [02:11<00:02, 9.09it/s]
98%|█████████▊| 976/1000 [02:11<00:02, 9.65it/s]
98%|█████████▊| 978/1000 [02:12<00:02, 10.69it/s]
98%|█████████▊| 980/1000 [02:12<00:02, 8.23it/s]
98%|█████████▊| 981/1000 [02:12<00:02, 6.95it/s]
98%|█████████▊| 982/1000 [02:12<00:03, 5.38it/s]
98%|█████████▊| 984/1000 [02:13<00:02, 6.86it/s]
99%|█████████▊| 986/1000 [02:13<00:01, 8.30it/s]
99%|█████████▉| 988/1000 [02:13<00:01, 6.72it/s]
99%|█████████▉| 989/1000 [02:13<00:01, 5.97it/s]
99%|█████████▉| 991/1000 [02:14<00:01, 6.13it/s]
99%|█████████▉| 992/1000 [02:14<00:01, 4.97it/s]
99%|█████████▉| 994/1000 [02:14<00:00, 6.54it/s]
100%|█████████▉| 995/1000 [02:15<00:00, 5.52it/s]
100%|█████████▉| 997/1000 [02:15<00:00, 7.04it/s]
100%|█████████▉| 999/1000 [02:15<00:00, 6.76it/s]
100%|██████████| 1000/1000 [02:15<00:00, 6.66it/s]
{'eval_loss': '0.7774', 'eval_runtime': '135.8', 'eval_samples_per_second': '7.363', 'eval_steps_per_second': '7.363', 'epoch': '0.4966', 'num_input_tokens_seen': 6050856}
50%|████▉ | 900/1813 [1:40:43<1:47:00, 7.03s/it]
100%|██████████| 1000/1000 [02:15<00:00, 6.66it/s]

50%|████▉ | 901/1813 [1:40:49<12:02:31, 47.53s/it]
50%|████▉ | 902/1813 [1:40:55<8:51:55, 35.03s/it]
50%|████▉ | 903/1813 [1:41:01<6:39:14, 26.32s/it]
50%|████▉ | 904/1813 [1:41:07<5:06:25, 20.23s/it]
50%|████▉ | 905/1813 [1:41:15<4:10:10, 16.53s/it]
50%|████▉ | 906/1813 [1:41:20<3:19:00, 13.17s/it]
50%|█████ | 907/1813 [1:41:24<2:38:43, 10.51s/it]
50%|█████ | 908/1813 [1:41:30<2:15:30, 8.98s/it]
50%|█████ | 909/1813 [1:41:36<2:04:16, 8.25s/it]
50%|█████ | 910/1813 [1:41:42<1:54:22, 7.60s/it]
{'loss': '0.9143', 'grad_norm': '1.114', 'learning_rate': '0.0001137', 'epoch': '0.5021', 'num_input_tokens_seen': 6115160, 'train_runtime': '6103', 'train_tokens_per_second': '1002'}
50%|█████ | 910/1813 [1:41:42<1:54:22, 7.60s/it]
50%|█████ | 911/1813 [1:41:48<1:44:12, 6.93s/it]
50%|█████ | 912/1813 [1:41:53<1:37:25, 6.49s/it]
50%|█████ | 913/1813 [1:41:58<1:31:32, 6.10s/it]
50%|█████ | 914/1813 [1:42:03<1:24:52, 5.66s/it]
50%|█████ | 915/1813 [1:42:11<1:33:51, 6.27s/it]
51%|█████ | 916/1813 [1:42:18<1:37:30, 6.52s/it]
51%|█████ | 917/1813 [1:42:25<1:38:16, 6.58s/it]
51%|█████ | 918/1813 [1:42:30<1:33:37, 6.28s/it]
51%|█████ | 919/1813 [1:42:36<1:33:37, 6.28s/it]
51%|█████ | 920/1813 [1:42:42<1:30:26, 6.08s/it]
{'loss': '0.9424', 'grad_norm': '0.8236', 'learning_rate': '0.0001118', 'epoch': '0.5076', 'num_input_tokens_seen': 6178904, 'train_runtime': '6163', 'train_tokens_per_second': '1003'}
51%|█████ | 920/1813 [1:42:42<1:30:26, 6.08s/it]
51%|█████ | 921/1813 [1:42:48<1:29:04, 5.99s/it]
51%|█████ | 922/1813 [1:42:54<1:28:23, 5.95s/it]
51%|█████ | 923/1813 [1:43:00<1:29:22, 6.03s/it]
51%|█████ | 924/1813 [1:43:07<1:33:40, 6.32s/it]
51%|█████ | 925/1813 [1:43:13<1:31:07, 6.16s/it]
51%|█████ | 926/1813 [1:43:19<1:33:00, 6.29s/it]
51%|█████ | 927/1813 [1:43:25<1:31:28, 6.19s/it]
51%|█████ | 928/1813 [1:43:31<1:28:32, 6.00s/it]
51%|█████ | 929/1813 [1:43:37<1:28:20, 6.00s/it]
51%|█████▏ | 930/1813 [1:43:44<1:32:08, 6.26s/it]
{'loss': '0.9029', 'grad_norm': '0.9303', 'learning_rate': '0.0001099', 'epoch': '0.5131', 'num_input_tokens_seen': 6244360, 'train_runtime': '6224', 'train_tokens_per_second': '1003'}
51%|█████▏ | 930/1813 [1:43:44<1:32:08, 6.26s/it]
51%|█████▏ | 931/1813 [1:43:51<1:35:28, 6.50s/it]
51%|█████▏ | 932/1813 [1:43:56<1:31:45, 6.25s/it]
51%|█████▏ | 933/1813 [1:44:02<1:29:53, 6.13s/it]
52%|█████▏ | 934/1813 [1:44:09<1:31:59, 6.28s/it]
52%|█████▏ | 935/1813 [1:44:18<1:43:11, 7.05s/it]
52%|█████▏ | 936/1813 [1:44:24<1:40:17, 6.86s/it]
52%|█████▏ | 937/1813 [1:44:30<1:37:25, 6.67s/it]
52%|█████▏ | 938/1813 [1:44:37<1:39:10, 6.80s/it]
52%|█████▏ | 939/1813 [1:44:43<1:35:33, 6.56s/it]
52%|█████▏ | 940/1813 [1:44:51<1:37:50, 6.72s/it]
{'loss': '0.8899', 'grad_norm': '1.102', 'learning_rate': '0.000108', 'epoch': '0.5186', 'num_input_tokens_seen': 6318968, 'train_runtime': '6291', 'train_tokens_per_second': '1004'}
52%|█████▏ | 940/1813 [1:44:51<1:37:50, 6.72s/it]
52%|█████▏ | 941/1813 [1:44:56<1:31:41, 6.31s/it]
52%|█████▏ | 942/1813 [1:45:02<1:28:43, 6.11s/it]
52%|█████▏ | 943/1813 [1:45:07<1:26:29, 5.97s/it]
52%|█████▏ | 944/1813 [1:45:13<1:26:25, 5.97s/it]
52%|█████▏ | 945/1813 [1:45:18<1:23:11, 5.75s/it]
52%|█████▏ | 946/1813 [1:45:25<1:24:53, 5.87s/it]
52%|█████▏ | 947/1813 [1:45:31<1:26:48, 6.01s/it]
52%|█████▏ | 948/1813 [1:45:37<1:27:52, 6.10s/it]
52%|█████▏ | 949/1813 [1:45:42<1:23:34, 5.80s/it]
52%|█████▏ | 950/1813 [1:45:49<1:26:06, 5.99s/it]
{'loss': '0.9461', 'grad_norm': '1.297', 'learning_rate': '0.0001061', 'epoch': '0.5241', 'num_input_tokens_seen': 6379704, 'train_runtime': '6349', 'train_tokens_per_second': '1005'}
52%|█████▏ | 950/1813 [1:45:49<1:26:06, 5.99s/it]
52%|█████▏ | 951/1813 [1:45:54<1:23:41, 5.83s/it]
53%|█████▎ | 952/1813 [1:46:00<1:22:17, 5.73s/it]
53%|█████▎ | 953/1813 [1:46:06<1:23:00, 5.79s/it]
53%|█████▎ | 954/1813 [1:46:11<1:22:13, 5.74s/it]
53%|█████▎ | 955/1813 [1:46:17<1:21:50, 5.72s/it]
53%|█████▎ | 956/1813 [1:46:22<1:21:03, 5.67s/it]
53%|█████▎ | 957/1813 [1:46:28<1:20:23, 5.63s/it]
53%|█████▎ | 958/1813 [1:46:33<1:15:27, 5.30s/it]
53%|█████▎ | 959/1813 [1:46:38<1:17:40, 5.46s/it]
53%|█████▎ | 960/1813 [1:46:46<1:29:03, 6.26s/it]
{'loss': '0.9544', 'grad_norm': '0.8503', 'learning_rate': '0.0001042', 'epoch': '0.5297', 'num_input_tokens_seen': 6441656, 'train_runtime': '6407', 'train_tokens_per_second': '1005'}
53%|█████▎ | 960/1813 [1:46:46<1:29:03, 6.26s/it]
53%|█████▎ | 961/1813 [1:46:53<1:30:00, 6.34s/it]
53%|█████▎ | 962/1813 [1:47:01<1:35:58, 6.77s/it]
53%|█████▎ | 963/1813 [1:47:08<1:36:12, 6.79s/it]
53%|█████▎ | 964/1813 [1:47:14<1:32:17, 6.52s/it]
53%|█████▎ | 965/1813 [1:47:19<1:29:22, 6.32s/it]
53%|█████▎ | 966/1813 [1:47:27<1:34:17, 6.68s/it]
53%|█████▎ | 967/1813 [1:47:34<1:37:14, 6.90s/it]
53%|█████▎ | 968/1813 [1:47:40<1:31:13, 6.48s/it]
53%|█████▎ | 969/1813 [1:47:46<1:28:49, 6.31s/it]
54%|█████▎ | 970/1813 [1:47:50<1:21:45, 5.82s/it]
{'loss': '0.9867', 'grad_norm': '0.9779', 'learning_rate': '0.0001024', 'epoch': '0.5352', 'num_input_tokens_seen': 6512320, 'train_runtime': '6471', 'train_tokens_per_second': '1006'}
54%|█████▎ | 970/1813 [1:47:50<1:21:45, 5.82s/it]
54%|█████▎ | 971/1813 [1:47:57<1:25:17, 6.08s/it]
54%|█████▎ | 972/1813 [1:48:03<1:25:56, 6.13s/it]
54%|█████▎ | 973/1813 [1:48:09<1:24:49, 6.06s/it]
54%|█████▎ | 974/1813 [1:48:18<1:34:29, 6.76s/it]
54%|█████▍ | 975/1813 [1:48:24<1:33:28, 6.69s/it]
54%|█████▍ | 976/1813 [1:48:30<1:28:58, 6.38s/it]
54%|█████▍ | 977/1813 [1:48:38<1:35:00, 6.82s/it]
54%|█████▍ | 978/1813 [1:48:44<1:32:41, 6.66s/it]
54%|█████▍ | 979/1813 [1:48:51<1:34:10, 6.78s/it]
54%|█████▍ | 980/1813 [1:48:57<1:32:34, 6.67s/it]
{'loss': '0.9339', 'grad_norm': '1.53', 'learning_rate': '0.0001005', 'epoch': '0.5407', 'num_input_tokens_seen': 6586672, 'train_runtime': '6538', 'train_tokens_per_second': '1007'}
54%|█████▍ | 980/1813 [1:48:57<1:32:34, 6.67s/it]
54%|█████▍ | 981/1813 [1:49:04<1:32:19, 6.66s/it]
54%|█████▍ | 982/1813 [1:49:09<1:25:45, 6.19s/it]
54%|█████▍ | 983/1813 [1:49:14<1:21:51, 5.92s/it]
54%|█████▍ | 984/1813 [1:49:20<1:20:00, 5.79s/it]
54%|█████▍ | 985/1813 [1:49:27<1:23:48, 6.07s/it]
54%|█████▍ | 986/1813 [1:49:34<1:29:53, 6.52s/it]
54%|█████▍ | 987/1813 [1:49:40<1:28:24, 6.42s/it]
54%|█████▍ | 988/1813 [1:49:46<1:24:29, 6.14s/it]
55%|█████▍ | 989/1813 [1:49:51<1:19:31, 5.79s/it]
55%|█████▍ | 990/1813 [1:49:59<1:28:09, 6.43s/it]
{'loss': '0.8833', 'grad_norm': '1.01', 'learning_rate': '9.858e-05', 'epoch': '0.5462', 'num_input_tokens_seen': 6653096, 'train_runtime': '6599', 'train_tokens_per_second': '1008'}
55%|█████▍ | 990/1813 [1:49:59<1:28:09, 6.43s/it]
55%|█████▍ | 991/1813 [1:50:04<1:23:27, 6.09s/it]
55%|█████▍ | 992/1813 [1:50:11<1:28:32, 6.47s/it]
55%|█████▍ | 993/1813 [1:50:17<1:26:00, 6.29s/it]
55%|█████▍ | 994/1813 [1:50:26<1:34:36, 6.93s/it]
55%|█████▍ | 995/1813 [1:50:32<1:30:13, 6.62s/it]
55%|█████▍ | 996/1813 [1:50:38<1:28:22, 6.49s/it]
55%|█████▍ | 997/1813 [1:50:44<1:25:06, 6.26s/it]
55%|█████▌ | 998/1813 [1:50:48<1:19:33, 5.86s/it]
55%|█████▌ | 999/1813 [1:50:54<1:18:45, 5.80s/it]
55%|█████▌ | 1000/1813 [1:50:59<1:15:25, 5.57s/it]
{'loss': '1', 'grad_norm': '1.051', 'learning_rate': '9.669e-05', 'epoch': '0.5517', 'num_input_tokens_seen': 6716784, 'train_runtime': '6660', 'train_tokens_per_second': '1009'}
55%|█████▌ | 1000/1813 [1:50:59<1:15:25, 5.57s/it]
55%|█████▌ | 1001/1813 [1:51:06<1:19:02, 5.84s/it]
55%|█████▌ | 1002/1813 [1:51:12<1:20:18, 5.94s/it]
55%|█████▌ | 1003/1813 [1:51:19<1:23:45, 6.20s/it]
55%|█████▌ | 1004/1813 [1:51:24<1:19:40, 5.91s/it]
55%|█████▌ | 1005/1813 [1:51:31<1:24:24, 6.27s/it]
55%|█████▌ | 1006/1813 [1:51:38<1:25:59, 6.39s/it]
56%|█████▌ | 1007/1813 [1:51:43<1:23:02, 6.18s/it]
56%|█████▌ | 1008/1813 [1:51:49<1:21:08, 6.05s/it]
56%|█████▌ | 1009/1813 [1:51:55<1:20:53, 6.04s/it]
56%|█████▌ | 1010/1813 [1:52:01<1:18:57, 5.90s/it]
{'loss': '0.9323', 'grad_norm': '1.135', 'learning_rate': '9.481e-05', 'epoch': '0.5572', 'num_input_tokens_seen': 6783768, 'train_runtime': '6721', 'train_tokens_per_second': '1009'}
56%|█████▌ | 1010/1813 [1:52:01<1:18:57, 5.90s/it]
56%|█████▌ | 1011/1813 [1:52:07<1:22:18, 6.16s/it]
56%|█████▌ | 1012/1813 [1:52:12<1:16:32, 5.73s/it]
56%|█████▌ | 1013/1813 [1:52:16<1:10:47, 5.31s/it]
56%|█████▌ | 1014/1813 [1:52:25<1:22:42, 6.21s/it]
56%|█████▌ | 1015/1813 [1:52:30<1:18:15, 5.88s/it]
56%|█████▌ | 1016/1813 [1:52:35<1:15:26, 5.68s/it]
56%|█████▌ | 1017/1813 [1:52:42<1:20:00, 6.03s/it]
56%|█████▌ | 1018/1813 [1:52:48<1:21:00, 6.11s/it]
56%|█████▌ | 1019/1813 [1:52:53<1:16:20, 5.77s/it]
56%|█████▋ | 1020/1813 [1:52:58<1:13:12, 5.54s/it]
{'loss': '0.8484', 'grad_norm': '1.222', 'learning_rate': '9.292e-05', 'epoch': '0.5628', 'num_input_tokens_seen': 6844992, 'train_runtime': '6779', 'train_tokens_per_second': '1010'}
56%|█████▋ | 1020/1813 [1:52:58<1:13:12, 5.54s/it]
56%|█████▋ | 1021/1813 [1:53:05<1:18:28, 5.95s/it]
56%|█████▋ | 1022/1813 [1:53:11<1:19:02, 6.00s/it]
56%|█████▋ | 1023/1813 [1:53:19<1:24:59, 6.46s/it]
56%|█████▋ | 1024/1813 [1:53:25<1:24:38, 6.44s/it]
57%|█████▋ | 1025/1813 [1:53:34<1:35:23, 7.26s/it]
57%|█████▋ | 1026/1813 [1:53:40<1:28:24, 6.74s/it]
57%|█████▋ | 1027/1813 [1:53:46<1:25:42, 6.54s/it]
57%|█████▋ | 1028/1813 [1:53:53<1:29:00, 6.80s/it]
57%|█████▋ | 1029/1813 [1:54:00<1:27:57, 6.73s/it]
57%|█████▋ | 1030/1813 [1:54:07<1:28:25, 6.78s/it]
{'loss': '0.9876', 'grad_norm': '0.8492', 'learning_rate': '9.104e-05', 'epoch': '0.5683', 'num_input_tokens_seen': 6920856, 'train_runtime': '6847', 'train_tokens_per_second': '1011'}
57%|█████▋ | 1030/1813 [1:54:07<1:28:25, 6.78s/it]
57%|█████▋ | 1031/1813 [1:54:13<1:24:26, 6.48s/it]
57%|█████▋ | 1032/1813 [1:54:19<1:25:43, 6.59s/it]
57%|█████▋ | 1033/1813 [1:54:26<1:24:14, 6.48s/it]
57%|█████▋ | 1034/1813 [1:54:31<1:21:35, 6.28s/it]
57%|█████▋ | 1035/1813 [1:54:38<1:21:05, 6.25s/it]
57%|█████▋ | 1036/1813 [1:54:44<1:21:49, 6.32s/it]
57%|█████▋ | 1037/1813 [1:54:50<1:19:28, 6.14s/it]
57%|█████▋ | 1038/1813 [1:54:56<1:19:44, 6.17s/it]
57%|█████▋ | 1039/1813 [1:55:03<1:22:59, 6.43s/it]
57%|█████▋ | 1040/1813 [1:55:10<1:25:34, 6.64s/it]
{'loss': '0.912', 'grad_norm': '0.8267', 'learning_rate': '8.916e-05', 'epoch': '0.5738', 'num_input_tokens_seen': 6988568, 'train_runtime': '6911', 'train_tokens_per_second': '1011'}
57%|█████▋ | 1040/1813 [1:55:10<1:25:34, 6.64s/it]
57%|█████▋ | 1041/1813 [1:55:16<1:22:35, 6.42s/it]
57%|█████▋ | 1042/1813 [1:55:23<1:22:32, 6.42s/it]
58%|█████▊ | 1043/1813 [1:55:28<1:19:00, 6.16s/it]
58%|█████▊ | 1044/1813 [1:55:34<1:15:58, 5.93s/it]
58%|█████▊ | 1045/1813 [1:55:39<1:15:02, 5.86s/it]
58%|█████▊ | 1046/1813 [1:55:45<1:14:13, 5.81s/it]
58%|█████▊ | 1047/1813 [1:55:52<1:17:11, 6.05s/it]
58%|█████▊ | 1048/1813 [1:55:58<1:20:03, 6.28s/it]
58%|█████▊ | 1049/1813 [1:56:04<1:17:32, 6.09s/it]
58%|█████▊ | 1050/1813 [1:56:10<1:17:00, 6.06s/it]
{'loss': '0.9023', 'grad_norm': '1.239', 'learning_rate': '8.728e-05', 'epoch': '0.5793', 'num_input_tokens_seen': 7051808, 'train_runtime': '6970', 'train_tokens_per_second': '1012'}
58%|█████▊ | 1050/1813 [1:56:10<1:17:00, 6.06s/it]
58%|█████▊ | 1051/1813 [1:56:15<1:13:47, 5.81s/it]
58%|█████▊ | 1052/1813 [1:56:21<1:14:06, 5.84s/it]
58%|█████▊ | 1053/1813 [1:56:27<1:14:44, 5.90s/it]
58%|█████▊ | 1054/1813 [1:56:33<1:14:08, 5.86s/it]
58%|█████▊ | 1055/1813 [1:56:38<1:11:43, 5.68s/it]
58%|█████▊ | 1056/1813 [1:56:44<1:11:55, 5.70s/it]
58%|█████▊ | 1057/1813 [1:56:51<1:15:12, 5.97s/it]
58%|█████▊ | 1058/1813 [1:56:55<1:11:10, 5.66s/it]
58%|█████▊ | 1059/1813 [1:57:00<1:07:06, 5.34s/it]
58%|█████▊ | 1060/1813 [1:57:07<1:13:33, 5.86s/it]
{'loss': '0.9028', 'grad_norm': '0.7496', 'learning_rate': '8.541e-05', 'epoch': '0.5848', 'num_input_tokens_seen': 7110624, 'train_runtime': '7028', 'train_tokens_per_second': '1012'}
58%|█████▊ | 1060/1813 [1:57:07<1:13:33, 5.86s/it]
59%|█████▊ | 1061/1813 [1:57:12<1:11:04, 5.67s/it]
59%|█████▊ | 1062/1813 [1:57:17<1:08:28, 5.47s/it]
59%|█████▊ | 1063/1813 [1:57:24<1:13:41, 5.90s/it]
59%|█████▊ | 1064/1813 [1:57:32<1:19:39, 6.38s/it]
59%|█████▊ | 1065/1813 [1:57:38<1:20:28, 6.46s/it]
59%|█████▉ | 1066/1813 [1:57:46<1:24:02, 6.75s/it]
59%|█████▉ | 1067/1813 [1:57:52<1:22:58, 6.67s/it]
59%|█████▉ | 1068/1813 [1:57:58<1:18:07, 6.29s/it]
59%|█████▉ | 1069/1813 [1:58:06<1:24:44, 6.83s/it]
59%|█████▉ | 1070/1813 [1:58:12<1:20:50, 6.53s/it]
{'loss': '0.9053', 'grad_norm': '1.243', 'learning_rate': '8.355e-05', 'epoch': '0.5903', 'num_input_tokens_seen': 7179728, 'train_runtime': '7092', 'train_tokens_per_second': '1012'}
59%|█████▉ | 1070/1813 [1:58:12<1:20:50, 6.53s/it]
59%|█████▉ | 1071/1813 [1:58:17<1:16:05, 6.15s/it]
59%|█████▉ | 1072/1813 [1:58:23<1:16:50, 6.22s/it]
59%|█████▉ | 1073/1813 [1:58:29<1:15:25, 6.12s/it]
59%|█████▉ | 1074/1813 [1:58:35<1:12:54, 5.92s/it]
59%|█████▉ | 1075/1813 [1:58:41<1:14:29, 6.06s/it]
59%|█████▉ | 1076/1813 [1:58:48<1:15:57, 6.18s/it]
59%|█████▉ | 1077/1813 [1:58:52<1:09:40, 5.68s/it]
59%|█████▉ | 1078/1813 [1:58:57<1:07:16, 5.49s/it]
60%|█████▉ | 1079/1813 [1:59:03<1:10:33, 5.77s/it]
60%|█████▉ | 1080/1813 [1:59:10<1:12:53, 5.97s/it]
{'loss': '0.9028', 'grad_norm': '0.7934', 'learning_rate': '8.169e-05', 'epoch': '0.5959', 'num_input_tokens_seen': 7240984, 'train_runtime': '7150', 'train_tokens_per_second': '1013'}
60%|█████▉ | 1080/1813 [1:59:10<1:12:53, 5.97s/it]
60%|█████▉ | 1081/1813 [1:59:16<1:14:01, 6.07s/it]
60%|█████▉ | 1082/1813 [1:59:22<1:12:47, 5.97s/it]
60%|█████▉ | 1083/1813 [1:59:28<1:12:59, 6.00s/it]
60%|█████▉ | 1084/1813 [1:59:34<1:12:10, 5.94s/it]
60%|█████▉ | 1085/1813 [1:59:40<1:11:53, 5.93s/it]
60%|█████▉ | 1086/1813 [1:59:44<1:04:27, 5.32s/it]
60%|█████▉ | 1087/1813 [1:59:49<1:05:34, 5.42s/it]
60%|██████ | 1088/1813 [1:59:55<1:06:24, 5.50s/it]
60%|██████ | 1089/1813 [2:00:02<1:10:16, 5.82s/it]
60%|██████ | 1090/1813 [2:00:08<1:11:22, 5.92s/it]
{'loss': '0.8074', 'grad_norm': '1.013', 'learning_rate': '7.983e-05', 'epoch': '0.6014', 'num_input_tokens_seen': 7301824, 'train_runtime': '7208', 'train_tokens_per_second': '1013'}
60%|██████ | 1090/1813 [2:00:08<1:11:22, 5.92s/it]
60%|██████ | 1091/1813 [2:00:14<1:12:13, 6.00s/it]
60%|██████ | 1092/1813 [2:00:20<1:12:04, 6.00s/it]
60%|██████ | 1093/1813 [2:00:26<1:10:42, 5.89s/it]
60%|██████ | 1094/1813 [2:00:32<1:12:26, 6.05s/it]
60%|██████ | 1095/1813 [2:00:38<1:13:17, 6.12s/it]
60%|██████ | 1096/1813 [2:00:44<1:10:22, 5.89s/it]
61%|██████ | 1097/1813 [2:00:49<1:10:04, 5.87s/it]
61%|██████ | 1098/1813 [2:00:56<1:14:03, 6.22s/it]
61%|██████ | 1099/1813 [2:01:03<1:13:43, 6.20s/it]
61%|██████ | 1100/1813 [2:01:10<1:19:25, 6.68s/it]
{'loss': '0.8957', 'grad_norm': '0.9555', 'learning_rate': '7.798e-05', 'epoch': '0.6069', 'num_input_tokens_seen': 7369528, 'train_runtime': '7271', 'train_tokens_per_second': '1014'}
61%|██████ | 1100/1813 [2:01:10<1:19:25, 6.68s/it]
61%|██████ | 1101/1813 [2:01:17<1:18:54, 6.65s/it]
61%|██████ | 1102/1813 [2:01:24<1:20:49, 6.82s/it]
61%|██████ | 1103/1813 [2:01:30<1:16:30, 6.46s/it]
61%|██████ | 1104/1813 [2:01:37<1:20:24, 6.81s/it]
61%|██████ | 1105/1813 [2:01:43<1:14:14, 6.29s/it]
61%|██████ | 1106/1813 [2:01:48<1:12:33, 6.16s/it]
61%|██████ | 1107/1813 [2:01:57<1:20:31, 6.84s/it]
61%|██████ | 1108/1813 [2:02:03<1:16:35, 6.52s/it]
61%|██████ | 1109/1813 [2:02:09<1:16:49, 6.55s/it]
61%|██████ | 1110/1813 [2:02:17<1:20:18, 6.85s/it]
{'loss': '0.9344', 'grad_norm': '1.018', 'learning_rate': '7.615e-05', 'epoch': '0.6124', 'num_input_tokens_seen': 7441040, 'train_runtime': '7337', 'train_tokens_per_second': '1014'}
61%|██████ | 1110/1813 [2:02:17<1:20:18, 6.85s/it]
61%|██████▏ | 1111/1813 [2:02:21<1:12:06, 6.16s/it]
61%|██████▏ | 1112/1813 [2:02:27<1:10:55, 6.07s/it]
61%|██████▏ | 1113/1813 [2:02:34<1:11:52, 6.16s/it]
61%|██████▏ | 1114/1813 [2:02:41<1:15:00, 6.44s/it]
62%|██████▏ | 1115/1813 [2:02:47<1:15:43, 6.51s/it]
62%|██████▏ | 1116/1813 [2:02:53<1:14:31, 6.42s/it]
62%|██████▏ | 1117/1813 [2:02:59<1:10:49, 6.11s/it]
62%|██████▏ | 1118/1813 [2:03:04<1:06:08, 5.71s/it]
62%|██████▏ | 1119/1813 [2:03:10<1:07:53, 5.87s/it]
62%|██████▏ | 1120/1813 [2:03:16<1:10:04, 6.07s/it]
{'loss': '0.872', 'grad_norm': '2.986', 'learning_rate': '7.432e-05', 'epoch': '0.6179', 'num_input_tokens_seen': 7504976, 'train_runtime': '7397', 'train_tokens_per_second': '1015'}
62%|██████▏ | 1120/1813 [2:03:16<1:10:04, 6.07s/it]
62%|██████▏ | 1121/1813 [2:03:24<1:16:01, 6.59s/it]
62%|██████▏ | 1122/1813 [2:03:29<1:09:31, 6.04s/it]
62%|██████▏ | 1123/1813 [2:03:36<1:14:34, 6.48s/it]
62%|██████▏ | 1124/1813 [2:03:42<1:10:39, 6.15s/it]
62%|██████▏ | 1125/1813 [2:03:49<1:12:15, 6.30s/it]
62%|██████▏ | 1126/1813 [2:03:54<1:10:51, 6.19s/it]
62%|██████▏ | 1127/1813 [2:04:00<1:07:36, 5.91s/it]
62%|██████▏ | 1128/1813 [2:04:05<1:05:15, 5.72s/it]
62%|██████▏ | 1129/1813 [2:04:10<1:03:17, 5.55s/it]
62%|██████▏ | 1130/1813 [2:04:15<1:01:31, 5.40s/it]
{'loss': '0.8494', 'grad_norm': '0.9379', 'learning_rate': '7.249e-05', 'epoch': '0.6234', 'num_input_tokens_seen': 7568576, 'train_runtime': '7456', 'train_tokens_per_second': '1015'}
62%|██████▏ | 1130/1813 [2:04:15<1:01:31, 5.40s/it]
62%|██████▏ | 1131/1813 [2:04:21<1:02:12, 5.47s/it]
62%|██████▏ | 1132/1813 [2:04:27<1:03:37, 5.61s/it]
62%|██████▏ | 1133/1813 [2:04:33<1:06:19, 5.85s/it]
63%|██████▎ | 1134/1813 [2:04:41<1:12:59, 6.45s/it]
63%|██████▎ | 1135/1813 [2:04:48<1:13:56, 6.54s/it]
63%|██████▎ | 1136/1813 [2:04:55<1:14:56, 6.64s/it]
63%|██████▎ | 1137/1813 [2:05:01<1:14:23, 6.60s/it]
63%|██████▎ | 1138/1813 [2:05:08<1:15:36, 6.72s/it]
63%|██████▎ | 1139/1813 [2:05:14<1:11:13, 6.34s/it]
63%|██████▎ | 1140/1813 [2:05:19<1:08:35, 6.12s/it]
{'loss': '0.9318', 'grad_norm': '1.038', 'learning_rate': '7.068e-05', 'epoch': '0.629', 'num_input_tokens_seen': 7639168, 'train_runtime': '7520', 'train_tokens_per_second': '1016'}
63%|██████▎ | 1140/1813 [2:05:19<1:08:35, 6.12s/it]
63%|██████▎ | 1141/1813 [2:05:26<1:09:07, 6.17s/it]
63%|██████▎ | 1142/1813 [2:05:32<1:08:32, 6.13s/it]
63%|██████▎ | 1143/1813 [2:05:37<1:07:47, 6.07s/it]
63%|██████▎ | 1144/1813 [2:05:44<1:10:26, 6.32s/it]
63%|██████▎ | 1145/1813 [2:05:51<1:11:13, 6.40s/it]
63%|██████▎ | 1146/1813 [2:05:56<1:07:54, 6.11s/it]
63%|██████▎ | 1147/1813 [2:06:04<1:12:43, 6.55s/it]
63%|██████▎ | 1148/1813 [2:06:11<1:14:43, 6.74s/it]
63%|██████▎ | 1149/1813 [2:06:17<1:11:54, 6.50s/it]
63%|██████▎ | 1150/1813 [2:06:25<1:15:16, 6.81s/it]
{'loss': '0.8448', 'grad_norm': '0.9389', 'learning_rate': '6.888e-05', 'epoch': '0.6345', 'num_input_tokens_seen': 7707832, 'train_runtime': '7585', 'train_tokens_per_second': '1016'}
63%|██████▎ | 1150/1813 [2:06:25<1:15:16, 6.81s/it]
63%|██████▎ | 1151/1813 [2:06:29<1:05:43, 5.96s/it]
64%|██████▎ | 1152/1813 [2:06:34<1:03:41, 5.78s/it]
64%|██████▎ | 1153/1813 [2:06:41<1:07:23, 6.13s/it]
64%|██████▎ | 1154/1813 [2:06:47<1:06:21, 6.04s/it]
64%|██████▎ | 1155/1813 [2:06:53<1:07:30, 6.16s/it]
64%|██████▍ | 1156/1813 [2:06:59<1:07:39, 6.18s/it]
64%|██████▍ | 1157/1813 [2:07:07<1:12:05, 6.59s/it]
64%|██████▍ | 1158/1813 [2:07:14<1:12:14, 6.62s/it]
64%|██████▍ | 1159/1813 [2:07:21<1:14:50, 6.87s/it]
64%|██████▍ | 1160/1813 [2:07:27<1:12:56, 6.70s/it]
{'loss': '0.9194', 'grad_norm': '0.7847', 'learning_rate': '6.709e-05', 'epoch': '0.64', 'num_input_tokens_seen': 7775872, 'train_runtime': '7648', 'train_tokens_per_second': '1017'}
64%|██████▍ | 1160/1813 [2:07:27<1:12:56, 6.70s/it]
64%|██████▍ | 1161/1813 [2:07:35<1:15:13, 6.92s/it]
64%|██████▍ | 1162/1813 [2:07:42<1:14:45, 6.89s/it]
64%|██████▍ | 1163/1813 [2:07:48<1:13:01, 6.74s/it]
64%|██████▍ | 1164/1813 [2:07:55<1:12:14, 6.68s/it]
64%|██████▍ | 1165/1813 [2:08:01<1:11:42, 6.64s/it]
64%|██████▍ | 1166/1813 [2:08:07<1:09:34, 6.45s/it]
64%|██████▍ | 1167/1813 [2:08:14<1:11:04, 6.60s/it]
64%|██████▍ | 1168/1813 [2:08:21<1:10:23, 6.55s/it]
64%|██████▍ | 1169/1813 [2:08:27<1:09:31, 6.48s/it]
65%|██████▍ | 1170/1813 [2:08:33<1:07:43, 6.32s/it]
{'loss': '0.8965', 'grad_norm': '1.08', 'learning_rate': '6.532e-05', 'epoch': '0.6455', 'num_input_tokens_seen': 7846688, 'train_runtime': '7713', 'train_tokens_per_second': '1017'}
65%|██████▍ | 1170/1813 [2:08:33<1:07:43, 6.32s/it]
65%|██████▍ | 1171/1813 [2:08:40<1:11:26, 6.68s/it]
65%|██████▍ | 1172/1813 [2:08:48<1:13:27, 6.88s/it]
65%|██████▍ | 1173/1813 [2:08:53<1:09:30, 6.52s/it]
65%|██████▍ | 1174/1813 [2:08:59<1:06:28, 6.24s/it]
65%|██████▍ | 1175/1813 [2:09:05<1:05:40, 6.18s/it]
65%|██████▍ | 1176/1813 [2:09:11<1:06:43, 6.28s/it]
65%|██████▍ | 1177/1813 [2:09:17<1:05:29, 6.18s/it]
65%|██████▍ | 1178/1813 [2:09:23<1:04:49, 6.13s/it]
65%|██████▌ | 1179/1813 [2:09:30<1:04:49, 6.14s/it]
65%|██████▌ | 1180/1813 [2:09:36<1:06:38, 6.32s/it]
{'loss': '0.8674', 'grad_norm': '1.108', 'learning_rate': '6.355e-05', 'epoch': '0.651', 'num_input_tokens_seen': 7914072, 'train_runtime': '7777', 'train_tokens_per_second': '1018'}
65%|██████▌ | 1180/1813 [2:09:36<1:06:38, 6.32s/it]
65%|██████▌ | 1181/1813 [2:09:44<1:11:42, 6.81s/it]
65%|██████▌ | 1182/1813 [2:09:52<1:14:46, 7.11s/it]
65%|██████▌ | 1183/1813 [2:09:59<1:14:40, 7.11s/it]
65%|██████▌ | 1184/1813 [2:10:05<1:10:40, 6.74s/it]
65%|██████▌ | 1185/1813 [2:10:13<1:13:41, 7.04s/it]
65%|██████▌ | 1186/1813 [2:10:20<1:14:30, 7.13s/it]
65%|██████▌ | 1187/1813 [2:10:27<1:13:47, 7.07s/it]
66%|██████▌ | 1188/1813 [2:10:32<1:08:12, 6.55s/it]
66%|██████▌ | 1189/1813 [2:10:38<1:03:44, 6.13s/it]
66%|██████▌ | 1190/1813 [2:10:44<1:04:24, 6.20s/it]
{'loss': '0.9325', 'grad_norm': '1.167', 'learning_rate': '6.18e-05', 'epoch': '0.6566', 'num_input_tokens_seen': 7989064, 'train_runtime': '7844', 'train_tokens_per_second': '1018'}
66%|██████▌ | 1190/1813 [2:10:44<1:04:24, 6.20s/it]
66%|██████▌ | 1191/1813 [2:10:50<1:03:17, 6.11s/it]
66%|██████▌ | 1192/1813 [2:10:57<1:05:02, 6.28s/it]
66%|██████▌ | 1193/1813 [2:11:02<1:03:58, 6.19s/it]
66%|██████▌ | 1194/1813 [2:11:09<1:05:01, 6.30s/it]
66%|██████▌ | 1195/1813 [2:11:14<1:00:29, 5.87s/it]
66%|██████▌ | 1196/1813 [2:11:20<1:01:23, 5.97s/it]
66%|██████▌ | 1197/1813 [2:11:27<1:02:42, 6.11s/it]
66%|██████▌ | 1198/1813 [2:11:33<1:02:32, 6.10s/it]
66%|██████▌ | 1199/1813 [2:11:39<1:02:26, 6.10s/it]
66%|██████▌ | 1200/1813 [2:11:46<1:06:29, 6.51s/it]
{'loss': '0.8622', 'grad_norm': '0.9519', 'learning_rate': '6.006e-05', 'epoch': '0.6621', 'num_input_tokens_seen': 8055352, 'train_runtime': '7907', 'train_tokens_per_second': '1019'}
66%|██████▌ | 1200/1813 [2:11:46<1:06:29, 6.51s/it]
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:03, 15.78it/s]
0%| | 5/1000 [00:00<02:17, 7.24it/s]
1%| | 7/1000 [00:00<02:00, 8.26it/s]
1%| | 9/1000 [00:01<02:35, 6.37it/s]
1%| | 11/1000 [00:01<02:04, 7.95it/s]
1%|▏ | 13/1000 [00:01<02:22, 6.94it/s]
1%|▏ | 14/1000 [00:01<02:25, 6.78it/s]
2%|▏ | 15/1000 [00:02<02:45, 5.94it/s]
2%|▏ | 16/1000 [00:02<02:52, 5.71it/s]
2%|▏ | 18/1000 [00:02<02:42, 6.04it/s]
2%|▏ | 19/1000 [00:02<03:10, 5.14it/s]
2%|▏ | 20/1000 [00:03<03:33, 4.60it/s]
2%|▏ | 22/1000 [00:03<02:36, 6.24it/s]
2%|▏ | 23/1000 [00:03<02:54, 5.59it/s]
2%|▎ | 25/1000 [00:03<02:12, 7.36it/s]
3%|▎ | 26/1000 [00:04<02:35, 6.26it/s]
3%|▎ | 28/1000 [00:04<02:42, 6.00it/s]
3%|▎ | 29/1000 [00:04<02:32, 6.37it/s]
3%|▎ | 30/1000 [00:04<02:42, 5.97it/s]
3%|▎ | 31/1000 [00:04<03:01, 5.35it/s]
3%|▎ | 32/1000 [00:05<02:41, 6.00it/s]
3%|▎ | 33/1000 [00:05<02:47, 5.76it/s]
4%|▎ | 35/1000 [00:05<02:05, 7.68it/s]
4%|▎ | 37/1000 [00:05<01:45, 9.12it/s]
4%|▍ | 39/1000 [00:05<02:06, 7.58it/s]
4%|▍ | 40/1000 [00:06<02:03, 7.75it/s]
4%|▍ | 42/1000 [00:06<01:45, 9.11it/s]
4%|▍ | 44/1000 [00:06<01:32, 10.35it/s]
5%|▍ | 46/1000 [00:06<01:45, 9.05it/s]
5%|▍ | 47/1000 [00:06<02:09, 7.37it/s]
5%|▍ | 49/1000 [00:06<01:48, 8.74it/s]
5%|▌ | 51/1000 [00:07<01:35, 9.90it/s]
5%|▌ | 53/1000 [00:07<01:26, 10.93it/s]
6%|▌ | 55/1000 [00:07<01:29, 10.59it/s]
6%|▌ | 57/1000 [00:07<01:42, 9.22it/s]
6%|▌ | 59/1000 [00:08<01:55, 8.16it/s]
6%|▌ | 61/1000 [00:08<01:40, 9.30it/s]
6%|▋ | 63/1000 [00:08<01:36, 9.73it/s]
6%|▋ | 65/1000 [00:08<01:51, 8.36it/s]
7%|▋ | 67/1000 [00:09<02:03, 7.57it/s]
7%|▋ | 69/1000 [00:09<01:52, 8.25it/s]
7%|▋ | 70/1000 [00:09<02:12, 6.99it/s]
7%|▋ | 72/1000 [00:09<02:18, 6.72it/s]
7%|▋ | 74/1000 [00:09<01:53, 8.13it/s]
8%|▊ | 75/1000 [00:10<02:14, 6.87it/s]
8%|▊ | 76/1000 [00:10<02:18, 6.67it/s]
8%|▊ | 78/1000 [00:10<02:25, 6.33it/s]
8%|▊ | 80/1000 [00:10<01:56, 7.87it/s]
8%|▊ | 82/1000 [00:10<01:39, 9.21it/s]
8%|▊ | 84/1000 [00:11<01:54, 8.02it/s]
8%|▊ | 85/1000 [00:11<02:14, 6.78it/s]
9%|▊ | 86/1000 [00:11<02:33, 5.95it/s]
9%|▊ | 87/1000 [00:12<02:49, 5.38it/s]
9%|▉ | 89/1000 [00:12<02:10, 7.00it/s]
9%|▉ | 90/1000 [00:12<02:05, 7.24it/s]
9%|▉ | 91/1000 [00:12<02:29, 6.08it/s]
9%|▉ | 92/1000 [00:12<02:27, 6.17it/s]
9%|▉ | 93/1000 [00:12<02:36, 5.78it/s]
10%|▉ | 95/1000 [00:13<02:43, 5.52it/s]
10%|▉ | 97/1000 [00:13<02:13, 6.78it/s]
10%|▉ | 99/1000 [00:13<01:47, 8.36it/s]
10%|█ | 101/1000 [00:13<01:33, 9.63it/s]
10%|█ | 103/1000 [00:14<01:55, 7.75it/s]
10%|█ | 104/1000 [00:14<01:54, 7.83it/s]
11%|█ | 106/1000 [00:14<01:35, 9.33it/s]
11%|█ | 108/1000 [00:14<01:25, 10.46it/s]
11%|█ | 110/1000 [00:14<01:19, 11.22it/s]
11%|█ | 112/1000 [00:14<01:13, 12.06it/s]
11%|█▏ | 114/1000 [00:14<01:10, 12.53it/s]
12%|█▏ | 116/1000 [00:15<01:08, 12.81it/s]
12%|█▏ | 118/1000 [00:15<01:06, 13.24it/s]
12%|█▏ | 120/1000 [00:15<02:07, 6.92it/s]
12%|█▏ | 122/1000 [00:15<01:48, 8.09it/s]
12%|█▏ | 124/1000 [00:16<01:57, 7.43it/s]
12%|█▎ | 125/1000 [00:16<02:32, 5.73it/s]
13%|█▎ | 126/1000 [00:16<02:22, 6.15it/s]
13%|█▎ | 127/1000 [00:16<02:30, 5.80it/s]
13%|█▎ | 128/1000 [00:17<02:45, 5.28it/s]
13%|█▎ | 130/1000 [00:17<02:05, 6.93it/s]
13%|█▎ | 132/1000 [00:17<01:41, 8.54it/s]
13%|█▎ | 134/1000 [00:17<01:26, 10.01it/s]
14%|█▎ | 136/1000 [00:17<01:30, 9.59it/s]
14%|█▍ | 138/1000 [00:18<01:27, 9.86it/s]
14%|█▍ | 140/1000 [00:18<01:26, 9.90it/s]
14%|█▍ | 142/1000 [00:18<01:35, 9.00it/s]
14%|█▍ | 143/1000 [00:18<01:36, 8.87it/s]
14%|█▍ | 145/1000 [00:18<01:25, 10.06it/s]
15%|█▍ | 147/1000 [00:19<01:41, 8.44it/s]
15%|█▍ | 148/1000 [00:19<01:40, 8.47it/s]
15%|█▌ | 150/1000 [00:19<01:25, 9.90it/s]
15%|█▌ | 152/1000 [00:19<01:16, 11.04it/s]
15%|█▌ | 154/1000 [00:19<01:21, 10.42it/s]
16%|█▌ | 156/1000 [00:20<02:06, 6.65it/s]
16%|█▌ | 158/1000 [00:20<01:45, 7.98it/s]
16%|█▌ | 160/1000 [00:20<01:37, 8.62it/s]
16%|█▌ | 162/1000 [00:20<01:47, 7.81it/s]
16%|█▋ | 163/1000 [00:21<01:51, 7.50it/s]
16%|█▋ | 164/1000 [00:21<02:10, 6.40it/s]
16%|█▋ | 165/1000 [00:21<02:27, 5.67it/s]
17%|█▋ | 166/1000 [00:21<02:40, 5.18it/s]
17%|█▋ | 167/1000 [00:21<02:24, 5.78it/s]
17%|█▋ | 169/1000 [00:22<01:45, 7.84it/s]
17%|█▋ | 171/1000 [00:22<01:55, 7.15it/s]
17%|█▋ | 172/1000 [00:22<02:14, 6.15it/s]
17%|█▋ | 173/1000 [00:22<02:12, 6.22it/s]
17%|█▋ | 174/1000 [00:22<02:02, 6.73it/s]
18%|█▊ | 176/1000 [00:23<01:37, 8.45it/s]
18%|█▊ | 177/1000 [00:23<02:00, 6.80it/s]
18%|█▊ | 179/1000 [00:23<01:35, 8.57it/s]
18%|█▊ | 180/1000 [00:23<01:36, 8.50it/s]
18%|█▊ | 181/1000 [00:23<02:01, 6.75it/s]
18%|█▊ | 182/1000 [00:24<02:22, 5.72it/s]
18%|█▊ | 183/1000 [00:24<02:20, 5.80it/s]
18%|█▊ | 185/1000 [00:24<01:45, 7.75it/s]
19%|█▊ | 186/1000 [00:24<01:43, 7.90it/s]
19%|█▊ | 187/1000 [00:24<02:07, 6.39it/s]
19%|█▉ | 189/1000 [00:24<01:40, 8.11it/s]
19%|█▉ | 190/1000 [00:25<02:02, 6.63it/s]
19%|█▉ | 192/1000 [00:25<02:04, 6.49it/s]
19%|█▉ | 194/1000 [00:25<02:06, 6.37it/s]
20%|█▉ | 196/1000 [00:25<01:43, 7.75it/s]
20%|█▉ | 198/1000 [00:26<01:27, 9.20it/s]
20%|██ | 200/1000 [00:26<01:14, 10.67it/s]
20%|██ | 202/1000 [00:26<01:30, 8.78it/s]
20%|██ | 204/1000 [00:26<01:34, 8.45it/s]
21%|██ | 206/1000 [00:26<01:21, 9.79it/s]
21%|██ | 208/1000 [00:27<01:33, 8.45it/s]
21%|██ | 210/1000 [00:27<01:33, 8.43it/s]
21%|██ | 212/1000 [00:27<01:22, 9.61it/s]
21%|██▏ | 214/1000 [00:27<01:30, 8.72it/s]
22%|██▏ | 216/1000 [00:28<01:27, 8.94it/s]
22%|██▏ | 217/1000 [00:28<01:46, 7.38it/s]
22%|██▏ | 219/1000 [00:28<01:31, 8.56it/s]
22%|██▏ | 220/1000 [00:28<02:05, 6.21it/s]
22%|██▏ | 221/1000 [00:28<02:05, 6.22it/s]
22%|██▏ | 223/1000 [00:29<02:20, 5.51it/s]
22%|██▏ | 224/1000 [00:29<02:08, 6.02it/s]
22%|██▎ | 225/1000 [00:29<02:07, 6.08it/s]
23%|██▎ | 226/1000 [00:29<02:23, 5.40it/s]
23%|██▎ | 228/1000 [00:30<01:53, 6.82it/s]
23%|██▎ | 229/1000 [00:30<02:10, 5.90it/s]
23%|██▎ | 230/1000 [00:30<02:00, 6.37it/s]
23%|██▎ | 232/1000 [00:30<01:35, 8.04it/s]
23%|██▎ | 233/1000 [00:30<01:33, 8.21it/s]
24%|██▎ | 235/1000 [00:30<01:16, 9.94it/s]
24%|██▎ | 237/1000 [00:31<01:20, 9.47it/s]
24%|██▍ | 239/1000 [00:31<01:24, 8.97it/s]
24%|██▍ | 241/1000 [00:31<01:30, 8.37it/s]
24%|██▍ | 242/1000 [00:31<02:05, 6.02it/s]
24%|██▍ | 243/1000 [00:32<02:18, 5.47it/s]
24%|██▍ | 244/1000 [00:32<02:03, 6.10it/s]
24%|██▍ | 245/1000 [00:32<01:54, 6.58it/s]
25%|██▍ | 247/1000 [00:32<01:27, 8.58it/s]
25%|██▍ | 248/1000 [00:32<01:49, 6.87it/s]
25%|██▍ | 249/1000 [00:33<02:07, 5.88it/s]
25%|██▌ | 250/1000 [00:33<02:09, 5.77it/s]
25%|██▌ | 252/1000 [00:33<02:04, 5.99it/s]
25%|██▌ | 253/1000 [00:33<02:10, 5.70it/s]
26%|██▌ | 255/1000 [00:33<01:41, 7.37it/s]
26%|██▌ | 256/1000 [00:34<01:36, 7.72it/s]
26%|██▌ | 258/1000 [00:34<01:24, 8.75it/s]
26%|██▌ | 260/1000 [00:34<01:36, 7.69it/s]
26%|██▌ | 261/1000 [00:34<01:53, 6.52it/s]
26%|██▌ | 262/1000 [00:34<01:54, 6.43it/s]
26%|██▋ | 264/1000 [00:35<01:56, 6.33it/s]
26%|██▋ | 265/1000 [00:35<01:51, 6.59it/s]
27%|██▋ | 266/1000 [00:35<01:46, 6.91it/s]
27%|██▋ | 268/1000 [00:35<01:37, 7.55it/s]
27%|██▋ | 270/1000 [00:36<01:43, 7.04it/s]
27%|██▋ | 271/1000 [00:36<02:14, 5.43it/s]
27%|██▋ | 273/1000 [00:36<02:07, 5.71it/s]
28%|██▊ | 275/1000 [00:36<01:48, 6.71it/s]
28%|██▊ | 277/1000 [00:37<01:29, 8.08it/s]
28%|██▊ | 278/1000 [00:37<01:46, 6.81it/s]
28%|██▊ | 280/1000 [00:37<01:48, 6.62it/s]
28%|██▊ | 282/1000 [00:37<01:29, 8.03it/s]
28%|██▊ | 283/1000 [00:38<02:02, 5.85it/s]
28%|██▊ | 284/1000 [00:38<02:05, 5.71it/s]
29%|██▊ | 286/1000 [00:38<01:36, 7.43it/s]
29%|██▉ | 288/1000 [00:38<01:21, 8.71it/s]
29%|██▉ | 290/1000 [00:38<01:31, 7.75it/s]
29%|██▉ | 291/1000 [00:39<01:41, 6.99it/s]
29%|██▉ | 292/1000 [00:39<01:56, 6.07it/s]
29%|██▉ | 294/1000 [00:39<01:38, 7.19it/s]
30%|██▉ | 296/1000 [00:39<01:42, 6.88it/s]
30%|██▉ | 298/1000 [00:40<01:25, 8.18it/s]
30%|██▉ | 299/1000 [00:40<01:48, 6.47it/s]
30%|███ | 300/1000 [00:40<01:42, 6.85it/s]
30%|███ | 301/1000 [00:40<01:37, 7.14it/s]
30%|███ | 303/1000 [00:40<01:19, 8.77it/s]
30%|███ | 304/1000 [00:40<01:26, 8.08it/s]
30%|███ | 305/1000 [00:41<01:25, 8.14it/s]
31%|███ | 306/1000 [00:41<01:39, 6.95it/s]
31%|███ | 307/1000 [00:41<01:41, 6.80it/s]
31%|███ | 309/1000 [00:41<01:18, 8.82it/s]
31%|███ | 311/1000 [00:41<01:07, 10.22it/s]
31%|███▏ | 313/1000 [00:41<01:01, 11.25it/s]
32%|███▏ | 315/1000 [00:42<01:06, 10.24it/s]
32%|███▏ | 317/1000 [00:42<01:11, 9.57it/s]
32%|███▏ | 319/1000 [00:42<01:34, 7.24it/s]
32%|███▏ | 321/1000 [00:43<01:39, 6.85it/s]
32%|███▏ | 322/1000 [00:43<01:45, 6.41it/s]
32%|███▏ | 324/1000 [00:43<01:27, 7.73it/s]
32%|███▎ | 325/1000 [00:43<01:58, 5.69it/s]
33%|███▎ | 327/1000 [00:43<01:31, 7.39it/s]
33%|███▎ | 328/1000 [00:44<01:33, 7.15it/s]
33%|███▎ | 330/1000 [00:44<01:38, 6.78it/s]
33%|███▎ | 332/1000 [00:44<01:41, 6.58it/s]
33%|███▎ | 333/1000 [00:44<01:35, 6.96it/s]
33%|███▎ | 334/1000 [00:44<01:44, 6.38it/s]
34%|███▎ | 336/1000 [00:45<01:22, 8.05it/s]
34%|███▍ | 338/1000 [00:45<01:15, 8.82it/s]
34%|███▍ | 340/1000 [00:45<01:05, 10.03it/s]
34%|███▍ | 342/1000 [00:45<01:00, 10.88it/s]
34%|███▍ | 344/1000 [00:46<01:26, 7.61it/s]
34%|███▍ | 345/1000 [00:46<01:24, 7.73it/s]
35%|███▍ | 346/1000 [00:46<01:30, 7.22it/s]
35%|███▍ | 347/1000 [00:46<01:28, 7.37it/s]
35%|███▍ | 349/1000 [00:46<01:34, 6.89it/s]
35%|███▌ | 350/1000 [00:47<01:49, 5.95it/s]
35%|███▌ | 352/1000 [00:47<01:24, 7.63it/s]
35%|███▌ | 354/1000 [00:47<01:25, 7.54it/s]
36%|███▌ | 355/1000 [00:47<01:27, 7.35it/s]
36%|███▌ | 357/1000 [00:47<01:11, 8.95it/s]
36%|███▌ | 359/1000 [00:47<01:00, 10.58it/s]
36%|███▌ | 361/1000 [00:48<01:07, 9.43it/s]
36%|███▋ | 363/1000 [00:48<01:28, 7.18it/s]
36%|███▋ | 364/1000 [00:48<01:41, 6.27it/s]
36%|███▋ | 365/1000 [00:49<02:09, 4.92it/s]
37%|███▋ | 367/1000 [00:49<01:58, 5.36it/s]
37%|███▋ | 368/1000 [00:49<02:05, 5.02it/s]
37%|███▋ | 369/1000 [00:49<01:52, 5.60it/s]
37%|███▋ | 371/1000 [00:49<01:23, 7.55it/s]
37%|███▋ | 372/1000 [00:50<01:21, 7.72it/s]
37%|███▋ | 374/1000 [00:50<01:17, 8.09it/s]
38%|███▊ | 375/1000 [00:50<01:40, 6.22it/s]
38%|███▊ | 376/1000 [00:50<01:53, 5.48it/s]
38%|███▊ | 378/1000 [00:51<01:29, 6.92it/s]
38%|███▊ | 380/1000 [00:51<01:10, 8.77it/s]
38%|███▊ | 382/1000 [00:51<01:18, 7.91it/s]
38%|███▊ | 384/1000 [00:51<01:06, 9.21it/s]
39%|███▊ | 386/1000 [00:51<01:06, 9.19it/s]
39%|███▉ | 388/1000 [00:52<01:25, 7.14it/s]
39%|███▉ | 390/1000 [00:52<01:19, 7.65it/s]
39%|███▉ | 391/1000 [00:52<01:22, 7.37it/s]
39%|███▉ | 393/1000 [00:52<01:09, 8.79it/s]
40%|███▉ | 395/1000 [00:53<01:20, 7.47it/s]
40%|███▉ | 397/1000 [00:53<01:08, 8.76it/s]
40%|███▉ | 399/1000 [00:53<01:36, 6.23it/s]
40%|████ | 400/1000 [00:54<01:45, 5.69it/s]
40%|████ | 402/1000 [00:54<01:40, 5.93it/s]
40%|████ | 404/1000 [00:54<01:22, 7.24it/s]
41%|████ | 406/1000 [00:54<01:09, 8.49it/s]
41%|████ | 408/1000 [00:55<01:32, 6.39it/s]
41%|████ | 410/1000 [00:55<01:31, 6.45it/s]
41%|████ | 411/1000 [00:55<01:40, 5.84it/s]
41%|████ | 412/1000 [00:55<01:49, 5.36it/s]
41%|████▏ | 414/1000 [00:56<01:23, 7.06it/s]
42%|████▏ | 416/1000 [00:56<01:25, 6.82it/s]
42%|████▏ | 418/1000 [00:56<01:10, 8.27it/s]
42%|████▏ | 420/1000 [00:56<01:08, 8.46it/s]
42%|████▏ | 421/1000 [00:56<01:17, 7.50it/s]
42%|████▏ | 423/1000 [00:57<01:26, 6.69it/s]
42%|████▏ | 424/1000 [00:57<01:37, 5.94it/s]
42%|████▎ | 425/1000 [00:57<01:30, 6.38it/s]
43%|████▎ | 427/1000 [00:57<01:11, 7.97it/s]
43%|████▎ | 428/1000 [00:57<01:15, 7.54it/s]
43%|████▎ | 429/1000 [00:58<01:12, 7.83it/s]
43%|████▎ | 431/1000 [00:58<00:59, 9.52it/s]
43%|████▎ | 433/1000 [00:58<00:51, 11.02it/s]
44%|████▎ | 435/1000 [00:58<00:47, 11.78it/s]
44%|████▎ | 437/1000 [00:58<00:53, 10.52it/s]
44%|████▍ | 439/1000 [00:59<01:09, 8.08it/s]
44%|████▍ | 441/1000 [00:59<01:00, 9.31it/s]
44%|████▍ | 443/1000 [00:59<01:08, 8.10it/s]
44%|████▍ | 444/1000 [00:59<01:16, 7.25it/s]
45%|████▍ | 446/1000 [00:59<01:03, 8.71it/s]
45%|████▍ | 448/1000 [01:00<01:13, 7.47it/s]
45%|████▌ | 450/1000 [01:00<01:18, 7.02it/s]
45%|████▌ | 451/1000 [01:00<01:28, 6.18it/s]
45%|████▌ | 452/1000 [01:01<01:38, 5.58it/s]
45%|████▌ | 454/1000 [01:01<01:16, 7.18it/s]
46%|████▌ | 456/1000 [01:01<01:03, 8.50it/s]
46%|████▌ | 457/1000 [01:01<01:09, 7.81it/s]
46%|████▌ | 459/1000 [01:01<00:58, 9.28it/s]
46%|████▌ | 461/1000 [01:01<00:49, 10.85it/s]
46%|████▋ | 463/1000 [01:02<01:10, 7.62it/s]
46%|████▋ | 465/1000 [01:02<01:19, 6.75it/s]
47%|████▋ | 466/1000 [01:02<01:28, 6.01it/s]
47%|████▋ | 467/1000 [01:03<01:50, 4.82it/s]
47%|████▋ | 469/1000 [01:03<01:24, 6.31it/s]
47%|████▋ | 471/1000 [01:03<01:07, 7.86it/s]
47%|████▋ | 473/1000 [01:03<01:09, 7.57it/s]
47%|████▋ | 474/1000 [01:03<01:20, 6.51it/s]
48%|████▊ | 476/1000 [01:04<01:21, 6.39it/s]
48%|████▊ | 477/1000 [01:04<01:35, 5.50it/s]
48%|████▊ | 479/1000 [01:04<01:12, 7.16it/s]
48%|████▊ | 480/1000 [01:04<01:18, 6.59it/s]
48%|████▊ | 482/1000 [01:05<01:04, 8.05it/s]
48%|████▊ | 484/1000 [01:05<01:10, 7.30it/s]
48%|████▊ | 485/1000 [01:05<01:21, 6.31it/s]
49%|████▊ | 486/1000 [01:05<01:21, 6.30it/s]
49%|████▉ | 488/1000 [01:05<01:03, 8.00it/s]
49%|████▉ | 489/1000 [01:06<01:17, 6.63it/s]
49%|████▉ | 491/1000 [01:06<01:01, 8.22it/s]
49%|████▉ | 492/1000 [01:06<01:01, 8.28it/s]
49%|████▉ | 494/1000 [01:06<00:50, 9.98it/s]
50%|████▉ | 496/1000 [01:06<00:59, 8.41it/s]
50%|████▉ | 498/1000 [01:07<00:59, 8.45it/s]
50%|████▉ | 499/1000 [01:07<01:15, 6.67it/s]
50%|█████ | 500/1000 [01:07<01:24, 5.93it/s]
50%|█████ | 502/1000 [01:07<01:05, 7.55it/s]
50%|█████ | 503/1000 [01:07<01:13, 6.80it/s]
50%|█████ | 505/1000 [01:08<01:15, 6.57it/s]
51%|█████ | 506/1000 [01:08<01:25, 5.81it/s]
51%|█████ | 508/1000 [01:08<01:06, 7.43it/s]
51%|█████ | 510/1000 [01:08<00:54, 8.96it/s]
51%|█████ | 512/1000 [01:08<00:48, 9.99it/s]
51%|█████▏ | 514/1000 [01:09<01:06, 7.30it/s]
52%|█████▏ | 515/1000 [01:09<01:04, 7.55it/s]
52%|█████▏ | 516/1000 [01:09<01:08, 7.11it/s]
52%|█████▏ | 518/1000 [01:09<00:59, 8.08it/s]
52%|█████▏ | 519/1000 [01:10<01:15, 6.39it/s]
52%|█████▏ | 521/1000 [01:10<00:59, 8.03it/s]
52%|█████▏ | 522/1000 [01:10<01:11, 6.68it/s]
52%|█████▏ | 523/1000 [01:10<01:22, 5.81it/s]
52%|█████▏ | 524/1000 [01:11<01:25, 5.56it/s]
53%|█████▎ | 526/1000 [01:11<01:11, 6.59it/s]
53%|█████▎ | 528/1000 [01:11<01:12, 6.55it/s]
53%|█████▎ | 529/1000 [01:11<01:13, 6.41it/s]
53%|█████▎ | 531/1000 [01:11<00:57, 8.13it/s]
53%|█████▎ | 533/1000 [01:11<00:47, 9.73it/s]
54%|█████▎ | 535/1000 [01:12<01:09, 6.70it/s]
54%|█████▎ | 536/1000 [01:12<01:12, 6.37it/s]
54%|█████▎ | 537/1000 [01:12<01:21, 5.66it/s]
54%|█████▍ | 539/1000 [01:13<01:17, 5.94it/s]
54%|█████▍ | 540/1000 [01:13<01:19, 5.77it/s]
54%|█████▍ | 541/1000 [01:13<01:27, 5.26it/s]
54%|█████▍ | 543/1000 [01:13<01:05, 6.94it/s]
55%|█████▍ | 545/1000 [01:14<01:04, 7.07it/s]
55%|█████▍ | 546/1000 [01:14<01:09, 6.51it/s]
55%|█████▍ | 547/1000 [01:14<01:19, 5.70it/s]
55%|█████▍ | 549/1000 [01:14<01:16, 5.92it/s]
55%|█████▌ | 551/1000 [01:14<00:59, 7.52it/s]
55%|█████▌ | 552/1000 [01:15<01:01, 7.28it/s]
55%|█████▌ | 553/1000 [01:15<01:12, 6.19it/s]
55%|█████▌ | 554/1000 [01:15<01:14, 5.95it/s]
56%|█████▌ | 556/1000 [01:15<00:57, 7.77it/s]
56%|█████▌ | 557/1000 [01:15<01:03, 7.03it/s]
56%|█████▌ | 559/1000 [01:16<00:49, 8.86it/s]
56%|█████▌ | 561/1000 [01:16<00:43, 10.05it/s]
56%|█████▋ | 563/1000 [01:16<00:52, 8.37it/s]
56%|█████▋ | 565/1000 [01:16<00:54, 7.98it/s]
57%|█████▋ | 566/1000 [01:17<01:04, 6.75it/s]
57%|█████▋ | 568/1000 [01:17<01:05, 6.56it/s]
57%|█████▋ | 569/1000 [01:17<01:06, 6.44it/s]
57%|█████▋ | 571/1000 [01:17<01:06, 6.44it/s]
57%|█████▋ | 572/1000 [01:17<01:07, 6.31it/s]
57%|█████▋ | 574/1000 [01:18<01:07, 6.35it/s]
58%|█████▊ | 576/1000 [01:18<00:54, 7.83it/s]
58%|█████▊ | 577/1000 [01:18<01:13, 5.73it/s]
58%|█████▊ | 578/1000 [01:19<01:20, 5.26it/s]
58%|█████▊ | 580/1000 [01:19<01:00, 6.99it/s]
58%|█████▊ | 582/1000 [01:19<00:48, 8.57it/s]
58%|█████▊ | 584/1000 [01:19<00:54, 7.60it/s]
58%|█████▊ | 585/1000 [01:19<00:59, 6.93it/s]
59%|█████▊ | 587/1000 [01:20<00:57, 7.17it/s]
59%|█████▉ | 589/1000 [01:20<00:48, 8.54it/s]
59%|█████▉ | 590/1000 [01:20<01:00, 6.75it/s]
59%|█████▉ | 592/1000 [01:20<00:49, 8.18it/s]
59%|█████▉ | 593/1000 [01:20<00:59, 6.80it/s]
60%|█████▉ | 595/1000 [01:21<00:48, 8.39it/s]
60%|█████▉ | 596/1000 [01:21<00:58, 6.87it/s]
60%|█████▉ | 597/1000 [01:21<01:00, 6.67it/s]
60%|█████▉ | 599/1000 [01:21<01:01, 6.47it/s]
60%|██████ | 601/1000 [01:22<01:02, 6.40it/s]
60%|██████ | 602/1000 [01:22<00:59, 6.71it/s]
60%|██████ | 604/1000 [01:22<01:09, 5.68it/s]
61%|██████ | 606/1000 [01:22<00:55, 7.10it/s]
61%|██████ | 608/1000 [01:23<00:49, 7.85it/s]
61%|██████ | 610/1000 [01:23<00:45, 8.48it/s]
61%|██████ | 612/1000 [01:23<00:39, 9.74it/s]
61%|██████▏ | 614/1000 [01:23<00:35, 10.83it/s]
62%|██████▏ | 616/1000 [01:23<00:50, 7.63it/s]
62%|██████▏ | 617/1000 [01:24<00:49, 7.76it/s]
62%|██████▏ | 619/1000 [01:24<00:41, 9.11it/s]
62%|██████▏ | 621/1000 [01:24<00:47, 8.03it/s]
62%|██████▏ | 623/1000 [01:24<00:45, 8.22it/s]
62%|██████▎ | 625/1000 [01:25<00:50, 7.46it/s]
63%|██████▎ | 627/1000 [01:25<00:43, 8.65it/s]
63%|██████▎ | 628/1000 [01:25<00:51, 7.19it/s]
63%|██████▎ | 629/1000 [01:25<00:59, 6.21it/s]
63%|██████▎ | 631/1000 [01:25<00:46, 7.85it/s]
63%|██████▎ | 633/1000 [01:25<00:38, 9.44it/s]
64%|██████▎ | 635/1000 [01:26<00:54, 6.72it/s]
64%|██████▎ | 636/1000 [01:26<00:51, 7.07it/s]
64%|██████▍ | 638/1000 [01:26<00:45, 7.95it/s]
64%|██████▍ | 640/1000 [01:26<00:39, 9.17it/s]
64%|██████▍ | 642/1000 [01:27<00:44, 7.97it/s]
64%|██████▍ | 643/1000 [01:27<00:46, 7.60it/s]
64%|██████▍ | 645/1000 [01:27<00:49, 7.11it/s]
65%|██████▍ | 647/1000 [01:27<00:46, 7.59it/s]
65%|██████▍ | 648/1000 [01:28<00:53, 6.53it/s]
65%|██████▌ | 650/1000 [01:28<00:53, 6.56it/s]
65%|██████▌ | 652/1000 [01:28<00:55, 6.32it/s]
65%|██████▌ | 654/1000 [01:28<00:44, 7.70it/s]
66%|██████▌ | 656/1000 [01:29<00:38, 8.92it/s]
66%|██████▌ | 658/1000 [01:29<00:42, 8.13it/s]
66%|██████▌ | 659/1000 [01:29<00:56, 6.01it/s]
66%|██████▌ | 661/1000 [01:29<00:44, 7.58it/s]
66%|██████▌ | 662/1000 [01:30<00:52, 6.49it/s]
66%|██████▋ | 664/1000 [01:30<00:58, 5.78it/s]
66%|██████▋ | 665/1000 [01:30<01:02, 5.33it/s]
67%|██████▋ | 667/1000 [01:31<00:59, 5.61it/s]
67%|██████▋ | 668/1000 [01:31<01:03, 5.20it/s]
67%|██████▋ | 669/1000 [01:31<00:58, 5.70it/s]
67%|██████▋ | 671/1000 [01:31<00:55, 5.88it/s]
67%|██████▋ | 673/1000 [01:32<00:49, 6.63it/s]
68%|██████▊ | 675/1000 [01:32<00:44, 7.27it/s]
68%|██████▊ | 677/1000 [01:32<00:37, 8.64it/s]
68%|██████▊ | 679/1000 [01:32<00:33, 9.68it/s]
68%|██████▊ | 681/1000 [01:32<00:29, 10.95it/s]
68%|██████▊ | 683/1000 [01:33<00:35, 8.91it/s]
68%|██████▊ | 685/1000 [01:33<00:31, 9.88it/s]
69%|██████▊ | 687/1000 [01:33<00:45, 6.87it/s]
69%|██████▉ | 688/1000 [01:33<00:43, 7.16it/s]
69%|██████▉ | 690/1000 [01:34<00:45, 6.81it/s]
69%|██████▉ | 692/1000 [01:34<00:39, 7.84it/s]
69%|██████▉ | 694/1000 [01:34<00:42, 7.27it/s]
70%|██████▉ | 695/1000 [01:34<00:41, 7.43it/s]
70%|██████▉ | 696/1000 [01:34<00:47, 6.34it/s]
70%|██████▉ | 698/1000 [01:35<00:43, 6.95it/s]
70%|██████▉ | 699/1000 [01:35<00:49, 6.05it/s]
70%|███████ | 701/1000 [01:35<00:39, 7.61it/s]
70%|███████ | 702/1000 [01:35<00:53, 5.62it/s]
70%|███████ | 704/1000 [01:36<00:40, 7.23it/s]
70%|███████ | 705/1000 [01:36<00:54, 5.42it/s]
71%|███████ | 707/1000 [01:36<00:41, 7.03it/s]
71%|███████ | 709/1000 [01:36<00:38, 7.62it/s]
71%|███████ | 710/1000 [01:37<00:44, 6.50it/s]
71%|███████ | 712/1000 [01:37<00:37, 7.70it/s]
71%|███████▏ | 713/1000 [01:37<00:36, 7.85it/s]
72%|███████▏ | 715/1000 [01:37<00:30, 9.35it/s]
72%|███████▏ | 717/1000 [01:37<00:35, 8.06it/s]
72%|███████▏ | 718/1000 [01:38<00:41, 6.80it/s]
72%|███████▏ | 719/1000 [01:38<00:47, 5.94it/s]
72%|███████▏ | 720/1000 [01:38<00:43, 6.46it/s]
72%|███████▏ | 722/1000 [01:38<00:34, 8.15it/s]
72%|███████▏ | 723/1000 [01:38<00:33, 8.22it/s]
72%|███████▏ | 724/1000 [01:38<00:33, 8.24it/s]
72%|███████▎ | 725/1000 [01:38<00:33, 8.31it/s]
73%|███████▎ | 727/1000 [01:39<00:26, 10.13it/s]
73%|███████▎ | 729/1000 [01:39<00:23, 11.61it/s]
73%|███████▎ | 731/1000 [01:39<00:32, 8.32it/s]
73%|███████▎ | 733/1000 [01:39<00:28, 9.52it/s]
74%|███████▎ | 735/1000 [01:39<00:26, 9.89it/s]
74%|███████▎ | 737/1000 [01:40<00:27, 9.55it/s]
74%|███████▍ | 739/1000 [01:40<00:26, 9.79it/s]
74%|███████▍ | 741/1000 [01:40<00:31, 8.31it/s]
74%|███████▍ | 743/1000 [01:40<00:30, 8.35it/s]
74%|███████▍ | 745/1000 [01:40<00:26, 9.61it/s]
75%|███████▍ | 747/1000 [01:41<00:24, 10.45it/s]
75%|███████▍ | 749/1000 [01:41<00:29, 8.65it/s]
75%|███████▌ | 750/1000 [01:41<00:32, 7.68it/s]
75%|███████▌ | 751/1000 [01:41<00:40, 6.16it/s]
75%|███████▌ | 753/1000 [01:42<00:34, 7.09it/s]
75%|███████▌ | 754/1000 [01:42<00:40, 6.15it/s]
76%|███████▌ | 756/1000 [01:42<00:38, 6.34it/s]
76%|███████▌ | 758/1000 [01:42<00:32, 7.52it/s]
76%|███████▌ | 759/1000 [01:43<00:33, 7.23it/s]
76%|███████▌ | 761/1000 [01:43<00:27, 8.64it/s]
76%|███████▋ | 763/1000 [01:43<00:31, 7.56it/s]
76%|███████▋ | 764/1000 [01:43<00:36, 6.55it/s]
77%|███████▋ | 766/1000 [01:44<00:36, 6.42it/s]
77%|███████▋ | 768/1000 [01:44<00:30, 7.73it/s]
77%|███████▋ | 769/1000 [01:44<00:34, 6.62it/s]
77%|███████▋ | 770/1000 [01:44<00:35, 6.55it/s]
77%|███████▋ | 772/1000 [01:44<00:28, 8.12it/s]
77%|███████▋ | 773/1000 [01:45<00:35, 6.37it/s]
77%|███████▋ | 774/1000 [01:45<00:33, 6.77it/s]
78%|███████▊ | 776/1000 [01:45<00:28, 7.89it/s]
78%|███████▊ | 778/1000 [01:45<00:23, 9.62it/s]
78%|███████▊ | 780/1000 [01:45<00:31, 6.95it/s]
78%|███████▊ | 782/1000 [01:46<00:25, 8.39it/s]
78%|███████▊ | 784/1000 [01:46<00:30, 7.16it/s]
79%|███████▊ | 786/1000 [01:46<00:28, 7.53it/s]
79%|███████▉ | 788/1000 [01:46<00:25, 8.37it/s]
79%|███████▉ | 790/1000 [01:47<00:23, 9.00it/s]
79%|███████▉ | 791/1000 [01:47<00:25, 8.23it/s]
79%|███████▉ | 792/1000 [01:47<00:26, 7.73it/s]
79%|███████▉ | 793/1000 [01:47<00:25, 7.96it/s]
80%|███████▉ | 795/1000 [01:47<00:28, 7.19it/s]
80%|███████▉ | 797/1000 [01:48<00:29, 6.86it/s]
80%|███████▉ | 798/1000 [01:48<00:33, 6.01it/s]
80%|████████ | 800/1000 [01:48<00:29, 6.71it/s]
80%|████████ | 802/1000 [01:48<00:25, 7.64it/s]
80%|████████ | 804/1000 [01:49<00:25, 7.83it/s]
81%|████████ | 806/1000 [01:49<00:21, 9.17it/s]
81%|████████ | 807/1000 [01:49<00:21, 8.97it/s]
81%|████████ | 809/1000 [01:49<00:18, 10.20it/s]
81%|████████ | 811/1000 [01:49<00:16, 11.23it/s]
81%|████████▏ | 813/1000 [01:49<00:20, 9.05it/s]
82%|████████▏ | 815/1000 [01:50<00:19, 9.31it/s]
82%|████████▏ | 817/1000 [01:50<00:22, 8.14it/s]
82%|████████▏ | 819/1000 [01:50<00:19, 9.20it/s]
82%|████████▏ | 821/1000 [01:50<00:22, 8.05it/s]
82%|████████▏ | 823/1000 [01:51<00:22, 7.81it/s]
82%|████████▏ | 824/1000 [01:51<00:26, 6.75it/s]
82%|████████▎ | 825/1000 [01:51<00:25, 7.00it/s]
83%|████████▎ | 826/1000 [01:51<00:29, 5.81it/s]
83%|████████▎ | 828/1000 [01:52<00:32, 5.24it/s]
83%|████████▎ | 829/1000 [01:52<00:29, 5.74it/s]
83%|████████▎ | 831/1000 [01:52<00:24, 7.02it/s]
83%|████████▎ | 832/1000 [01:52<00:29, 5.75it/s]
83%|████████▎ | 833/1000 [01:52<00:26, 6.23it/s]
83%|████████▎ | 834/1000 [01:53<00:27, 6.02it/s]
84%|████████▎ | 835/1000 [01:53<00:25, 6.53it/s]
84%|████████▎ | 836/1000 [01:53<00:26, 6.12it/s]
84%|████████▍ | 838/1000 [01:53<00:21, 7.46it/s]
84%|████████▍ | 840/1000 [01:53<00:24, 6.63it/s]
84%|████████▍ | 842/1000 [01:54<00:19, 8.16it/s]
84%|████████▍ | 844/1000 [01:54<00:24, 6.43it/s]
84%|████████▍ | 845/1000 [01:54<00:26, 5.77it/s]
85%|████████▍ | 847/1000 [01:55<00:24, 6.26it/s]
85%|████████▍ | 849/1000 [01:55<00:19, 7.56it/s]
85%|████████▌ | 850/1000 [01:55<00:23, 6.50it/s]
85%|████████▌ | 851/1000 [01:55<00:21, 6.88it/s]
85%|████████▌ | 853/1000 [01:55<00:17, 8.48it/s]
86%|████████▌ | 855/1000 [01:55<00:14, 10.06it/s]
86%|████████▌ | 857/1000 [01:56<00:13, 10.22it/s]
86%|████████▌ | 859/1000 [01:56<00:16, 8.53it/s]
86%|████████▌ | 861/1000 [01:56<00:14, 9.77it/s]
86%|████████▋ | 863/1000 [01:56<00:12, 10.63it/s]
86%|████████▋ | 865/1000 [01:56<00:11, 11.72it/s]
87%|████████▋ | 867/1000 [01:57<00:14, 9.33it/s]
87%|████████▋ | 869/1000 [01:57<00:12, 10.29it/s]
87%|████████▋ | 871/1000 [01:57<00:11, 11.29it/s]
87%|████████▋ | 873/1000 [01:57<00:16, 7.78it/s]
88%|████████▊ | 875/1000 [01:58<00:16, 7.63it/s]
88%|████████▊ | 877/1000 [01:58<00:13, 8.87it/s]
88%|████████▊ | 879/1000 [01:58<00:17, 6.87it/s]
88%|████████▊ | 881/1000 [01:58<00:15, 7.59it/s]
88%|████████▊ | 882/1000 [01:59<00:18, 6.55it/s]
88%|████████▊ | 884/1000 [01:59<00:14, 7.96it/s]
89%|████████▊ | 886/1000 [01:59<00:12, 9.18it/s]
89%|████████▉ | 888/1000 [01:59<00:10, 10.35it/s]
89%|████████▉ | 890/1000 [01:59<00:11, 9.77it/s]
89%|████████▉ | 892/1000 [01:59<00:10, 10.76it/s]
89%|████████▉ | 894/1000 [02:00<00:13, 7.62it/s]
90%|████████▉ | 896/1000 [02:00<00:11, 8.85it/s]
90%|████████▉ | 898/1000 [02:01<00:15, 6.53it/s]
90%|█████████ | 900/1000 [02:01<00:12, 7.70it/s]
90%|█████████ | 902/1000 [02:01<00:12, 7.87it/s]
90%|█████████ | 904/1000 [02:01<00:10, 9.07it/s]
91%|█████████ | 906/1000 [02:02<00:13, 7.04it/s]
91%|█████████ | 908/1000 [02:02<00:11, 8.32it/s]
91%|█████████ | 910/1000 [02:02<00:11, 7.60it/s]
91%|█████████ | 912/1000 [02:02<00:10, 8.79it/s]
91%|█████████▏| 914/1000 [02:02<00:11, 7.39it/s]
92%|█████████▏| 916/1000 [02:03<00:11, 7.08it/s]
92%|█████████▏| 917/1000 [02:03<00:11, 7.37it/s]
92%|█████████▏| 918/1000 [02:03<00:14, 5.60it/s]
92%|█████████▏| 919/1000 [02:03<00:14, 5.70it/s]
92%|█████████▏| 921/1000 [02:04<00:14, 5.57it/s]
92%|█████████▏| 922/1000 [02:04<00:13, 5.93it/s]
92%|█████████▏| 924/1000 [02:04<00:10, 7.17it/s]
93%|█████████▎| 926/1000 [02:04<00:08, 8.66it/s]
93%|█████████▎| 927/1000 [02:04<00:09, 8.09it/s]
93%|█████████▎| 928/1000 [02:05<00:10, 6.64it/s]
93%|█████████▎| 930/1000 [02:05<00:10, 6.47it/s]
93%|█████████▎| 931/1000 [02:05<00:10, 6.83it/s]
93%|█████████▎| 933/1000 [02:05<00:10, 6.62it/s]
93%|█████████▎| 934/1000 [02:06<00:10, 6.17it/s]
94%|█████████▎| 936/1000 [02:06<00:08, 7.31it/s]
94%|█████████▍| 938/1000 [02:06<00:07, 8.85it/s]
94%|█████████▍| 939/1000 [02:06<00:07, 8.06it/s]
94%|█████████▍| 940/1000 [02:06<00:07, 8.16it/s]
94%|█████████▍| 942/1000 [02:07<00:09, 6.34it/s]
94%|█████████▍| 944/1000 [02:07<00:07, 7.08it/s]
95%|█████████▍| 946/1000 [02:07<00:06, 8.39it/s]
95%|█████████▍| 948/1000 [02:07<00:05, 9.72it/s]
95%|█████████▌| 950/1000 [02:07<00:05, 8.84it/s]
95%|█████████▌| 952/1000 [02:08<00:06, 7.42it/s]
95%|█████████▌| 954/1000 [02:08<00:07, 6.17it/s]
96%|█████████▌| 956/1000 [02:08<00:05, 7.40it/s]
96%|█████████▌| 957/1000 [02:09<00:06, 6.41it/s]
96%|█████████▌| 959/1000 [02:09<00:07, 5.77it/s]
96%|█████████▌| 961/1000 [02:09<00:05, 6.81it/s]
96%|█████████▌| 962/1000 [02:09<00:06, 6.05it/s]
96%|█████████▋| 964/1000 [02:10<00:04, 7.51it/s]
96%|█████████▋| 965/1000 [02:10<00:05, 6.45it/s]
97%|█████████▋| 966/1000 [02:10<00:05, 6.34it/s]
97%|█████████▋| 968/1000 [02:10<00:03, 8.02it/s]
97%|█████████▋| 970/1000 [02:10<00:03, 9.42it/s]
97%|█████████▋| 972/1000 [02:11<00:03, 8.03it/s]
97%|█████████▋| 974/1000 [02:11<00:02, 9.21it/s]
98%|█████████▊| 976/1000 [02:11<00:02, 9.80it/s]
98%|█████████▊| 978/1000 [02:11<00:02, 10.82it/s]
98%|█████████▊| 980/1000 [02:11<00:02, 8.45it/s]
98%|█████████▊| 981/1000 [02:12<00:02, 7.07it/s]
98%|█████████▊| 982/1000 [02:12<00:03, 5.45it/s]
98%|█████████▊| 984/1000 [02:12<00:02, 6.94it/s]
99%|█████████▊| 986/1000 [02:12<00:01, 8.38it/s]
99%|█████████▉| 988/1000 [02:13<00:01, 6.74it/s]
99%|█████████▉| 989/1000 [02:13<00:01, 6.00it/s]
99%|█████████▉| 991/1000 [02:13<00:01, 6.15it/s]
99%|█████████▉| 992/1000 [02:14<00:01, 4.98it/s]
99%|█████████▉| 994/1000 [02:14<00:00, 6.55it/s]
100%|█████████▉| 995/1000 [02:14<00:00, 5.52it/s]
100%|█████████▉| 997/1000 [02:14<00:00, 7.05it/s]
100%|█████████▉| 999/1000 [02:15<00:00, 6.77it/s]
100%|██████████| 1000/1000 [02:15<00:00, 6.67it/s]
{'eval_loss': '0.7551', 'eval_runtime': '135.4', 'eval_samples_per_second': '7.385', 'eval_steps_per_second': '7.385', 'epoch': '0.6621', 'num_input_tokens_seen': 8055352}
66%|██████▌ | 1200/1813 [2:14:02<1:06:29, 6.51s/it]
100%|██████████| 1000/1000 [02:15<00:00, 6.67it/s]

66%|██████▌ | 1201/1813 [2:14:07<7:57:45, 46.84s/it]
66%|██████▋ | 1202/1813 [2:14:14<5:54:42, 34.83s/it]
66%|██████▋ | 1203/1813 [2:14:20<4:27:22, 26.30s/it]
66%|██████▋ | 1204/1813 [2:14:27<3:26:51, 20.38s/it]
66%|██████▋ | 1205/1813 [2:14:34<2:45:04, 16.29s/it]
67%|██████▋ | 1206/1813 [2:14:40<2:14:25, 13.29s/it]
67%|██████▋ | 1207/1813 [2:14:46<1:53:19, 11.22s/it]
67%|██████▋ | 1208/1813 [2:14:54<1:42:26, 10.16s/it]
67%|██████▋ | 1209/1813 [2:15:01<1:32:15, 9.16s/it]
67%|██████▋ | 1210/1813 [2:15:07<1:22:47, 8.24s/it]
{'loss': '0.921', 'grad_norm': '1.073', 'learning_rate': '5.833e-05', 'epoch': '0.6676', 'num_input_tokens_seen': 8125224, 'train_runtime': '8107', 'train_tokens_per_second': '1002'}
67%|██████▋ | 1210/1813 [2:15:07<1:22:47, 8.24s/it]
67%|██████▋ | 1211/1813 [2:15:14<1:18:48, 7.86s/it]
67%|██████▋ | 1212/1813 [2:15:18<1:08:07, 6.80s/it]
67%|██████▋ | 1213/1813 [2:15:25<1:07:15, 6.73s/it]
67%|██████▋ | 1214/1813 [2:15:33<1:12:26, 7.26s/it]
67%|██████▋ | 1215/1813 [2:15:40<1:10:04, 7.03s/it]
67%|██████▋ | 1216/1813 [2:15:47<1:10:32, 7.09s/it]
67%|██████▋ | 1217/1813 [2:15:53<1:07:31, 6.80s/it]
67%|██████▋ | 1218/1813 [2:16:00<1:06:14, 6.68s/it]
67%|██████▋ | 1219/1813 [2:16:05<1:02:35, 6.32s/it]
67%|██████▋ | 1220/1813 [2:16:13<1:07:58, 6.88s/it]
{'loss': '0.9406', 'grad_norm': '14.71', 'learning_rate': '5.662e-05', 'epoch': '0.6731', 'num_input_tokens_seen': 8197488, 'train_runtime': '8174', 'train_tokens_per_second': '1003'}
67%|██████▋ | 1220/1813 [2:16:13<1:07:58, 6.88s/it]
67%|██████▋ | 1221/1813 [2:16:18<1:03:08, 6.40s/it]
67%|██████▋ | 1222/1813 [2:16:23<58:47, 5.97s/it]
67%|██████▋ | 1223/1813 [2:16:29<57:21, 5.83s/it]
68%|██████▊ | 1224/1813 [2:16:34<55:27, 5.65s/it]
68%|██████▊ | 1225/1813 [2:16:40<57:01, 5.82s/it]
68%|██████▊ | 1226/1813 [2:16:47<58:00, 5.93s/it]
68%|██████▊ | 1227/1813 [2:16:53<1:00:00, 6.14s/it]
68%|██████▊ | 1228/1813 [2:16:59<57:24, 5.89s/it]
68%|██████▊ | 1229/1813 [2:17:05<59:12, 6.08s/it]
68%|██████▊ | 1230/1813 [2:17:11<58:48, 6.05s/it]
{'loss': '0.7933', 'grad_norm': '0.8689', 'learning_rate': '5.493e-05', 'epoch': '0.6786', 'num_input_tokens_seen': 8257288, 'train_runtime': '8232', 'train_tokens_per_second': '1003'}
68%|██████▊ | 1230/1813 [2:17:11<58:48, 6.05s/it]
68%|██████▊ | 1231/1813 [2:17:18<1:02:41, 6.46s/it]
68%|██████▊ | 1232/1813 [2:17:26<1:04:46, 6.69s/it]
68%|██████▊ | 1233/1813 [2:17:32<1:02:59, 6.52s/it]
68%|██████▊ | 1234/1813 [2:17:38<1:01:02, 6.33s/it]
68%|██████▊ | 1235/1813 [2:17:44<1:00:16, 6.26s/it]
68%|██████▊ | 1236/1813 [2:17:52<1:06:31, 6.92s/it]
68%|██████▊ | 1237/1813 [2:17:58<1:04:33, 6.72s/it]
68%|██████▊ | 1238/1813 [2:18:04<1:00:33, 6.32s/it]
68%|██████▊ | 1239/1813 [2:18:09<57:00, 5.96s/it]
68%|██████▊ | 1240/1813 [2:18:14<54:24, 5.70s/it]
{'loss': '0.7911', 'grad_norm': '0.9318', 'learning_rate': '5.325e-05', 'epoch': '0.6841', 'num_input_tokens_seen': 8327600, 'train_runtime': '8295', 'train_tokens_per_second': '1004'}
68%|██████▊ | 1240/1813 [2:18:14<54:24, 5.70s/it]
68%|██████▊ | 1241/1813 [2:18:20<54:14, 5.69s/it]
69%|██████▊ | 1242/1813 [2:18:26<54:50, 5.76s/it]
69%|██████▊ | 1243/1813 [2:18:32<55:48, 5.87s/it]
69%|██████▊ | 1244/1813 [2:18:39<58:54, 6.21s/it]
69%|██████▊ | 1245/1813 [2:18:46<1:02:03, 6.55s/it]
69%|██████▊ | 1246/1813 [2:18:52<1:00:30, 6.40s/it]
69%|██████▉ | 1247/1813 [2:18:59<1:02:08, 6.59s/it]
69%|██████▉ | 1248/1813 [2:19:06<1:02:30, 6.64s/it]
69%|██████▉ | 1249/1813 [2:19:12<1:01:08, 6.50s/it]
69%|██████▉ | 1250/1813 [2:19:17<55:36, 5.93s/it]
{'loss': '0.9418', 'grad_norm': '1.292', 'learning_rate': '5.159e-05', 'epoch': '0.6897', 'num_input_tokens_seen': 8394824, 'train_runtime': '8357', 'train_tokens_per_second': '1004'}
69%|██████▉ | 1250/1813 [2:19:17<55:36, 5.93s/it]
69%|██████▉ | 1251/1813 [2:19:23<56:12, 6.00s/it]
69%|██████▉ | 1252/1813 [2:19:29<55:00, 5.88s/it]
69%|██████▉ | 1253/1813 [2:19:34<54:48, 5.87s/it]
69%|██████▉ | 1254/1813 [2:19:41<56:24, 6.06s/it]
69%|██████▉ | 1255/1813 [2:19:47<57:00, 6.13s/it]
69%|██████▉ | 1256/1813 [2:19:53<56:53, 6.13s/it]
69%|██████▉ | 1257/1813 [2:19:59<55:45, 6.02s/it]
69%|██████▉ | 1258/1813 [2:20:06<57:35, 6.23s/it]
69%|██████▉ | 1259/1813 [2:20:13<58:56, 6.38s/it]
69%|██████▉ | 1260/1813 [2:20:20<1:00:41, 6.59s/it]
{'loss': '0.9137', 'grad_norm': '1.113', 'learning_rate': '4.995e-05', 'epoch': '0.6952', 'num_input_tokens_seen': 8461096, 'train_runtime': '8420', 'train_tokens_per_second': '1005'}
69%|██████▉ | 1260/1813 [2:20:20<1:00:41, 6.59s/it]
70%|██████▉ | 1261/1813 [2:20:28<1:05:01, 7.07s/it]
70%|██████▉ | 1262/1813 [2:20:35<1:06:14, 7.21s/it]
70%|██████▉ | 1263/1813 [2:20:43<1:06:09, 7.22s/it]
70%|██████▉ | 1264/1813 [2:20:48<1:01:55, 6.77s/it]
70%|██████▉ | 1265/1813 [2:20:53<57:34, 6.30s/it]
70%|██████▉ | 1266/1813 [2:21:01<1:01:29, 6.74s/it]
70%|██████▉ | 1267/1813 [2:21:07<57:39, 6.34s/it]
70%|██████▉ | 1268/1813 [2:21:12<54:08, 5.96s/it]
70%|██████▉ | 1269/1813 [2:21:17<52:14, 5.76s/it]
70%|███████ | 1270/1813 [2:21:23<52:57, 5.85s/it]
{'loss': '0.8917', 'grad_norm': '1.074', 'learning_rate': '4.832e-05', 'epoch': '0.7007', 'num_input_tokens_seen': 8529224, 'train_runtime': '8484', 'train_tokens_per_second': '1005'}
70%|███████ | 1270/1813 [2:21:23<52:57, 5.85s/it]
70%|███████ | 1271/1813 [2:21:28<49:42, 5.50s/it]
70%|███████ | 1272/1813 [2:21:35<53:28, 5.93s/it]
70%|███████ | 1273/1813 [2:21:42<56:27, 6.27s/it]
70%|███████ | 1274/1813 [2:21:49<59:39, 6.64s/it]
70%|███████ | 1275/1813 [2:21:56<59:54, 6.68s/it]
70%|███████ | 1276/1813 [2:22:02<56:47, 6.35s/it]
70%|███████ | 1277/1813 [2:22:09<58:28, 6.55s/it]
70%|███████ | 1278/1813 [2:22:14<55:21, 6.21s/it]
71%|███████ | 1279/1813 [2:22:19<51:07, 5.74s/it]
71%|███████ | 1280/1813 [2:22:26<54:10, 6.10s/it]
{'loss': '0.9203', 'grad_norm': '1.26', 'learning_rate': '4.671e-05', 'epoch': '0.7062', 'num_input_tokens_seen': 8596456, 'train_runtime': '8546', 'train_tokens_per_second': '1006'}
71%|███████ | 1280/1813 [2:22:26<54:10, 6.10s/it]
71%|███████ | 1281/1813 [2:22:31<51:29, 5.81s/it]
71%|███████ | 1282/1813 [2:22:37<52:36, 5.94s/it]
71%|███████ | 1283/1813 [2:22:44<54:23, 6.16s/it]
71%|███████ | 1284/1813 [2:22:49<53:18, 6.05s/it]
71%|███████ | 1285/1813 [2:22:55<51:44, 5.88s/it]
71%|███████ | 1286/1813 [2:23:02<55:18, 6.30s/it]
71%|███████ | 1287/1813 [2:23:08<54:54, 6.26s/it]
71%|███████ | 1288/1813 [2:23:14<52:18, 5.98s/it]
71%|███████ | 1289/1813 [2:23:21<54:28, 6.24s/it]
71%|███████ | 1290/1813 [2:23:28<57:01, 6.54s/it]
{'loss': '0.9674', 'grad_norm': '0.7892', 'learning_rate': '4.512e-05', 'epoch': '0.7117', 'num_input_tokens_seen': 8662472, 'train_runtime': '8608', 'train_tokens_per_second': '1006'}
71%|███████ | 1290/1813 [2:23:28<57:01, 6.54s/it]
71%|███████ | 1291/1813 [2:23:34<56:02, 6.44s/it]
71%|███████▏ | 1292/1813 [2:23:41<57:21, 6.61s/it]
71%|███████▏ | 1293/1813 [2:23:48<58:43, 6.78s/it]
71%|███████▏ | 1294/1813 [2:23:55<57:31, 6.65s/it]
71%|███████▏ | 1295/1813 [2:24:00<55:29, 6.43s/it]
71%|███████▏ | 1296/1813 [2:24:06<52:29, 6.09s/it]
72%|███████▏ | 1297/1813 [2:24:11<50:49, 5.91s/it]
72%|███████▏ | 1298/1813 [2:24:18<52:52, 6.16s/it]
72%|███████▏ | 1299/1813 [2:24:25<54:58, 6.42s/it]
72%|███████▏ | 1300/1813 [2:24:31<54:15, 6.35s/it]
{'loss': '0.8595', 'grad_norm': '1.249', 'learning_rate': '4.355e-05', 'epoch': '0.7172', 'num_input_tokens_seen': 8730600, 'train_runtime': '8672', 'train_tokens_per_second': '1007'}
72%|███████▏ | 1300/1813 [2:24:31<54:15, 6.35s/it]
72%|███████▏ | 1301/1813 [2:24:37<52:33, 6.16s/it]
72%|███████▏ | 1302/1813 [2:24:43<53:30, 6.28s/it]
72%|███████▏ | 1303/1813 [2:24:51<57:00, 6.71s/it]
72%|███████▏ | 1304/1813 [2:24:57<53:49, 6.35s/it]
72%|███████▏ | 1305/1813 [2:25:04<56:25, 6.66s/it]
72%|███████▏ | 1306/1813 [2:25:10<53:53, 6.38s/it]
72%|███████▏ | 1307/1813 [2:25:16<54:14, 6.43s/it]
72%|███████▏ | 1308/1813 [2:25:23<54:29, 6.47s/it]
72%|███████▏ | 1309/1813 [2:25:29<54:09, 6.45s/it]
72%|███████▏ | 1310/1813 [2:25:36<55:45, 6.65s/it]
{'loss': '0.9525', 'grad_norm': '1.013', 'learning_rate': '4.2e-05', 'epoch': '0.7228', 'num_input_tokens_seen': 8802000, 'train_runtime': '8737', 'train_tokens_per_second': '1007'}
72%|███████▏ | 1310/1813 [2:25:36<55:45, 6.65s/it]
72%|███████▏ | 1311/1813 [2:25:43<54:51, 6.56s/it]
72%|███████▏ | 1312/1813 [2:25:49<52:43, 6.31s/it]
72%|███████▏ | 1313/1813 [2:25:55<52:14, 6.27s/it]
72%|███████▏ | 1314/1813 [2:26:01<52:13, 6.28s/it]
73%|███████▎ | 1315/1813 [2:26:07<50:25, 6.08s/it]
73%|███████▎ | 1316/1813 [2:26:12<49:31, 5.98s/it]
73%|███████▎ | 1317/1813 [2:26:18<49:23, 5.98s/it]
73%|███████▎ | 1318/1813 [2:26:24<47:58, 5.82s/it]
73%|███████▎ | 1319/1813 [2:26:30<49:30, 6.01s/it]
73%|███████▎ | 1320/1813 [2:26:37<50:57, 6.20s/it]
{'loss': '0.9255', 'grad_norm': '0.8742', 'learning_rate': '4.048e-05', 'epoch': '0.7283', 'num_input_tokens_seen': 8866824, 'train_runtime': '8797', 'train_tokens_per_second': '1008'}
73%|███████▎ | 1320/1813 [2:26:37<50:57, 6.20s/it]
73%|███████▎ | 1321/1813 [2:26:44<51:53, 6.33s/it]
73%|███████▎ | 1322/1813 [2:26:50<51:25, 6.29s/it]
73%|███████▎ | 1323/1813 [2:26:56<52:19, 6.41s/it]
73%|███████▎ | 1324/1813 [2:27:03<51:32, 6.33s/it]
73%|███████▎ | 1325/1813 [2:27:09<50:38, 6.23s/it]
73%|███████▎ | 1326/1813 [2:27:15<50:53, 6.27s/it]
73%|███████▎ | 1327/1813 [2:27:23<54:27, 6.72s/it]
73%|███████▎ | 1328/1813 [2:27:30<54:44, 6.77s/it]
73%|███████▎ | 1329/1813 [2:27:36<53:12, 6.60s/it]
73%|███████▎ | 1330/1813 [2:27:41<50:42, 6.30s/it]
{'loss': '0.8798', 'grad_norm': '1.073', 'learning_rate': '3.897e-05', 'epoch': '0.7338', 'num_input_tokens_seen': 8935584, 'train_runtime': '8862', 'train_tokens_per_second': '1008'}
73%|███████▎ | 1330/1813 [2:27:41<50:42, 6.30s/it]
73%|███████▎ | 1331/1813 [2:27:47<49:01, 6.10s/it]
73%|███████▎ | 1332/1813 [2:27:53<48:02, 5.99s/it]
74%|███████▎ | 1333/1813 [2:27:59<47:43, 5.97s/it]
74%|███████▎ | 1334/1813 [2:28:04<46:54, 5.88s/it]
74%|███████▎ | 1335/1813 [2:28:10<46:03, 5.78s/it]
74%|███████▎ | 1336/1813 [2:28:16<47:12, 5.94s/it]
74%|███████▎ | 1337/1813 [2:28:24<50:43, 6.39s/it]
74%|███████▍ | 1338/1813 [2:28:31<52:53, 6.68s/it]
74%|███████▍ | 1339/1813 [2:28:36<49:40, 6.29s/it]
74%|███████▍ | 1340/1813 [2:28:43<50:46, 6.44s/it]
{'loss': '0.9731', 'grad_norm': '1.005', 'learning_rate': '3.748e-05', 'epoch': '0.7393', 'num_input_tokens_seen': 9000416, 'train_runtime': '8924', 'train_tokens_per_second': '1009'}
74%|███████▍ | 1340/1813 [2:28:43<50:46, 6.44s/it]
74%|███████▍ | 1341/1813 [2:28:49<50:25, 6.41s/it]
74%|███████▍ | 1342/1813 [2:28:55<47:29, 6.05s/it]
74%|███████▍ | 1343/1813 [2:29:00<46:04, 5.88s/it]
74%|███████▍ | 1344/1813 [2:29:06<46:10, 5.91s/it]
74%|███████▍ | 1345/1813 [2:29:14<50:12, 6.44s/it]
74%|███████▍ | 1346/1813 [2:29:20<49:59, 6.42s/it]
74%|███████▍ | 1347/1813 [2:29:26<48:11, 6.20s/it]
74%|███████▍ | 1348/1813 [2:29:32<48:23, 6.24s/it]
74%|███████▍ | 1349/1813 [2:29:39<49:32, 6.41s/it]
74%|███████▍ | 1350/1813 [2:29:45<48:07, 6.24s/it]
{'loss': '0.9161', 'grad_norm': '1.297', 'learning_rate': '3.602e-05', 'epoch': '0.7448', 'num_input_tokens_seen': 9066864, 'train_runtime': '8985', 'train_tokens_per_second': '1009'}
74%|███████▍ | 1350/1813 [2:29:45<48:07, 6.24s/it]
75%|███████▍ | 1351/1813 [2:29:53<52:00, 6.75s/it]
75%|███████▍ | 1352/1813 [2:29:59<50:45, 6.61s/it]
75%|███████▍ | 1353/1813 [2:30:06<51:06, 6.67s/it]
75%|███████▍ | 1354/1813 [2:30:13<51:17, 6.70s/it]
75%|███████▍ | 1355/1813 [2:30:21<55:14, 7.24s/it]
75%|███████▍ | 1356/1813 [2:30:27<51:39, 6.78s/it]
75%|███████▍ | 1357/1813 [2:30:33<49:46, 6.55s/it]
75%|███████▍ | 1358/1813 [2:30:39<49:44, 6.56s/it]
75%|███████▍ | 1359/1813 [2:30:45<47:39, 6.30s/it]
75%|███████▌ | 1360/1813 [2:30:51<46:41, 6.19s/it]
{'loss': '0.868', 'grad_norm': '1.254', 'learning_rate': '3.458e-05', 'epoch': '0.7503', 'num_input_tokens_seen': 9140520, 'train_runtime': '9052', 'train_tokens_per_second': '1010'}
75%|███████▌ | 1360/1813 [2:30:51<46:41, 6.19s/it]
75%|███████▌ | 1361/1813 [2:30:58<48:15, 6.41s/it]
75%|███████▌ | 1362/1813 [2:31:05<48:32, 6.46s/it]
75%|███████▌ | 1363/1813 [2:31:12<50:46, 6.77s/it]
75%|███████▌ | 1364/1813 [2:31:18<48:49, 6.52s/it]
75%|███████▌ | 1365/1813 [2:31:26<50:49, 6.81s/it]
75%|███████▌ | 1366/1813 [2:31:31<48:45, 6.55s/it]
75%|███████▌ | 1367/1813 [2:31:38<48:43, 6.55s/it]
75%|███████▌ | 1368/1813 [2:31:43<45:51, 6.18s/it]
76%|███████▌ | 1369/1813 [2:31:51<50:07, 6.77s/it]
76%|███████▌ | 1370/1813 [2:31:57<48:12, 6.53s/it]
{'loss': '0.8542', 'grad_norm': '1.008', 'learning_rate': '3.316e-05', 'epoch': '0.7559', 'num_input_tokens_seen': 9213048, 'train_runtime': '9118', 'train_tokens_per_second': '1010'}
76%|███████▌ | 1370/1813 [2:31:57<48:12, 6.53s/it]
76%|███████▌ | 1371/1813 [2:32:05<51:21, 6.97s/it]
76%|███████▌ | 1372/1813 [2:32:11<47:20, 6.44s/it]
76%|███████▌ | 1373/1813 [2:32:17<46:21, 6.32s/it]
76%|███████▌ | 1374/1813 [2:32:23<45:18, 6.19s/it]
76%|███████▌ | 1375/1813 [2:32:28<44:02, 6.03s/it]
76%|███████▌ | 1376/1813 [2:32:34<42:22, 5.82s/it]
76%|███████▌ | 1377/1813 [2:32:40<42:55, 5.91s/it]
76%|███████▌ | 1378/1813 [2:32:45<41:55, 5.78s/it]
76%|███████▌ | 1379/1813 [2:32:51<42:12, 5.84s/it]
76%|███████▌ | 1380/1813 [2:32:58<44:32, 6.17s/it]
{'loss': '0.8455', 'grad_norm': '1.114', 'learning_rate': '3.177e-05', 'epoch': '0.7614', 'num_input_tokens_seen': 9279088, 'train_runtime': '9179', 'train_tokens_per_second': '1011'}
76%|███████▌ | 1380/1813 [2:32:58<44:32, 6.17s/it]
76%|███████▌ | 1381/1813 [2:33:05<46:03, 6.40s/it]
76%|███████▌ | 1382/1813 [2:33:10<43:40, 6.08s/it]
76%|███████▋ | 1383/1813 [2:33:16<43:05, 6.01s/it]
76%|███████▋ | 1384/1813 [2:33:22<42:58, 6.01s/it]
76%|███████▋ | 1385/1813 [2:33:29<44:47, 6.28s/it]
76%|███████▋ | 1386/1813 [2:33:36<45:24, 6.38s/it]
77%|███████▋ | 1387/1813 [2:33:43<47:04, 6.63s/it]
77%|███████▋ | 1388/1813 [2:33:49<44:49, 6.33s/it]
77%|███████▋ | 1389/1813 [2:33:53<41:09, 5.83s/it]
77%|███████▋ | 1390/1813 [2:34:00<43:15, 6.14s/it]
{'loss': '0.9327', 'grad_norm': '1.097', 'learning_rate': '3.04e-05', 'epoch': '0.7669', 'num_input_tokens_seen': 9344880, 'train_runtime': '9241', 'train_tokens_per_second': '1011'}
77%|███████▋ | 1390/1813 [2:34:00<43:15, 6.14s/it]
77%|███████▋ | 1391/1813 [2:34:05<41:10, 5.85s/it]
77%|███████▋ | 1392/1813 [2:34:12<42:35, 6.07s/it]
77%|███████▋ | 1393/1813 [2:34:17<40:54, 5.84s/it]
77%|███████▋ | 1394/1813 [2:34:24<42:52, 6.14s/it]
77%|███████▋ | 1395/1813 [2:34:30<43:25, 6.23s/it]
77%|███████▋ | 1396/1813 [2:34:37<43:31, 6.26s/it]
77%|███████▋ | 1397/1813 [2:34:44<44:47, 6.46s/it]
77%|███████▋ | 1398/1813 [2:34:48<41:02, 5.93s/it]
77%|███████▋ | 1399/1813 [2:34:53<38:37, 5.60s/it]
77%|███████▋ | 1400/1813 [2:35:00<40:45, 5.92s/it]
{'loss': '0.8799', 'grad_norm': '0.9047', 'learning_rate': '2.906e-05', 'epoch': '0.7724', 'num_input_tokens_seen': 9408280, 'train_runtime': '9300', 'train_tokens_per_second': '1012'}
77%|███████▋ | 1400/1813 [2:35:00<40:45, 5.92s/it]
77%|███████▋ | 1401/1813 [2:35:05<40:01, 5.83s/it]
77%|███████▋ | 1402/1813 [2:35:12<40:46, 5.95s/it]
77%|███████▋ | 1403/1813 [2:35:18<42:09, 6.17s/it]
77%|███████▋ | 1404/1813 [2:35:25<42:22, 6.22s/it]
77%|███████▋ | 1405/1813 [2:35:30<39:37, 5.83s/it]
78%|███████▊ | 1406/1813 [2:35:35<39:27, 5.82s/it]
78%|███████▊ | 1407/1813 [2:35:42<41:05, 6.07s/it]
78%|███████▊ | 1408/1813 [2:35:47<39:01, 5.78s/it]
78%|███████▊ | 1409/1813 [2:35:52<36:28, 5.42s/it]
78%|███████▊ | 1410/1813 [2:35:57<36:57, 5.50s/it]
{'loss': '0.9233', 'grad_norm': '1.028', 'learning_rate': '2.774e-05', 'epoch': '0.7779', 'num_input_tokens_seen': 9467408, 'train_runtime': '9358', 'train_tokens_per_second': '1012'}
78%|███████▊ | 1410/1813 [2:35:57<36:57, 5.50s/it]
78%|███████▊ | 1411/1813 [2:36:03<37:04, 5.53s/it]
78%|███████▊ | 1412/1813 [2:36:10<38:46, 5.80s/it]
78%|███████▊ | 1413/1813 [2:36:15<38:27, 5.77s/it]
78%|███████▊ | 1414/1813 [2:36:22<39:23, 5.92s/it]
78%|███████▊ | 1415/1813 [2:36:29<41:57, 6.33s/it]
78%|███████▊ | 1416/1813 [2:36:35<41:42, 6.30s/it]
78%|███████▊ | 1417/1813 [2:36:41<40:07, 6.08s/it]
78%|███████▊ | 1418/1813 [2:36:47<39:45, 6.04s/it]
78%|███████▊ | 1419/1813 [2:36:55<44:54, 6.84s/it]
78%|███████▊ | 1420/1813 [2:37:00<40:39, 6.21s/it]
{'loss': '0.8733', 'grad_norm': '1.122', 'learning_rate': '2.644e-05', 'epoch': '0.7834', 'num_input_tokens_seen': 9532720, 'train_runtime': '9420', 'train_tokens_per_second': '1012'}
78%|███████▊ | 1420/1813 [2:37:00<40:39, 6.21s/it]
78%|███████▊ | 1421/1813 [2:37:07<42:09, 6.45s/it]
78%|███████▊ | 1422/1813 [2:37:13<40:43, 6.25s/it]
78%|███████▊ | 1423/1813 [2:37:19<39:48, 6.12s/it]
79%|███████▊ | 1424/1813 [2:37:26<42:04, 6.49s/it]
79%|███████▊ | 1425/1813 [2:37:30<38:09, 5.90s/it]
79%|███████▊ | 1426/1813 [2:37:39<43:11, 6.70s/it]
79%|███████▊ | 1427/1813 [2:37:44<40:29, 6.29s/it]
79%|███████▉ | 1428/1813 [2:37:51<40:50, 6.37s/it]
79%|███████▉ | 1429/1813 [2:37:57<40:17, 6.30s/it]
79%|███████▉ | 1430/1813 [2:38:04<41:12, 6.46s/it]
{'loss': '0.8383', 'grad_norm': '0.9834', 'learning_rate': '2.518e-05', 'epoch': '0.789', 'num_input_tokens_seen': 9602112, 'train_runtime': '9484', 'train_tokens_per_second': '1012'}
79%|███████▉ | 1430/1813 [2:38:04<41:12, 6.46s/it]
79%|███████▉ | 1431/1813 [2:38:10<40:25, 6.35s/it]
79%|███████▉ | 1432/1813 [2:38:16<39:23, 6.20s/it]
79%|███████▉ | 1433/1813 [2:38:22<39:41, 6.27s/it]
79%|███████▉ | 1434/1813 [2:38:29<39:55, 6.32s/it]
79%|███████▉ | 1435/1813 [2:38:34<38:38, 6.13s/it]
79%|███████▉ | 1436/1813 [2:38:41<40:06, 6.38s/it]
79%|███████▉ | 1437/1813 [2:38:47<39:07, 6.24s/it]
79%|███████▉ | 1438/1813 [2:38:55<40:54, 6.55s/it]
79%|███████▉ | 1439/1813 [2:39:00<38:40, 6.20s/it]
79%|███████▉ | 1440/1813 [2:39:05<36:17, 5.84s/it]
{'loss': '0.8573', 'grad_norm': '0.998', 'learning_rate': '2.394e-05', 'epoch': '0.7945', 'num_input_tokens_seen': 9667112, 'train_runtime': '9545', 'train_tokens_per_second': '1013'}
79%|███████▉ | 1440/1813 [2:39:05<36:17, 5.84s/it]
79%|███████▉ | 1441/1813 [2:39:11<37:10, 6.00s/it]
80%|███████▉ | 1442/1813 [2:39:16<35:35, 5.76s/it]
80%|███████▉ | 1443/1813 [2:39:21<34:03, 5.52s/it]
80%|███████▉ | 1444/1813 [2:39:28<36:11, 5.89s/it]
80%|███████▉ | 1445/1813 [2:39:34<35:26, 5.78s/it]
80%|███████▉ | 1446/1813 [2:39:39<34:40, 5.67s/it]
80%|███████▉ | 1447/1813 [2:39:47<39:11, 6.42s/it]
80%|███████▉ | 1448/1813 [2:39:55<40:29, 6.66s/it]
80%|███████▉ | 1449/1813 [2:40:01<40:06, 6.61s/it]
80%|███████▉ | 1450/1813 [2:40:07<39:39, 6.56s/it]
{'loss': '0.9389', 'grad_norm': '1.036', 'learning_rate': '2.273e-05', 'epoch': '0.8', 'num_input_tokens_seen': 9735792, 'train_runtime': '9608', 'train_tokens_per_second': '1013'}
80%|███████▉ | 1450/1813 [2:40:07<39:39, 6.56s/it]
80%|████████ | 1451/1813 [2:40:14<40:22, 6.69s/it]
80%|████████ | 1452/1813 [2:40:19<36:31, 6.07s/it]
80%|████████ | 1453/1813 [2:40:27<40:31, 6.75s/it]
80%|████████ | 1454/1813 [2:40:33<37:50, 6.32s/it]
80%|████████ | 1455/1813 [2:40:39<37:26, 6.28s/it]
80%|████████ | 1456/1813 [2:40:46<38:45, 6.51s/it]
80%|████████ | 1457/1813 [2:40:50<33:27, 5.64s/it]
80%|████████ | 1458/1813 [2:40:55<33:07, 5.60s/it]
80%|████████ | 1459/1813 [2:41:02<35:30, 6.02s/it]
81%|████████ | 1460/1813 [2:41:09<37:26, 6.36s/it]
{'loss': '0.8932', 'grad_norm': '1.063', 'learning_rate': '2.154e-05', 'epoch': '0.8055', 'num_input_tokens_seen': 9802968, 'train_runtime': '9670', 'train_tokens_per_second': '1014'}
81%|████████ | 1460/1813 [2:41:09<37:26, 6.36s/it]
81%|████████ | 1461/1813 [2:41:15<36:26, 6.21s/it]
81%|████████ | 1462/1813 [2:41:20<34:41, 5.93s/it]
81%|████████ | 1463/1813 [2:41:28<37:15, 6.39s/it]
81%|████████ | 1464/1813 [2:41:34<37:32, 6.46s/it]
81%|████████ | 1465/1813 [2:41:43<40:31, 6.99s/it]
81%|████████ | 1466/1813 [2:41:48<37:39, 6.51s/it]
81%|████████ | 1467/1813 [2:41:55<38:58, 6.76s/it]
81%|████████ | 1468/1813 [2:42:02<38:29, 6.69s/it]
81%|████████ | 1469/1813 [2:42:11<41:56, 7.31s/it]
81%|████████ | 1470/1813 [2:42:17<40:33, 7.09s/it]
{'loss': '0.9012', 'grad_norm': '0.9799', 'learning_rate': '2.038e-05', 'epoch': '0.811', 'num_input_tokens_seen': 9879232, 'train_runtime': '9738', 'train_tokens_per_second': '1015'}
81%|████████ | 1470/1813 [2:42:17<40:33, 7.09s/it]
81%|████████ | 1471/1813 [2:42:23<38:45, 6.80s/it]
81%|████████ | 1472/1813 [2:42:30<38:19, 6.74s/it]
81%|████████ | 1473/1813 [2:42:36<36:37, 6.46s/it]
81%|████████▏ | 1474/1813 [2:42:42<36:41, 6.49s/it]
81%|████████▏ | 1475/1813 [2:42:49<36:02, 6.40s/it]
81%|████████▏ | 1476/1813 [2:42:55<35:39, 6.35s/it]
81%|████████▏ | 1477/1813 [2:43:01<35:49, 6.40s/it]
82%|████████▏ | 1478/1813 [2:43:07<34:31, 6.18s/it]
82%|████████▏ | 1479/1813 [2:43:13<34:25, 6.18s/it]
82%|████████▏ | 1480/1813 [2:43:20<35:53, 6.47s/it]
{'loss': '0.8726', 'grad_norm': '0.8065', 'learning_rate': '1.925e-05', 'epoch': '0.8166', 'num_input_tokens_seen': 9948032, 'train_runtime': '9801', 'train_tokens_per_second': '1015'}
82%|████████▏ | 1480/1813 [2:43:20<35:53, 6.47s/it]
82%|████████▏ | 1481/1813 [2:43:27<36:16, 6.55s/it]
82%|████████▏ | 1482/1813 [2:43:33<34:42, 6.29s/it]
82%|████████▏ | 1483/1813 [2:43:40<35:37, 6.48s/it]
82%|████████▏ | 1484/1813 [2:43:46<35:34, 6.49s/it]
82%|████████▏ | 1485/1813 [2:43:53<35:39, 6.52s/it]
82%|████████▏ | 1486/1813 [2:43:58<33:25, 6.13s/it]
82%|████████▏ | 1487/1813 [2:44:06<36:07, 6.65s/it]
82%|████████▏ | 1488/1813 [2:44:12<35:24, 6.54s/it]
82%|████████▏ | 1489/1813 [2:44:20<36:39, 6.79s/it]
82%|████████▏ | 1490/1813 [2:44:26<36:43, 6.82s/it]
{'loss': '0.887', 'grad_norm': '1.024', 'learning_rate': '1.815e-05', 'epoch': '0.8221', 'num_input_tokens_seen': 10021400, 'train_runtime': '9867', 'train_tokens_per_second': '1016'}
82%|████████▏ | 1490/1813 [2:44:26<36:43, 6.82s/it]
82%|████████▏ | 1491/1813 [2:44:32<34:52, 6.50s/it]
82%|████████▏ | 1492/1813 [2:44:40<37:32, 7.02s/it]
82%|████████▏ | 1493/1813 [2:44:47<36:39, 6.87s/it]
82%|████████▏ | 1494/1813 [2:44:54<36:26, 6.85s/it]
82%|████████▏ | 1495/1813 [2:45:02<39:10, 7.39s/it]
83%|████████▎ | 1496/1813 [2:45:08<35:53, 6.79s/it]
83%|████████▎ | 1497/1813 [2:45:13<33:32, 6.37s/it]
83%|████████▎ | 1498/1813 [2:45:20<34:30, 6.57s/it]
83%|████████▎ | 1499/1813 [2:45:25<32:23, 6.19s/it]
83%|████████▎ | 1500/1813 [2:45:34<36:02, 6.91s/it]
{'loss': '0.8516', 'grad_norm': '0.9367', 'learning_rate': '1.708e-05', 'epoch': '0.8276', 'num_input_tokens_seen': 10089904, 'train_runtime': '9935', 'train_tokens_per_second': '1016'}
83%|████████▎ | 1500/1813 [2:45:34<36:02, 6.91s/it]
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:12, 13.83it/s]
0%| | 5/1000 [00:00<02:38, 6.29it/s]
1%| | 6/1000 [00:00<02:24, 6.90it/s]
1%| | 7/1000 [00:00<02:20, 7.09it/s]
1%| | 9/1000 [00:01<03:05, 5.34it/s]
1%| | 11/1000 [00:01<02:25, 6.81it/s]
1%| | 12/1000 [00:01<02:23, 6.89it/s]
1%|▏ | 13/1000 [00:02<02:54, 5.66it/s]
1%|▏ | 14/1000 [00:02<02:56, 5.60it/s]
2%|▏ | 15/1000 [00:02<03:28, 4.73it/s]
2%|▏ | 16/1000 [00:02<03:32, 4.64it/s]
2%|▏ | 18/1000 [00:03<03:13, 5.09it/s]
2%|▏ | 19/1000 [00:03<03:51, 4.24it/s]
2%|▏ | 20/1000 [00:03<04:17, 3.81it/s]
2%|▏ | 22/1000 [00:03<03:04, 5.29it/s]
2%|▏ | 23/1000 [00:04<03:29, 4.67it/s]
2%|▎ | 25/1000 [00:04<02:37, 6.20it/s]
3%|▎ | 26/1000 [00:04<03:02, 5.34it/s]
3%|▎ | 27/1000 [00:04<02:42, 5.99it/s]
3%|▎ | 28/1000 [00:05<03:21, 4.82it/s]
3%|▎ | 29/1000 [00:05<03:03, 5.29it/s]
3%|▎ | 30/1000 [00:05<03:14, 4.98it/s]
3%|▎ | 31/1000 [00:05<03:40, 4.39it/s]
3%|▎ | 32/1000 [00:05<03:14, 4.99it/s]
3%|▎ | 33/1000 [00:06<03:18, 4.87it/s]
4%|▎ | 35/1000 [00:06<02:25, 6.63it/s]
4%|▎ | 37/1000 [00:06<02:01, 7.94it/s]
4%|▍ | 39/1000 [00:06<02:26, 6.56it/s]
4%|▍ | 40/1000 [00:07<02:22, 6.73it/s]
4%|▍ | 42/1000 [00:07<02:00, 7.97it/s]
4%|▍ | 44/1000 [00:07<01:49, 8.77it/s]
4%|▍ | 45/1000 [00:07<02:10, 7.30it/s]
5%|▍ | 47/1000 [00:07<02:25, 6.54it/s]
5%|▍ | 49/1000 [00:08<02:03, 7.72it/s]
5%|▌ | 51/1000 [00:08<01:48, 8.72it/s]
5%|▌ | 53/1000 [00:08<01:38, 9.58it/s]
6%|▌ | 55/1000 [00:08<01:43, 9.16it/s]
6%|▌ | 56/1000 [00:08<02:06, 7.49it/s]
6%|▌ | 58/1000 [00:09<01:57, 8.03it/s]
6%|▌ | 59/1000 [00:09<02:15, 6.93it/s]
6%|▌ | 61/1000 [00:09<01:55, 8.16it/s]
6%|▋ | 63/1000 [00:09<01:49, 8.59it/s]
6%|▋ | 64/1000 [00:10<02:21, 6.60it/s]
7%|▋ | 66/1000 [00:10<01:59, 7.82it/s]
7%|▋ | 67/1000 [00:10<02:28, 6.30it/s]
7%|▋ | 69/1000 [00:10<02:10, 7.11it/s]
7%|▋ | 70/1000 [00:11<02:42, 5.74it/s]
7%|▋ | 72/1000 [00:11<02:45, 5.62it/s]
7%|▋ | 74/1000 [00:11<02:12, 6.97it/s]
8%|▊ | 75/1000 [00:11<02:37, 5.88it/s]
8%|▊ | 76/1000 [00:12<02:45, 5.59it/s]
8%|▊ | 77/1000 [00:12<02:29, 6.16it/s]
8%|▊ | 78/1000 [00:12<02:57, 5.19it/s]
8%|▊ | 80/1000 [00:12<02:13, 6.89it/s]
8%|▊ | 82/1000 [00:12<01:54, 8.03it/s]
8%|▊ | 83/1000 [00:13<02:24, 6.35it/s]
8%|▊ | 85/1000 [00:13<02:35, 5.89it/s]
9%|▊ | 86/1000 [00:13<02:57, 5.16it/s]
9%|▊ | 87/1000 [00:14<03:14, 4.68it/s]
9%|▉ | 89/1000 [00:14<02:28, 6.12it/s]
9%|▉ | 90/1000 [00:14<02:23, 6.34it/s]
9%|▉ | 91/1000 [00:14<02:51, 5.31it/s]
9%|▉ | 92/1000 [00:14<02:48, 5.38it/s]
9%|▉ | 93/1000 [00:15<03:00, 5.02it/s]
9%|▉ | 94/1000 [00:15<02:38, 5.71it/s]
10%|▉ | 95/1000 [00:15<03:23, 4.45it/s]
10%|▉ | 97/1000 [00:15<02:34, 5.83it/s]
10%|▉ | 99/1000 [00:15<02:01, 7.41it/s]
10%|█ | 101/1000 [00:16<01:44, 8.60it/s]
10%|█ | 102/1000 [00:16<02:14, 6.66it/s]
10%|█ | 103/1000 [00:16<02:16, 6.59it/s]
10%|█ | 104/1000 [00:16<02:13, 6.72it/s]
11%|█ | 106/1000 [00:16<01:46, 8.39it/s]
11%|█ | 108/1000 [00:16<01:34, 9.47it/s]
11%|█ | 110/1000 [00:17<01:27, 10.12it/s]
11%|█ | 112/1000 [00:17<01:21, 10.86it/s]
11%|█▏ | 114/1000 [00:17<01:21, 10.81it/s]
12%|█▏ | 116/1000 [00:17<01:20, 11.03it/s]
12%|█▏ | 118/1000 [00:17<01:16, 11.48it/s]
12%|█▏ | 120/1000 [00:18<02:29, 5.89it/s]
12%|█▏ | 122/1000 [00:18<02:06, 6.92it/s]
12%|█▏ | 124/1000 [00:19<02:18, 6.33it/s]
12%|█▎ | 125/1000 [00:19<02:59, 4.88it/s]
13%|█▎ | 126/1000 [00:19<02:46, 5.26it/s]
13%|█▎ | 127/1000 [00:19<02:55, 4.97it/s]
13%|█▎ | 128/1000 [00:20<03:11, 4.56it/s]
13%|█▎ | 130/1000 [00:20<02:22, 6.13it/s]
13%|█▎ | 132/1000 [00:20<01:54, 7.55it/s]
13%|█▎ | 134/1000 [00:20<01:40, 8.57it/s]
14%|█▎ | 135/1000 [00:20<01:51, 7.74it/s]
14%|█▎ | 137/1000 [00:20<01:44, 8.25it/s]
14%|█▍ | 139/1000 [00:21<01:41, 8.50it/s]
14%|█▍ | 140/1000 [00:21<01:39, 8.66it/s]
14%|█▍ | 141/1000 [00:21<01:42, 8.40it/s]
14%|█▍ | 142/1000 [00:21<01:52, 7.62it/s]
14%|█▍ | 143/1000 [00:21<01:58, 7.21it/s]
14%|█▍ | 145/1000 [00:21<01:38, 8.68it/s]
15%|█▍ | 147/1000 [00:22<01:59, 7.13it/s]
15%|█▍ | 148/1000 [00:22<01:57, 7.25it/s]
15%|█▌ | 150/1000 [00:22<01:38, 8.60it/s]
15%|█▌ | 152/1000 [00:22<01:27, 9.66it/s]
15%|█▌ | 154/1000 [00:23<01:32, 9.16it/s]
16%|█▌ | 155/1000 [00:23<02:04, 6.81it/s]
16%|█▌ | 156/1000 [00:23<02:38, 5.31it/s]
16%|█▌ | 158/1000 [00:23<02:06, 6.65it/s]
16%|█▌ | 160/1000 [00:24<01:53, 7.41it/s]
16%|█▌ | 162/1000 [00:24<02:05, 6.69it/s]
16%|█▋ | 163/1000 [00:24<02:10, 6.43it/s]
16%|█▋ | 164/1000 [00:24<02:32, 5.49it/s]
16%|█▋ | 165/1000 [00:25<02:55, 4.76it/s]
17%|█▋ | 166/1000 [00:25<03:09, 4.39it/s]
17%|█▋ | 167/1000 [00:25<02:48, 4.95it/s]
17%|█▋ | 169/1000 [00:25<02:02, 6.77it/s]
17%|█▋ | 171/1000 [00:26<02:13, 6.22it/s]
17%|█▋ | 172/1000 [00:26<02:35, 5.33it/s]
17%|█▋ | 173/1000 [00:26<02:33, 5.39it/s]
17%|█▋ | 174/1000 [00:26<02:21, 5.86it/s]
18%|█▊ | 176/1000 [00:26<01:54, 7.17it/s]
18%|█▊ | 177/1000 [00:27<02:20, 5.85it/s]
18%|█▊ | 179/1000 [00:27<01:50, 7.44it/s]
18%|█▊ | 180/1000 [00:27<01:50, 7.41it/s]
18%|█▊ | 181/1000 [00:27<02:19, 5.85it/s]
18%|█▊ | 182/1000 [00:28<02:46, 4.91it/s]
18%|█▊ | 183/1000 [00:28<02:46, 4.91it/s]
18%|█▊ | 185/1000 [00:28<02:02, 6.63it/s]
19%|█▊ | 186/1000 [00:28<01:59, 6.81it/s]
19%|█▊ | 187/1000 [00:28<02:26, 5.54it/s]
19%|█▉ | 189/1000 [00:28<01:54, 7.07it/s]
19%|█▉ | 190/1000 [00:29<02:19, 5.79it/s]
19%|█▉ | 192/1000 [00:29<02:22, 5.68it/s]
19%|█▉ | 194/1000 [00:29<02:23, 5.61it/s]
20%|█▉ | 196/1000 [00:30<01:57, 6.82it/s]
20%|█▉ | 198/1000 [00:30<01:39, 8.08it/s]
20%|██ | 200/1000 [00:30<01:24, 9.42it/s]
20%|██ | 202/1000 [00:30<01:43, 7.71it/s]
20%|██ | 204/1000 [00:31<01:44, 7.60it/s]
21%|██ | 206/1000 [00:31<01:30, 8.80it/s]
21%|██ | 208/1000 [00:31<01:45, 7.50it/s]
21%|██ | 210/1000 [00:31<01:46, 7.45it/s]
21%|██ | 212/1000 [00:32<01:32, 8.50it/s]
21%|██▏ | 213/1000 [00:32<01:42, 7.69it/s]
21%|██▏ | 214/1000 [00:32<01:42, 7.70it/s]
22%|██▏ | 216/1000 [00:32<01:36, 8.15it/s]
22%|██▏ | 217/1000 [00:32<02:01, 6.44it/s]
22%|██▏ | 219/1000 [00:32<01:40, 7.74it/s]
22%|██▏ | 220/1000 [00:33<02:24, 5.39it/s]
22%|██▏ | 221/1000 [00:33<02:23, 5.42it/s]
22%|██▏ | 223/1000 [00:34<02:42, 4.78it/s]
22%|██▏ | 224/1000 [00:34<02:28, 5.23it/s]
22%|██▎ | 225/1000 [00:34<02:26, 5.28it/s]
23%|██▎ | 226/1000 [00:34<02:44, 4.70it/s]
23%|██▎ | 228/1000 [00:34<02:09, 5.96it/s]
23%|██▎ | 229/1000 [00:35<02:29, 5.16it/s]
23%|██▎ | 230/1000 [00:35<02:18, 5.58it/s]
23%|██▎ | 232/1000 [00:35<01:48, 7.05it/s]
23%|██▎ | 233/1000 [00:35<01:46, 7.20it/s]
24%|██▎ | 235/1000 [00:35<01:29, 8.54it/s]
24%|██▎ | 236/1000 [00:35<01:30, 8.42it/s]
24%|██▎ | 237/1000 [00:36<01:34, 8.08it/s]
24%|██▍ | 239/1000 [00:36<01:39, 7.69it/s]
24%|██▍ | 241/1000 [00:36<01:46, 7.15it/s]
24%|██▍ | 242/1000 [00:37<02:34, 4.90it/s]
24%|██▍ | 243/1000 [00:37<02:47, 4.52it/s]
24%|██▍ | 245/1000 [00:37<02:13, 5.64it/s]
25%|██▍ | 247/1000 [00:37<01:48, 6.91it/s]
25%|██▍ | 248/1000 [00:38<02:09, 5.81it/s]
25%|██▍ | 249/1000 [00:38<02:27, 5.10it/s]
25%|██▌ | 250/1000 [00:38<02:28, 5.05it/s]
25%|██▌ | 252/1000 [00:38<02:23, 5.23it/s]
25%|██▌ | 253/1000 [00:39<02:30, 4.98it/s]
26%|██▌ | 255/1000 [00:39<01:55, 6.42it/s]
26%|██▌ | 256/1000 [00:39<01:54, 6.51it/s]
26%|██▌ | 258/1000 [00:39<01:39, 7.49it/s]
26%|██▌ | 260/1000 [00:39<01:51, 6.66it/s]
26%|██▌ | 261/1000 [00:40<02:10, 5.68it/s]
26%|██▌ | 262/1000 [00:40<02:15, 5.45it/s]
26%|██▋ | 264/1000 [00:40<02:15, 5.44it/s]
26%|██▋ | 265/1000 [00:40<02:09, 5.69it/s]
27%|██▋ | 266/1000 [00:41<02:02, 5.99it/s]
27%|██▋ | 268/1000 [00:41<01:51, 6.55it/s]
27%|██▋ | 270/1000 [00:41<01:59, 6.13it/s]
27%|██▋ | 271/1000 [00:42<02:37, 4.62it/s]
27%|██▋ | 273/1000 [00:42<02:28, 4.89it/s]
28%|██▊ | 275/1000 [00:42<02:08, 5.64it/s]
28%|██▊ | 277/1000 [00:42<01:45, 6.82it/s]
28%|██▊ | 278/1000 [00:43<02:03, 5.83it/s]
28%|██▊ | 280/1000 [00:43<02:05, 5.73it/s]
28%|██▊ | 282/1000 [00:43<01:43, 6.96it/s]
28%|██▊ | 283/1000 [00:44<02:24, 4.96it/s]
28%|██▊ | 284/1000 [00:44<02:27, 4.85it/s]
29%|██▊ | 286/1000 [00:44<01:52, 6.35it/s]
29%|██▉ | 288/1000 [00:44<01:37, 7.31it/s]
29%|██▉ | 290/1000 [00:45<01:47, 6.62it/s]
29%|██▉ | 291/1000 [00:45<01:58, 5.98it/s]
29%|██▉ | 292/1000 [00:45<02:19, 5.07it/s]
29%|██▉ | 294/1000 [00:45<01:55, 6.12it/s]
30%|██▉ | 296/1000 [00:46<01:58, 5.94it/s]
30%|██▉ | 298/1000 [00:46<01:39, 7.08it/s]
30%|██▉ | 299/1000 [00:46<02:05, 5.60it/s]
30%|███ | 300/1000 [00:46<01:58, 5.90it/s]
30%|███ | 301/1000 [00:47<01:52, 6.19it/s]
30%|███ | 303/1000 [00:47<01:30, 7.67it/s]
30%|███ | 304/1000 [00:47<01:38, 7.08it/s]
30%|███ | 305/1000 [00:47<01:37, 7.13it/s]
31%|███ | 306/1000 [00:47<01:54, 6.04it/s]
31%|███ | 307/1000 [00:47<01:57, 5.91it/s]
31%|███ | 309/1000 [00:48<01:30, 7.64it/s]
31%|███ | 310/1000 [00:48<01:28, 7.80it/s]
31%|███ | 312/1000 [00:48<01:14, 9.19it/s]
31%|███▏ | 314/1000 [00:48<01:11, 9.63it/s]
32%|███▏ | 315/1000 [00:48<01:17, 8.80it/s]
32%|███▏ | 316/1000 [00:48<01:28, 7.75it/s]
32%|███▏ | 318/1000 [00:49<01:16, 8.89it/s]
32%|███▏ | 319/1000 [00:49<01:59, 5.71it/s]
32%|███▏ | 321/1000 [00:49<02:01, 5.58it/s]
32%|███▏ | 322/1000 [00:50<02:08, 5.26it/s]
32%|███▏ | 324/1000 [00:50<01:42, 6.60it/s]
32%|███▎ | 325/1000 [00:50<02:21, 4.76it/s]
33%|███▎ | 327/1000 [00:50<01:45, 6.35it/s]
33%|███▎ | 328/1000 [00:50<01:48, 6.19it/s]
33%|███▎ | 330/1000 [00:51<01:53, 5.89it/s]
33%|███▎ | 332/1000 [00:51<01:56, 5.73it/s]
33%|███▎ | 333/1000 [00:51<01:49, 6.07it/s]
33%|███▎ | 334/1000 [00:52<01:59, 5.57it/s]
34%|███▎ | 336/1000 [00:52<01:34, 7.06it/s]
34%|███▍ | 338/1000 [00:52<01:25, 7.76it/s]
34%|███▍ | 340/1000 [00:52<01:14, 8.85it/s]
34%|███▍ | 342/1000 [00:52<01:08, 9.60it/s]
34%|███▍ | 344/1000 [00:53<01:38, 6.66it/s]
34%|███▍ | 345/1000 [00:53<01:36, 6.77it/s]
35%|███▍ | 346/1000 [00:53<01:43, 6.31it/s]
35%|███▍ | 347/1000 [00:53<01:40, 6.50it/s]
35%|███▍ | 349/1000 [00:54<01:47, 6.07it/s]
35%|███▌ | 350/1000 [00:54<02:04, 5.21it/s]
35%|███▌ | 352/1000 [00:54<01:36, 6.69it/s]
35%|███▌ | 354/1000 [00:54<01:37, 6.61it/s]
36%|███▌ | 355/1000 [00:55<01:40, 6.44it/s]
36%|███▌ | 357/1000 [00:55<01:22, 7.84it/s]
36%|███▌ | 359/1000 [00:55<01:08, 9.29it/s]
36%|███▌ | 361/1000 [00:55<01:17, 8.26it/s]
36%|███▋ | 363/1000 [00:56<01:41, 6.28it/s]
36%|███▋ | 364/1000 [00:56<01:55, 5.49it/s]
36%|███▋ | 365/1000 [00:56<02:30, 4.21it/s]
37%|███▋ | 367/1000 [00:57<02:16, 4.63it/s]
37%|███▋ | 368/1000 [00:57<02:28, 4.25it/s]
37%|███▋ | 369/1000 [00:57<02:11, 4.79it/s]
37%|███▋ | 371/1000 [00:57<01:36, 6.51it/s]
37%|███▋ | 372/1000 [00:57<01:34, 6.63it/s]
37%|███▋ | 374/1000 [00:58<01:29, 7.00it/s]
38%|███▊ | 375/1000 [00:58<01:59, 5.23it/s]
38%|███▊ | 376/1000 [00:58<02:13, 4.67it/s]
38%|███▊ | 377/1000 [00:58<01:57, 5.30it/s]
38%|███▊ | 379/1000 [00:59<01:27, 7.08it/s]
38%|███▊ | 381/1000 [00:59<01:19, 7.75it/s]
38%|███▊ | 382/1000 [00:59<01:32, 6.71it/s]
38%|███▊ | 384/1000 [00:59<01:16, 8.04it/s]
38%|███▊ | 385/1000 [00:59<01:18, 7.87it/s]
39%|███▊ | 386/1000 [00:59<01:15, 8.10it/s]
39%|███▊ | 387/1000 [01:00<01:42, 6.01it/s]
39%|███▉ | 388/1000 [01:00<01:44, 5.88it/s]
39%|███▉ | 389/1000 [01:00<01:34, 6.47it/s]
39%|███▉ | 390/1000 [01:00<01:31, 6.68it/s]
39%|███▉ | 391/1000 [01:00<01:36, 6.31it/s]
39%|███▉ | 393/1000 [01:01<01:15, 8.03it/s]
40%|███▉ | 395/1000 [01:01<01:36, 6.28it/s]
40%|███▉ | 397/1000 [01:01<01:20, 7.49it/s]
40%|███▉ | 398/1000 [01:01<01:38, 6.11it/s]
40%|███▉ | 399/1000 [01:02<01:59, 5.02it/s]
40%|████ | 400/1000 [01:02<02:11, 4.57it/s]
40%|████ | 402/1000 [01:02<02:03, 4.83it/s]
40%|████ | 404/1000 [01:03<01:36, 6.20it/s]
41%|████ | 406/1000 [01:03<01:19, 7.43it/s]
41%|████ | 407/1000 [01:03<01:36, 6.14it/s]
41%|████ | 408/1000 [01:03<01:50, 5.35it/s]
41%|████ | 410/1000 [01:04<01:50, 5.32it/s]
41%|████ | 411/1000 [01:04<02:02, 4.81it/s]
41%|████ | 412/1000 [01:04<02:12, 4.45it/s]
41%|████▏ | 413/1000 [01:04<01:54, 5.12it/s]
42%|████▏ | 415/1000 [01:04<01:24, 6.96it/s]
42%|████▏ | 416/1000 [01:05<01:41, 5.73it/s]
42%|████▏ | 418/1000 [01:05<01:19, 7.32it/s]
42%|████▏ | 420/1000 [01:05<01:17, 7.47it/s]
42%|████▏ | 421/1000 [01:05<01:29, 6.50it/s]
42%|████▏ | 423/1000 [01:06<01:42, 5.62it/s]
42%|████▏ | 424/1000 [01:06<01:54, 5.03it/s]
42%|████▎ | 425/1000 [01:06<01:45, 5.45it/s]
43%|████▎ | 427/1000 [01:06<01:23, 6.85it/s]
43%|████▎ | 428/1000 [01:07<01:28, 6.47it/s]
43%|████▎ | 429/1000 [01:07<01:24, 6.76it/s]
43%|████▎ | 431/1000 [01:07<01:08, 8.28it/s]
43%|████▎ | 433/1000 [01:07<00:59, 9.45it/s]
44%|████▎ | 435/1000 [01:07<00:58, 9.60it/s]
44%|████▎ | 436/1000 [01:07<01:06, 8.51it/s]
44%|████▍ | 438/1000 [01:08<01:00, 9.36it/s]
44%|████▍ | 439/1000 [01:08<01:26, 6.49it/s]
44%|████▍ | 441/1000 [01:08<01:11, 7.83it/s]
44%|████▍ | 442/1000 [01:08<01:28, 6.27it/s]
44%|████▍ | 444/1000 [01:09<01:30, 6.13it/s]
45%|████▍ | 446/1000 [01:09<01:14, 7.44it/s]
45%|████▍ | 448/1000 [01:09<01:25, 6.43it/s]
45%|████▌ | 450/1000 [01:10<01:32, 5.95it/s]
45%|████▌ | 451/1000 [01:10<01:43, 5.29it/s]
45%|████▌ | 452/1000 [01:10<01:54, 4.80it/s]
45%|████▌ | 454/1000 [01:10<01:28, 6.19it/s]
46%|████▌ | 456/1000 [01:11<01:13, 7.37it/s]
46%|████▌ | 457/1000 [01:11<01:20, 6.78it/s]
46%|████▌ | 459/1000 [01:11<01:07, 8.06it/s]
46%|████▌ | 461/1000 [01:11<00:57, 9.44it/s]
46%|████▋ | 463/1000 [01:12<01:22, 6.49it/s]
46%|████▋ | 465/1000 [01:12<01:32, 5.80it/s]
47%|████▋ | 466/1000 [01:12<01:42, 5.19it/s]
47%|████▋ | 467/1000 [01:13<02:08, 4.16it/s]
47%|████▋ | 469/1000 [01:13<01:37, 5.47it/s]
47%|████▋ | 471/1000 [01:13<01:17, 6.84it/s]
47%|████▋ | 472/1000 [01:13<01:13, 7.17it/s]
47%|████▋ | 473/1000 [01:13<01:21, 6.46it/s]
47%|████▋ | 474/1000 [01:14<01:37, 5.40it/s]
48%|████▊ | 476/1000 [01:14<01:36, 5.41it/s]
48%|████▊ | 477/1000 [01:14<01:53, 4.61it/s]
48%|████▊ | 479/1000 [01:15<01:24, 6.20it/s]
48%|████▊ | 480/1000 [01:15<01:34, 5.52it/s]
48%|████▊ | 482/1000 [01:15<01:15, 6.82it/s]
48%|████▊ | 484/1000 [01:15<01:21, 6.29it/s]
48%|████▊ | 485/1000 [01:16<01:36, 5.32it/s]
49%|████▊ | 486/1000 [01:16<01:36, 5.33it/s]
49%|████▉ | 488/1000 [01:16<01:14, 6.85it/s]
49%|████▉ | 489/1000 [01:16<01:29, 5.71it/s]
49%|████▉ | 491/1000 [01:16<01:11, 7.11it/s]
49%|████▉ | 492/1000 [01:17<01:10, 7.20it/s]
49%|████▉ | 494/1000 [01:17<00:57, 8.73it/s]
50%|████▉ | 496/1000 [01:17<01:08, 7.35it/s]
50%|████▉ | 498/1000 [01:17<01:08, 7.38it/s]
50%|████▉ | 499/1000 [01:18<01:28, 5.66it/s]
50%|█████ | 500/1000 [01:18<01:38, 5.06it/s]
50%|█████ | 502/1000 [01:18<01:16, 6.48it/s]
50%|█████ | 503/1000 [01:18<01:27, 5.71it/s]
50%|█████ | 505/1000 [01:19<01:28, 5.62it/s]
51%|█████ | 506/1000 [01:19<01:38, 5.02it/s]
51%|█████ | 508/1000 [01:19<01:16, 6.46it/s]
51%|█████ | 510/1000 [01:19<01:02, 7.78it/s]
51%|█████ | 512/1000 [01:19<00:56, 8.64it/s]
51%|█████▏ | 514/1000 [01:20<01:16, 6.33it/s]
52%|█████▏ | 515/1000 [01:20<01:15, 6.42it/s]
52%|█████▏ | 516/1000 [01:20<01:19, 6.08it/s]
52%|█████▏ | 518/1000 [01:21<01:09, 6.98it/s]
52%|█████▏ | 519/1000 [01:21<01:26, 5.53it/s]
52%|█████▏ | 521/1000 [01:21<01:08, 6.98it/s]
52%|█████▏ | 522/1000 [01:21<01:22, 5.81it/s]
52%|█████▏ | 523/1000 [01:22<01:34, 5.07it/s]
52%|█████▏ | 524/1000 [01:22<01:37, 4.86it/s]
53%|█████▎ | 526/1000 [01:22<01:22, 5.77it/s]
53%|█████▎ | 528/1000 [01:22<01:24, 5.60it/s]
53%|█████▎ | 529/1000 [01:23<01:25, 5.51it/s]
53%|█████▎ | 531/1000 [01:23<01:09, 6.74it/s]
53%|█████▎ | 533/1000 [01:23<00:57, 8.13it/s]
53%|█████▎ | 534/1000 [01:23<01:11, 6.51it/s]
54%|█████▎ | 535/1000 [01:24<01:26, 5.37it/s]
54%|█████▎ | 536/1000 [01:24<01:29, 5.17it/s]
54%|█████▎ | 537/1000 [01:24<01:39, 4.64it/s]
54%|█████▍ | 539/1000 [01:24<01:33, 4.95it/s]
54%|█████▍ | 540/1000 [01:25<01:34, 4.84it/s]
54%|█████▍ | 541/1000 [01:25<01:44, 4.37it/s]
54%|█████▍ | 543/1000 [01:25<01:17, 5.92it/s]
55%|█████▍ | 545/1000 [01:25<01:14, 6.09it/s]
55%|█████▍ | 546/1000 [01:26<01:21, 5.60it/s]
55%|█████▍ | 547/1000 [01:26<01:34, 4.81it/s]
55%|█████▍ | 549/1000 [01:26<01:29, 5.06it/s]
55%|█████▌ | 551/1000 [01:26<01:09, 6.45it/s]
55%|█████▌ | 552/1000 [01:27<01:13, 6.10it/s]
55%|█████▌ | 553/1000 [01:27<01:24, 5.28it/s]
55%|█████▌ | 554/1000 [01:27<01:27, 5.12it/s]
56%|█████▌ | 556/1000 [01:27<01:06, 6.72it/s]
56%|█████▌ | 557/1000 [01:28<01:12, 6.09it/s]
56%|█████▌ | 559/1000 [01:28<00:57, 7.70it/s]
56%|█████▌ | 561/1000 [01:28<00:50, 8.63it/s]
56%|█████▋ | 563/1000 [01:28<01:01, 7.06it/s]
56%|█████▋ | 565/1000 [01:29<01:03, 6.81it/s]
57%|█████▋ | 566/1000 [01:29<01:14, 5.81it/s]
57%|█████▋ | 568/1000 [01:29<01:17, 5.55it/s]
57%|█████▋ | 569/1000 [01:29<01:18, 5.51it/s]
57%|█████▋ | 571/1000 [01:30<01:17, 5.56it/s]
57%|█████▋ | 572/1000 [01:30<01:18, 5.46it/s]
57%|█████▋ | 574/1000 [01:30<01:17, 5.52it/s]
58%|█████▊ | 576/1000 [01:31<01:03, 6.69it/s]
58%|█████▊ | 577/1000 [01:31<01:25, 4.95it/s]
58%|█████▊ | 578/1000 [01:31<01:32, 4.57it/s]
58%|█████▊ | 580/1000 [01:31<01:09, 6.08it/s]
58%|█████▊ | 582/1000 [01:32<00:56, 7.45it/s]
58%|█████▊ | 583/1000 [01:32<01:08, 6.11it/s]
58%|█████▊ | 584/1000 [01:32<01:03, 6.57it/s]
58%|█████▊ | 585/1000 [01:32<01:10, 5.89it/s]
59%|█████▊ | 587/1000 [01:32<01:06, 6.18it/s]
59%|█████▉ | 589/1000 [01:33<00:54, 7.56it/s]
59%|█████▉ | 590/1000 [01:33<01:10, 5.84it/s]
59%|█████▉ | 592/1000 [01:33<00:56, 7.16it/s]
59%|█████▉ | 593/1000 [01:33<01:08, 5.91it/s]
60%|█████▉ | 595/1000 [01:34<00:55, 7.34it/s]
60%|█████▉ | 596/1000 [01:34<01:09, 5.83it/s]
60%|█████▉ | 597/1000 [01:34<01:11, 5.67it/s]
60%|█████▉ | 599/1000 [01:34<01:11, 5.58it/s]
60%|██████ | 601/1000 [01:35<01:11, 5.54it/s]
60%|██████ | 602/1000 [01:35<01:08, 5.82it/s]
60%|██████ | 604/1000 [01:35<01:20, 4.95it/s]
61%|██████ | 606/1000 [01:36<01:04, 6.08it/s]
61%|██████ | 608/1000 [01:36<00:57, 6.76it/s]
61%|██████ | 610/1000 [01:36<00:54, 7.09it/s]
61%|██████ | 612/1000 [01:36<00:46, 8.28it/s]
61%|██████▏ | 614/1000 [01:36<00:41, 9.25it/s]
62%|██████▏ | 616/1000 [01:37<00:58, 6.59it/s]
62%|██████▏ | 617/1000 [01:37<00:56, 6.72it/s]
62%|██████▏ | 619/1000 [01:37<00:48, 7.90it/s]
62%|██████▏ | 621/1000 [01:38<00:54, 7.00it/s]
62%|██████▏ | 623/1000 [01:38<00:53, 7.02it/s]
62%|██████▎ | 625/1000 [01:38<00:58, 6.42it/s]
63%|██████▎ | 627/1000 [01:38<00:49, 7.48it/s]
63%|██████▎ | 628/1000 [01:39<00:59, 6.25it/s]
63%|██████▎ | 629/1000 [01:39<01:08, 5.42it/s]
63%|██████▎ | 631/1000 [01:39<00:53, 6.86it/s]
63%|██████▎ | 633/1000 [01:39<00:44, 8.31it/s]
63%|██████▎ | 634/1000 [01:40<01:05, 5.62it/s]
64%|██████▎ | 635/1000 [01:40<01:01, 5.96it/s]
64%|██████▎ | 636/1000 [01:40<00:57, 6.35it/s]
64%|██████▍ | 638/1000 [01:40<00:51, 7.04it/s]
64%|██████▍ | 640/1000 [01:40<00:44, 8.18it/s]
64%|██████▍ | 641/1000 [01:41<00:55, 6.47it/s]
64%|██████▍ | 643/1000 [01:41<00:52, 6.79it/s]
64%|██████▍ | 645/1000 [01:41<00:56, 6.30it/s]
65%|██████▍ | 647/1000 [01:41<00:52, 6.70it/s]
65%|██████▍ | 648/1000 [01:42<01:01, 5.75it/s]
65%|██████▌ | 650/1000 [01:42<01:02, 5.64it/s]
65%|██████▌ | 652/1000 [01:43<01:03, 5.45it/s]
65%|██████▌ | 654/1000 [01:43<00:52, 6.65it/s]
66%|██████▌ | 656/1000 [01:43<00:45, 7.55it/s]
66%|██████▌ | 657/1000 [01:43<00:54, 6.33it/s]
66%|██████▌ | 659/1000 [01:44<01:03, 5.35it/s]
66%|██████▌ | 661/1000 [01:44<00:50, 6.67it/s]
66%|██████▌ | 662/1000 [01:44<00:59, 5.72it/s]
66%|██████▋ | 664/1000 [01:45<01:07, 4.98it/s]
66%|██████▋ | 665/1000 [01:45<01:12, 4.63it/s]
67%|██████▋ | 667/1000 [01:45<01:08, 4.88it/s]
67%|██████▋ | 668/1000 [01:45<01:13, 4.54it/s]
67%|██████▋ | 669/1000 [01:46<01:06, 4.99it/s]
67%|██████▋ | 671/1000 [01:46<01:03, 5.15it/s]
67%|██████▋ | 673/1000 [01:46<00:56, 5.81it/s]
68%|██████▊ | 675/1000 [01:47<00:50, 6.38it/s]
68%|██████▊ | 677/1000 [01:47<00:42, 7.60it/s]
68%|██████▊ | 679/1000 [01:47<00:37, 8.53it/s]
68%|██████▊ | 681/1000 [01:47<00:32, 9.76it/s]
68%|██████▊ | 683/1000 [01:47<00:40, 7.90it/s]
68%|██████▊ | 685/1000 [01:48<00:36, 8.75it/s]
69%|██████▊ | 686/1000 [01:48<00:45, 6.90it/s]
69%|██████▊ | 687/1000 [01:48<00:53, 5.80it/s]
69%|██████▉ | 688/1000 [01:48<00:50, 6.18it/s]
69%|██████▉ | 690/1000 [01:49<00:52, 5.87it/s]
69%|██████▉ | 692/1000 [01:49<00:44, 6.90it/s]
69%|██████▉ | 694/1000 [01:49<00:47, 6.38it/s]
70%|██████▉ | 695/1000 [01:49<00:46, 6.53it/s]
70%|██████▉ | 696/1000 [01:50<00:55, 5.52it/s]
70%|██████▉ | 698/1000 [01:50<00:49, 6.07it/s]
70%|██████▉ | 699/1000 [01:50<00:57, 5.28it/s]
70%|███████ | 701/1000 [01:50<00:44, 6.67it/s]
70%|███████ | 702/1000 [01:51<01:00, 4.90it/s]
70%|███████ | 704/1000 [01:51<00:47, 6.19it/s]
70%|███████ | 705/1000 [01:51<01:03, 4.64it/s]
71%|███████ | 707/1000 [01:51<00:48, 6.05it/s]
71%|███████ | 709/1000 [01:52<00:44, 6.60it/s]
71%|███████ | 710/1000 [01:52<00:51, 5.65it/s]
71%|███████ | 712/1000 [01:52<00:43, 6.60it/s]
71%|███████▏ | 713/1000 [01:52<00:42, 6.74it/s]
72%|███████▏ | 715/1000 [01:52<00:35, 8.09it/s]
72%|███████▏ | 716/1000 [01:53<00:44, 6.41it/s]
72%|███████▏ | 717/1000 [01:53<00:40, 6.97it/s]
72%|███████▏ | 718/1000 [01:53<00:49, 5.67it/s]
72%|███████▏ | 719/1000 [01:53<00:57, 4.90it/s]
72%|███████▏ | 720/1000 [01:54<00:51, 5.49it/s]
72%|███████▏ | 722/1000 [01:54<00:39, 7.11it/s]
72%|███████▏ | 723/1000 [01:54<00:38, 7.20it/s]
72%|███████▏ | 724/1000 [01:54<00:38, 7.21it/s]
72%|███████▎ | 725/1000 [01:54<00:37, 7.29it/s]
73%|███████▎ | 727/1000 [01:54<00:30, 8.95it/s]
73%|███████▎ | 729/1000 [01:54<00:27, 9.86it/s]
73%|███████▎ | 730/1000 [01:55<00:37, 7.18it/s]
73%|███████▎ | 731/1000 [01:55<00:37, 7.20it/s]
73%|███████▎ | 733/1000 [01:55<00:31, 8.56it/s]
73%|███████▎ | 734/1000 [01:55<00:31, 8.45it/s]
74%|███████▎ | 736/1000 [01:55<00:33, 7.87it/s]
74%|███████▍ | 738/1000 [01:56<00:30, 8.50it/s]
74%|███████▍ | 740/1000 [01:56<00:27, 9.35it/s]
74%|███████▍ | 741/1000 [01:56<00:36, 7.14it/s]
74%|███████▍ | 743/1000 [01:56<00:36, 7.05it/s]
74%|███████▍ | 745/1000 [01:57<00:30, 8.30it/s]
75%|███████▍ | 747/1000 [01:57<00:27, 9.14it/s]
75%|███████▍ | 748/1000 [01:57<00:35, 7.09it/s]
75%|███████▌ | 750/1000 [01:57<00:36, 6.80it/s]
75%|███████▌ | 751/1000 [01:58<00:46, 5.39it/s]
75%|███████▌ | 753/1000 [01:58<00:39, 6.33it/s]
75%|███████▌ | 754/1000 [01:58<00:44, 5.48it/s]
76%|███████▌ | 756/1000 [01:59<00:44, 5.54it/s]
76%|███████▌ | 758/1000 [01:59<00:36, 6.59it/s]
76%|███████▌ | 759/1000 [01:59<00:37, 6.37it/s]
76%|███████▌ | 761/1000 [01:59<00:31, 7.59it/s]
76%|███████▋ | 763/1000 [01:59<00:35, 6.71it/s]
76%|███████▋ | 764/1000 [02:00<00:41, 5.75it/s]
77%|███████▋ | 766/1000 [02:00<00:41, 5.65it/s]
77%|███████▋ | 768/1000 [02:00<00:34, 6.82it/s]
77%|███████▋ | 769/1000 [02:01<00:40, 5.68it/s]
77%|███████▋ | 770/1000 [02:01<00:40, 5.65it/s]
77%|███████▋ | 771/1000 [02:01<00:36, 6.22it/s]
77%|███████▋ | 773/1000 [02:01<00:40, 5.62it/s]
77%|███████▋ | 774/1000 [02:01<00:38, 5.94it/s]
78%|███████▊ | 776/1000 [02:02<00:33, 6.73it/s]
78%|███████▊ | 778/1000 [02:02<00:27, 8.21it/s]
78%|███████▊ | 780/1000 [02:02<00:36, 6.00it/s]
78%|███████▊ | 782/1000 [02:02<00:30, 7.23it/s]
78%|███████▊ | 783/1000 [02:03<00:35, 6.05it/s]
78%|███████▊ | 784/1000 [02:03<00:34, 6.30it/s]
79%|███████▊ | 786/1000 [02:03<00:32, 6.57it/s]
79%|███████▉ | 788/1000 [02:03<00:28, 7.38it/s]
79%|███████▉ | 790/1000 [02:04<00:26, 7.93it/s]
79%|███████▉ | 791/1000 [02:04<00:29, 7.17it/s]
79%|███████▉ | 792/1000 [02:04<00:30, 6.75it/s]
79%|███████▉ | 793/1000 [02:04<00:29, 7.00it/s]
80%|███████▉ | 795/1000 [02:04<00:32, 6.31it/s]
80%|███████▉ | 797/1000 [02:05<00:33, 6.01it/s]
80%|███████▉ | 798/1000 [02:05<00:38, 5.27it/s]
80%|████████ | 800/1000 [02:05<00:33, 5.91it/s]
80%|████████ | 802/1000 [02:06<00:29, 6.73it/s]
80%|████████ | 804/1000 [02:06<00:28, 6.90it/s]
81%|████████ | 806/1000 [02:06<00:24, 8.07it/s]
81%|████████ | 807/1000 [02:06<00:24, 7.89it/s]
81%|████████ | 809/1000 [02:06<00:21, 9.02it/s]
81%|████████ | 811/1000 [02:06<00:19, 9.92it/s]
81%|████████▏ | 813/1000 [02:07<00:23, 7.97it/s]
81%|████████▏ | 814/1000 [02:07<00:23, 7.82it/s]
82%|████████▏ | 816/1000 [02:07<00:21, 8.74it/s]
82%|████████▏ | 817/1000 [02:07<00:26, 6.86it/s]
82%|████████▏ | 819/1000 [02:08<00:22, 8.06it/s]
82%|████████▏ | 820/1000 [02:08<00:28, 6.33it/s]
82%|████████▏ | 822/1000 [02:08<00:23, 7.46it/s]
82%|████████▏ | 823/1000 [02:08<00:27, 6.53it/s]
82%|████████▏ | 824/1000 [02:09<00:31, 5.51it/s]
82%|████████▎ | 825/1000 [02:09<00:29, 5.86it/s]
83%|████████▎ | 826/1000 [02:09<00:36, 4.76it/s]
83%|████████▎ | 828/1000 [02:09<00:39, 4.37it/s]
83%|████████▎ | 829/1000 [02:10<00:35, 4.86it/s]
83%|████████▎ | 831/1000 [02:10<00:28, 5.91it/s]
83%|████████▎ | 832/1000 [02:10<00:34, 4.85it/s]
83%|████████▎ | 833/1000 [02:10<00:31, 5.30it/s]
83%|████████▎ | 834/1000 [02:11<00:33, 5.00it/s]
84%|████████▎ | 835/1000 [02:11<00:30, 5.49it/s]
84%|████████▎ | 836/1000 [02:11<00:31, 5.18it/s]
84%|████████▍ | 838/1000 [02:11<00:25, 6.39it/s]
84%|████████▍ | 840/1000 [02:12<00:28, 5.60it/s]
84%|████████▍ | 842/1000 [02:12<00:22, 6.93it/s]
84%|████████▍ | 844/1000 [02:12<00:28, 5.39it/s]
84%|████████▍ | 845/1000 [02:13<00:31, 4.90it/s]
85%|████████▍ | 847/1000 [02:13<00:29, 5.25it/s]
85%|████████▍ | 849/1000 [02:13<00:23, 6.41it/s]
85%|████████▌ | 850/1000 [02:13<00:26, 5.58it/s]
85%|████████▌ | 851/1000 [02:13<00:25, 5.94it/s]
85%|████████▌ | 853/1000 [02:14<00:19, 7.35it/s]
86%|████████▌ | 855/1000 [02:14<00:16, 8.72it/s]
86%|████████▌ | 856/1000 [02:14<00:16, 8.54it/s]
86%|████████▌ | 858/1000 [02:14<00:20, 7.09it/s]
86%|████████▌ | 860/1000 [02:14<00:17, 8.20it/s]
86%|████████▌ | 862/1000 [02:15<00:15, 8.92it/s]
86%|████████▋ | 864/1000 [02:15<00:13, 10.06it/s]
87%|████████▋ | 866/1000 [02:15<00:12, 10.64it/s]
87%|████████▋ | 868/1000 [02:15<00:16, 8.21it/s]
87%|████████▋ | 870/1000 [02:15<00:14, 8.75it/s]
87%|████████▋ | 872/1000 [02:16<00:15, 8.17it/s]
87%|████████▋ | 873/1000 [02:16<00:19, 6.58it/s]
87%|████████▋ | 874/1000 [02:16<00:21, 5.95it/s]
88%|████████▊ | 876/1000 [02:16<00:16, 7.37it/s]
88%|████████▊ | 878/1000 [02:17<00:18, 6.58it/s]
88%|████████▊ | 879/1000 [02:17<00:20, 5.98it/s]
88%|████████▊ | 880/1000 [02:17<00:18, 6.49it/s]
88%|████████▊ | 881/1000 [02:17<00:17, 6.65it/s]
88%|████████▊ | 882/1000 [02:18<00:21, 5.39it/s]
88%|████████▊ | 884/1000 [02:18<00:16, 7.07it/s]
89%|████████▊ | 886/1000 [02:18<00:13, 8.35it/s]
89%|████████▉ | 888/1000 [02:18<00:11, 9.45it/s]
89%|████████▉ | 890/1000 [02:18<00:12, 8.73it/s]
89%|████████▉ | 892/1000 [02:18<00:11, 9.62it/s]
89%|████████▉ | 894/1000 [02:19<00:15, 6.67it/s]
90%|████████▉ | 896/1000 [02:19<00:13, 7.78it/s]
90%|████████▉ | 897/1000 [02:19<00:16, 6.41it/s]
90%|████████▉ | 898/1000 [02:20<00:19, 5.31it/s]
90%|█████████ | 900/1000 [02:20<00:15, 6.65it/s]
90%|█████████ | 901/1000 [02:20<00:14, 6.66it/s]
90%|█████████ | 902/1000 [02:20<00:14, 6.92it/s]
90%|█████████ | 904/1000 [02:20<00:11, 8.37it/s]
90%|█████████ | 905/1000 [02:21<00:13, 7.14it/s]
91%|█████████ | 906/1000 [02:21<00:16, 5.77it/s]
91%|█████████ | 908/1000 [02:21<00:12, 7.38it/s]
91%|█████████ | 910/1000 [02:21<00:13, 6.58it/s]
91%|█████████ | 912/1000 [02:22<00:11, 7.84it/s]
91%|█████████▏| 913/1000 [02:22<00:15, 5.75it/s]
92%|█████████▏| 915/1000 [02:22<00:12, 7.03it/s]
92%|█████████▏| 916/1000 [02:22<00:14, 5.92it/s]
92%|█████████▏| 917/1000 [02:22<00:13, 6.30it/s]
92%|█████████▏| 918/1000 [02:23<00:17, 4.60it/s]
92%|█████████▏| 919/1000 [02:23<00:16, 4.77it/s]
92%|█████████▏| 921/1000 [02:23<00:16, 4.72it/s]
92%|█████████▏| 922/1000 [02:24<00:15, 4.97it/s]
92%|█████████▏| 924/1000 [02:24<00:12, 6.14it/s]
93%|█████████▎| 926/1000 [02:24<00:09, 7.47it/s]
93%|█████████▎| 927/1000 [02:24<00:10, 7.01it/s]
93%|█████████▎| 928/1000 [02:24<00:12, 5.75it/s]
93%|█████████▎| 930/1000 [02:25<00:12, 5.49it/s]
93%|█████████▎| 931/1000 [02:25<00:11, 5.83it/s]
93%|█████████▎| 933/1000 [02:25<00:11, 5.59it/s]
93%|█████████▎| 934/1000 [02:26<00:12, 5.27it/s]
94%|█████████▎| 936/1000 [02:26<00:10, 6.28it/s]
94%|█████████▍| 938/1000 [02:26<00:08, 7.63it/s]
94%|█████████▍| 939/1000 [02:26<00:08, 6.79it/s]
94%|█████████▍| 940/1000 [02:26<00:08, 6.89it/s]
94%|█████████▍| 942/1000 [02:27<00:10, 5.28it/s]
94%|█████████▍| 944/1000 [02:27<00:09, 5.99it/s]
95%|█████████▍| 946/1000 [02:27<00:07, 7.15it/s]
95%|█████████▍| 948/1000 [02:27<00:06, 8.32it/s]
95%|█████████▍| 949/1000 [02:28<00:07, 7.19it/s]
95%|█████████▌| 951/1000 [02:28<00:05, 8.27it/s]
95%|█████████▌| 952/1000 [02:28<00:07, 6.11it/s]
95%|█████████▌| 954/1000 [02:29<00:09, 4.96it/s]
96%|█████████▌| 956/1000 [02:29<00:07, 6.22it/s]
96%|█████████▌| 957/1000 [02:29<00:08, 5.37it/s]
96%|█████████▌| 959/1000 [02:30<00:08, 4.88it/s]
96%|█████████▌| 961/1000 [02:30<00:06, 5.87it/s]
96%|█████████▌| 962/1000 [02:30<00:07, 5.22it/s]
96%|█████████▋| 964/1000 [02:30<00:05, 6.52it/s]
96%|█████████▋| 965/1000 [02:31<00:06, 5.45it/s]
97%|█████████▋| 966/1000 [02:31<00:06, 5.40it/s]
97%|█████████▋| 968/1000 [02:31<00:04, 6.92it/s]
97%|█████████▋| 970/1000 [02:31<00:03, 8.18it/s]
97%|█████████▋| 971/1000 [02:31<00:04, 6.48it/s]
97%|█████████▋| 973/1000 [02:32<00:03, 7.75it/s]
98%|█████████▊| 975/1000 [02:32<00:03, 8.18it/s]
98%|█████████▊| 977/1000 [02:32<00:02, 9.38it/s]
98%|█████████▊| 979/1000 [02:32<00:02, 9.43it/s]
98%|█████████▊| 981/1000 [02:33<00:03, 6.09it/s]
98%|█████████▊| 982/1000 [02:33<00:03, 4.86it/s]
98%|█████████▊| 984/1000 [02:33<00:02, 6.04it/s]
99%|█████████▊| 986/1000 [02:33<00:01, 7.23it/s]
99%|█████████▊| 987/1000 [02:34<00:01, 6.76it/s]
99%|█████████▉| 988/1000 [02:34<00:02, 5.64it/s]
99%|█████████▉| 989/1000 [02:34<00:02, 4.97it/s]
99%|█████████▉| 991/1000 [02:35<00:01, 5.22it/s]
99%|█████████▉| 992/1000 [02:35<00:01, 4.19it/s]
99%|█████████▉| 994/1000 [02:35<00:01, 5.49it/s]
100%|█████████▉| 995/1000 [02:35<00:01, 4.65it/s]
100%|█████████▉| 997/1000 [02:36<00:00, 6.03it/s]
100%|█████████▉| 999/1000 [02:36<00:00, 5.82it/s]
100%|██████████| 1000/1000 [02:36<00:00, 5.76it/s]
{'eval_loss': '0.7433', 'eval_runtime': '156.9', 'eval_samples_per_second': '6.374', 'eval_steps_per_second': '6.374', 'epoch': '0.8276', 'num_input_tokens_seen': 10089904}
83%|████████▎ | 1500/1813 [2:48:11<36:02, 6.91s/it]
100%|██████████| 1000/1000 [02:36<00:00, 5.76it/s]

83%|████████▎ | 1501/1813 [2:48:18<4:41:15, 54.09s/it]
83%|████████▎ | 1502/1813 [2:48:23<3:24:09, 39.39s/it]
83%|████████▎ | 1503/1813 [2:48:30<2:33:31, 29.71s/it]
83%|████████▎ | 1504/1813 [2:48:36<1:55:58, 22.52s/it]
83%|████████▎ | 1505/1813 [2:48:42<1:30:30, 17.63s/it]
83%|████████▎ | 1506/1813 [2:48:50<1:15:15, 14.71s/it]
83%|████████▎ | 1507/1813 [2:48:56<1:01:08, 11.99s/it]
83%|████████▎ | 1508/1813 [2:49:04<54:52, 10.80s/it]
83%|████████▎ | 1509/1813 [2:49:10<48:08, 9.50s/it]
83%|████████▎ | 1510/1813 [2:49:17<43:40, 8.65s/it]
{'loss': '0.8178', 'grad_norm': '1.216', 'learning_rate': '1.604e-05', 'epoch': '0.8331', 'num_input_tokens_seen': 10151928, 'train_runtime': '1.016e+04', 'train_tokens_per_second': '999.4'}
83%|████████▎ | 1510/1813 [2:49:17<43:40, 8.65s/it]
83%|████████▎ | 1511/1813 [2:49:24<41:29, 8.24s/it]
83%|████████▎ | 1512/1813 [2:49:31<38:37, 7.70s/it]
83%|████████▎ | 1513/1813 [2:49:37<36:37, 7.33s/it]
84%|████████▎ | 1514/1813 [2:49:45<36:44, 7.37s/it]
84%|████████▎ | 1515/1813 [2:49:53<38:21, 7.72s/it]
84%|████████▎ | 1516/1813 [2:50:01<38:38, 7.81s/it]
84%|████████▎ | 1517/1813 [2:50:09<38:02, 7.71s/it]
84%|████████▎ | 1518/1813 [2:50:18<39:25, 8.02s/it]
84%|████████▍ | 1519/1813 [2:50:26<39:32, 8.07s/it]
84%|████████▍ | 1520/1813 [2:50:33<37:54, 7.76s/it]
{'loss': '0.8583', 'grad_norm': '1.18', 'learning_rate': '1.503e-05', 'epoch': '0.8386', 'num_input_tokens_seen': 10225024, 'train_runtime': '1.023e+04', 'train_tokens_per_second': '999.2'}
84%|████████▍ | 1520/1813 [2:50:33<37:54, 7.76s/it]
84%|████████▍ | 1521/1813 [2:50:41<37:54, 7.79s/it]
84%|████████▍ | 1522/1813 [2:50:48<36:47, 7.59s/it]
84%|████████▍ | 1523/1813 [2:50:56<37:47, 7.82s/it]
84%|████████▍ | 1524/1813 [2:51:03<36:48, 7.64s/it]
84%|████████▍ | 1525/1813 [2:51:09<33:32, 6.99s/it]
84%|████████▍ | 1526/1813 [2:51:16<33:56, 7.10s/it]
84%|████████▍ | 1527/1813 [2:51:24<34:34, 7.25s/it]
84%|████████▍ | 1528/1813 [2:51:31<34:32, 7.27s/it]
84%|████████▍ | 1529/1813 [2:51:39<35:26, 7.49s/it]
84%|████████▍ | 1530/1813 [2:51:45<33:48, 7.17s/it]
{'loss': '0.9037', 'grad_norm': '0.9507', 'learning_rate': '1.405e-05', 'epoch': '0.8441', 'num_input_tokens_seen': 10294368, 'train_runtime': '1.031e+04', 'train_tokens_per_second': '998.9'}
84%|████████▍ | 1530/1813 [2:51:45<33:48, 7.17s/it]
84%|████████▍ | 1531/1813 [2:51:51<31:54, 6.79s/it]
85%|████████▍ | 1532/1813 [2:51:59<33:19, 7.12s/it]
85%|████████▍ | 1533/1813 [2:52:05<31:19, 6.71s/it]
85%|████████▍ | 1534/1813 [2:52:14<34:42, 7.46s/it]
85%|████████▍ | 1535/1813 [2:52:20<32:50, 7.09s/it]
85%|████████▍ | 1536/1813 [2:52:29<34:49, 7.54s/it]
85%|████████▍ | 1537/1813 [2:52:37<34:55, 7.59s/it]
85%|████████▍ | 1538/1813 [2:52:42<31:35, 6.89s/it]
85%|████████▍ | 1539/1813 [2:52:49<30:53, 6.76s/it]
85%|████████▍ | 1540/1813 [2:52:55<30:11, 6.64s/it]
{'loss': '0.9012', 'grad_norm': '1.3', 'learning_rate': '1.31e-05', 'epoch': '0.8497', 'num_input_tokens_seen': 10359416, 'train_runtime': '1.038e+04', 'train_tokens_per_second': '998.5'}
85%|████████▍ | 1540/1813 [2:52:55<30:11, 6.64s/it]
85%|████████▍ | 1541/1813 [2:53:02<31:17, 6.90s/it]
85%|████████▌ | 1542/1813 [2:53:10<31:29, 6.97s/it]
85%|████████▌ | 1543/1813 [2:53:15<29:24, 6.53s/it]
85%|████████▌ | 1544/1813 [2:53:21<28:08, 6.28s/it]
85%|████████▌ | 1545/1813 [2:53:30<31:45, 7.11s/it]
85%|████████▌ | 1546/1813 [2:53:37<31:17, 7.03s/it]
85%|████████▌ | 1547/1813 [2:53:43<29:43, 6.71s/it]
85%|████████▌ | 1548/1813 [2:53:52<33:07, 7.50s/it]
85%|████████▌ | 1549/1813 [2:53:58<31:02, 7.06s/it]
85%|████████▌ | 1550/1813 [2:54:06<32:37, 7.44s/it]
{'loss': '0.9699', 'grad_norm': '0.9705', 'learning_rate': '1.218e-05', 'epoch': '0.8552', 'num_input_tokens_seen': 10427368, 'train_runtime': '1.045e+04', 'train_tokens_per_second': '998.1'}
85%|████████▌ | 1550/1813 [2:54:06<32:37, 7.44s/it]
86%|████████▌ | 1551/1813 [2:54:15<34:13, 7.84s/it]
86%|████████▌ | 1552/1813 [2:54:22<32:38, 7.50s/it]
86%|████████▌ | 1553/1813 [2:54:28<31:19, 7.23s/it]
86%|████████▌ | 1554/1813 [2:54:36<31:38, 7.33s/it]
86%|████████▌ | 1555/1813 [2:54:43<31:49, 7.40s/it]
86%|████████▌ | 1556/1813 [2:54:50<31:09, 7.27s/it]
86%|████████▌ | 1557/1813 [2:54:59<32:59, 7.73s/it]
86%|████████▌ | 1558/1813 [2:55:06<31:43, 7.46s/it]
86%|████████▌ | 1559/1813 [2:55:13<31:13, 7.38s/it]
86%|████████▌ | 1560/1813 [2:55:19<29:16, 6.94s/it]
{'loss': '0.9822', 'grad_norm': '0.9182', 'learning_rate': '1.129e-05', 'epoch': '0.8607', 'num_input_tokens_seen': 10497472, 'train_runtime': '1.052e+04', 'train_tokens_per_second': '997.9'}
86%|████████▌ | 1560/1813 [2:55:19<29:16, 6.94s/it]
86%|████████▌ | 1561/1813 [2:55:27<30:28, 7.26s/it]
86%|████████▌ | 1562/1813 [2:55:34<30:22, 7.26s/it]
86%|████████▌ | 1563/1813 [2:55:41<29:51, 7.17s/it]
86%|████████▋ | 1564/1813 [2:55:48<29:35, 7.13s/it]
86%|████████▋ | 1565/1813 [2:55:53<26:47, 6.48s/it]
86%|████████▋ | 1566/1813 [2:56:00<26:58, 6.55s/it]
86%|████████▋ | 1567/1813 [2:56:07<27:24, 6.68s/it]
86%|████████▋ | 1568/1813 [2:56:13<25:52, 6.34s/it]
87%|████████▋ | 1569/1813 [2:56:21<28:34, 7.03s/it]
87%|████████▋ | 1570/1813 [2:56:30<30:09, 7.45s/it]
{'loss': '0.799', 'grad_norm': '1.071', 'learning_rate': '1.044e-05', 'epoch': '0.8662', 'num_input_tokens_seen': 10564336, 'train_runtime': '1.059e+04', 'train_tokens_per_second': '997.6'}
87%|████████▋ | 1570/1813 [2:56:30<30:09, 7.45s/it]
87%|████████▋ | 1571/1813 [2:56:36<28:12, 6.99s/it]
87%|████████▋ | 1572/1813 [2:56:42<27:07, 6.75s/it]
87%|████████▋ | 1573/1813 [2:56:48<26:36, 6.65s/it]
87%|████████▋ | 1574/1813 [2:56:56<27:14, 6.84s/it]
87%|████████▋ | 1575/1813 [2:57:02<26:45, 6.75s/it]
87%|████████▋ | 1576/1813 [2:57:10<28:38, 7.25s/it]
87%|████████▋ | 1577/1813 [2:57:18<29:07, 7.40s/it]
87%|████████▋ | 1578/1813 [2:57:25<28:41, 7.33s/it]
87%|████████▋ | 1579/1813 [2:57:32<28:07, 7.21s/it]
87%|████████▋ | 1580/1813 [2:57:38<26:11, 6.74s/it]
{'loss': '0.9316', 'grad_norm': '1.203', 'learning_rate': '9.612e-06', 'epoch': '0.8717', 'num_input_tokens_seen': 10628400, 'train_runtime': '1.066e+04', 'train_tokens_per_second': '997.2'}
87%|████████▋ | 1580/1813 [2:57:38<26:11, 6.74s/it]
87%|████████▋ | 1581/1813 [2:57:45<25:55, 6.71s/it]
87%|████████▋ | 1582/1813 [2:57:49<23:34, 6.12s/it]
87%|████████▋ | 1583/1813 [2:57:57<24:41, 6.44s/it]
87%|████████▋ | 1584/1813 [2:58:04<25:31, 6.69s/it]
87%|████████▋ | 1585/1813 [2:58:12<27:20, 7.20s/it]
87%|████████▋ | 1586/1813 [2:58:21<28:38, 7.57s/it]
88%|████████▊ | 1587/1813 [2:58:29<29:36, 7.86s/it]
88%|████████▊ | 1588/1813 [2:58:36<28:07, 7.50s/it]
88%|████████▊ | 1589/1813 [2:58:42<25:58, 6.96s/it]
88%|████████▊ | 1590/1813 [2:58:49<26:35, 7.15s/it]
{'loss': '0.8658', 'grad_norm': '1.09', 'learning_rate': '8.82e-06', 'epoch': '0.8772', 'num_input_tokens_seen': 10695288, 'train_runtime': '1.073e+04', 'train_tokens_per_second': '996.8'}
88%|████████▊ | 1590/1813 [2:58:49<26:35, 7.15s/it]
88%|████████▊ | 1591/1813 [2:58:56<26:12, 7.08s/it]
88%|████████▊ | 1592/1813 [2:59:03<26:25, 7.18s/it]
88%|████████▊ | 1593/1813 [2:59:11<26:46, 7.30s/it]
88%|████████▊ | 1594/1813 [2:59:19<27:03, 7.41s/it]
88%|████████▊ | 1595/1813 [2:59:27<28:02, 7.72s/it]
88%|████████▊ | 1596/1813 [2:59:37<30:23, 8.40s/it]
88%|████████▊ | 1597/1813 [2:59:45<29:36, 8.23s/it]
88%|████████▊ | 1598/1813 [2:59:52<28:42, 8.01s/it]
88%|████████▊ | 1599/1813 [2:59:59<26:48, 7.52s/it]
88%|████████▊ | 1600/1813 [3:00:04<24:10, 6.81s/it]
{'loss': '0.8727', 'grad_norm': '1.014', 'learning_rate': '8.061e-06', 'epoch': '0.8828', 'num_input_tokens_seen': 10767512, 'train_runtime': '1.08e+04', 'train_tokens_per_second': '996.6'}
88%|████████▊ | 1600/1813 [3:00:04<24:10, 6.81s/it]
88%|████████▊ | 1601/1813 [3:00:13<26:34, 7.52s/it]
88%|████████▊ | 1602/1813 [3:00:20<25:52, 7.36s/it]
88%|████████▊ | 1603/1813 [3:00:28<26:16, 7.51s/it]
88%|████████▊ | 1604/1813 [3:00:36<26:28, 7.60s/it]
89%|████████▊ | 1605/1813 [3:00:45<28:13, 8.14s/it]
89%|████████▊ | 1606/1813 [3:00:51<25:47, 7.47s/it]
89%|████████▊ | 1607/1813 [3:00:59<25:53, 7.54s/it]
89%|████████▊ | 1608/1813 [3:01:07<26:36, 7.79s/it]
89%|████████▊ | 1609/1813 [3:01:13<24:45, 7.28s/it]
89%|████████▉ | 1610/1813 [3:01:20<24:11, 7.15s/it]
{'loss': '0.8924', 'grad_norm': '1.515', 'learning_rate': '7.334e-06', 'epoch': '0.8883', 'num_input_tokens_seen': 10840800, 'train_runtime': '1.088e+04', 'train_tokens_per_second': '996.3'}
89%|████████▉ | 1610/1813 [3:01:20<24:11, 7.15s/it]
89%|████████▉ | 1611/1813 [3:01:26<22:34, 6.70s/it]
89%|████████▉ | 1612/1813 [3:01:32<22:24, 6.69s/it]
89%|████████▉ | 1613/1813 [3:01:38<20:48, 6.24s/it]
89%|████████▉ | 1614/1813 [3:01:44<21:05, 6.36s/it]
89%|████████▉ | 1615/1813 [3:01:52<21:55, 6.64s/it]
89%|████████▉ | 1616/1813 [3:01:59<22:32, 6.86s/it]
89%|████████▉ | 1617/1813 [3:02:07<23:11, 7.10s/it]
89%|████████▉ | 1618/1813 [3:02:12<21:43, 6.69s/it]
89%|████████▉ | 1619/1813 [3:02:19<21:21, 6.61s/it]
89%|████████▉ | 1620/1813 [3:02:24<20:12, 6.28s/it]
{'loss': '0.9038', 'grad_norm': '1.104', 'learning_rate': '6.641e-06', 'epoch': '0.8938', 'num_input_tokens_seen': 10899640, 'train_runtime': '1.094e+04', 'train_tokens_per_second': '995.9'}
89%|████████▉ | 1620/1813 [3:02:24<20:12, 6.28s/it]
89%|████████▉ | 1621/1813 [3:02:30<19:58, 6.24s/it]
89%|████████▉ | 1622/1813 [3:02:39<22:10, 6.97s/it]
90%|████████▉ | 1623/1813 [3:02:47<22:56, 7.24s/it]
90%|████████▉ | 1624/1813 [3:02:54<22:18, 7.08s/it]
90%|████████▉ | 1625/1813 [3:03:02<23:24, 7.47s/it]
90%|████████▉ | 1626/1813 [3:03:09<22:55, 7.35s/it]
90%|████████▉ | 1627/1813 [3:03:16<22:09, 7.15s/it]
90%|████████▉ | 1628/1813 [3:03:22<21:20, 6.92s/it]
90%|████████▉ | 1629/1813 [3:03:30<22:28, 7.33s/it]
90%|████████▉ | 1630/1813 [3:03:37<21:11, 6.95s/it]
{'loss': '0.8923', 'grad_norm': '1.513', 'learning_rate': '5.981e-06', 'epoch': '0.8993', 'num_input_tokens_seen': 10968528, 'train_runtime': '1.102e+04', 'train_tokens_per_second': '995.6'}
90%|████████▉ | 1630/1813 [3:03:37<21:11, 6.95s/it]
90%|████████▉ | 1631/1813 [3:03:43<20:28, 6.75s/it]
90%|█████████ | 1632/1813 [3:03:48<19:19, 6.41s/it]
90%|█████████ | 1633/1813 [3:03:57<21:09, 7.05s/it]
90%|█████████ | 1634/1813 [3:04:03<19:48, 6.64s/it]
90%|█████████ | 1635/1813 [3:04:10<20:39, 6.96s/it]
90%|█████████ | 1636/1813 [3:04:17<19:51, 6.73s/it]
90%|█████████ | 1637/1813 [3:04:24<20:11, 6.88s/it]
90%|█████████ | 1638/1813 [3:04:30<19:18, 6.62s/it]
90%|█████████ | 1639/1813 [3:04:38<20:09, 6.95s/it]
90%|█████████ | 1640/1813 [3:04:43<19:08, 6.64s/it]
{'loss': '0.903', 'grad_norm': '0.9351', 'learning_rate': '5.354e-06', 'epoch': '0.9048', 'num_input_tokens_seen': 11030048, 'train_runtime': '1.108e+04', 'train_tokens_per_second': '995.1'}
90%|█████████ | 1640/1813 [3:04:43<19:08, 6.64s/it]
91%|█████████ | 1641/1813 [3:04:50<18:57, 6.61s/it]
91%|█████████ | 1642/1813 [3:04:57<19:33, 6.86s/it]
91%|█████████ | 1643/1813 [3:05:04<19:26, 6.86s/it]
91%|█████████ | 1644/1813 [3:05:12<19:59, 7.10s/it]
91%|█████████ | 1645/1813 [3:05:23<22:55, 8.19s/it]
91%|█████████ | 1646/1813 [3:05:30<22:11, 7.97s/it]
91%|█████████ | 1647/1813 [3:05:37<20:55, 7.57s/it]
91%|█████████ | 1648/1813 [3:05:44<20:41, 7.53s/it]
91%|█████████ | 1649/1813 [3:05:50<19:11, 7.02s/it]
91%|█████████ | 1650/1813 [3:05:56<17:58, 6.62s/it]
{'loss': '0.8583', 'grad_norm': '1.028', 'learning_rate': '4.761e-06', 'epoch': '0.9103', 'num_input_tokens_seen': 11098768, 'train_runtime': '1.116e+04', 'train_tokens_per_second': '994.8'}
91%|█████████ | 1650/1813 [3:05:56<17:58, 6.62s/it]
91%|█████████ | 1651/1813 [3:06:03<18:16, 6.77s/it]
91%|█████████ | 1652/1813 [3:06:10<18:35, 6.93s/it]
91%|█████████ | 1653/1813 [3:06:18<19:01, 7.13s/it]
91%|█████████ | 1654/1813 [3:06:25<18:36, 7.02s/it]
91%|█████████▏| 1655/1813 [3:06:32<18:41, 7.10s/it]
91%|█████████▏| 1656/1813 [3:06:38<18:05, 6.92s/it]
91%|█████████▏| 1657/1813 [3:06:47<19:26, 7.48s/it]
91%|█████████▏| 1658/1813 [3:06:54<19:07, 7.41s/it]
92%|█████████▏| 1659/1813 [3:07:02<19:20, 7.54s/it]
92%|█████████▏| 1660/1813 [3:07:09<18:48, 7.38s/it]
{'loss': '0.9241', 'grad_norm': '0.9705', 'learning_rate': '4.202e-06', 'epoch': '0.9159', 'num_input_tokens_seen': 11168848, 'train_runtime': '1.123e+04', 'train_tokens_per_second': '994.6'}
92%|█████████▏| 1660/1813 [3:07:09<18:48, 7.38s/it]
92%|█████████▏| 1661/1813 [3:07:17<19:10, 7.57s/it]
92%|█████████▏| 1662/1813 [3:07:25<19:02, 7.56s/it]
92%|█████████▏| 1663/1813 [3:07:33<19:08, 7.66s/it]
92%|█████████▏| 1664/1813 [3:07:41<19:14, 7.75s/it]
92%|█████████▏| 1665/1813 [3:07:49<19:52, 8.06s/it]
92%|█████████▏| 1666/1813 [3:07:55<17:38, 7.20s/it]
92%|█████████▏| 1667/1813 [3:08:02<17:47, 7.31s/it]
92%|█████████▏| 1668/1813 [3:08:09<17:23, 7.20s/it]
92%|█████████▏| 1669/1813 [3:08:21<20:19, 8.47s/it]
92%|█████████▏| 1670/1813 [3:08:26<18:20, 7.70s/it]
{'loss': '0.8751', 'grad_norm': '1.113', 'learning_rate': '3.677e-06', 'epoch': '0.9214', 'num_input_tokens_seen': 11244288, 'train_runtime': '1.131e+04', 'train_tokens_per_second': '994.5'}
92%|█████████▏| 1670/1813 [3:08:26<18:20, 7.70s/it]
92%|█████████▏| 1671/1813 [3:08:32<16:50, 7.12s/it]
92%|█████████▏| 1672/1813 [3:08:39<16:18, 6.94s/it]
92%|█████████▏| 1673/1813 [3:08:45<15:56, 6.83s/it]
92%|█████████▏| 1674/1813 [3:08:53<16:37, 7.18s/it]
92%|█████████▏| 1675/1813 [3:09:01<17:13, 7.49s/it]
92%|█████████▏| 1676/1813 [3:09:10<17:43, 7.77s/it]
92%|█████████▏| 1677/1813 [3:09:17<17:17, 7.63s/it]
93%|█████████▎| 1678/1813 [3:09:24<16:54, 7.51s/it]
93%|█████████▎| 1679/1813 [3:09:31<16:15, 7.28s/it]
93%|█████████▎| 1680/1813 [3:09:41<18:01, 8.13s/it]
{'loss': '0.9481', 'grad_norm': '1.048', 'learning_rate': '3.187e-06', 'epoch': '0.9269', 'num_input_tokens_seen': 11317056, 'train_runtime': '1.138e+04', 'train_tokens_per_second': '994.3'}
93%|█████████▎| 1680/1813 [3:09:41<18:01, 8.13s/it]
93%|█████████▎| 1681/1813 [3:09:47<16:08, 7.34s/it]
93%|█████████▎| 1682/1813 [3:09:53<15:07, 6.93s/it]
93%|█████████▎| 1683/1813 [3:09:58<13:51, 6.40s/it]
93%|█████████▎| 1684/1813 [3:10:06<14:43, 6.85s/it]
93%|█████████▎| 1685/1813 [3:10:13<15:05, 7.07s/it]
93%|█████████▎| 1686/1813 [3:10:21<15:29, 7.32s/it]
93%|█████████▎| 1687/1813 [3:10:29<15:24, 7.34s/it]
93%|█████████▎| 1688/1813 [3:10:36<15:35, 7.48s/it]
93%|█████████▎| 1689/1813 [3:10:42<14:08, 6.84s/it]
93%|█████████▎| 1690/1813 [3:10:49<14:26, 7.04s/it]
{'loss': '0.8746', 'grad_norm': '0.9118', 'learning_rate': '2.731e-06', 'epoch': '0.9324', 'num_input_tokens_seen': 11380560, 'train_runtime': '1.145e+04', 'train_tokens_per_second': '993.9'}
93%|█████████▎| 1690/1813 [3:10:49<14:26, 7.04s/it]
93%|█████████▎| 1691/1813 [3:10:56<14:21, 7.06s/it]
93%|█████████▎| 1692/1813 [3:11:05<15:14, 7.56s/it]
93%|█████████▎| 1693/1813 [3:11:12<14:46, 7.39s/it]
93%|█████████▎| 1694/1813 [3:11:22<15:55, 8.03s/it]
93%|█████████▎| 1695/1813 [3:11:29<15:04, 7.66s/it]
94%|█████████▎| 1696/1813 [3:11:35<14:20, 7.35s/it]
94%|█████████▎| 1697/1813 [3:11:42<14:08, 7.31s/it]
94%|█████████▎| 1698/1813 [3:11:48<13:16, 6.93s/it]
94%|█████████▎| 1699/1813 [3:11:56<13:19, 7.02s/it]
94%|█████████▍| 1700/1813 [3:12:03<13:16, 7.05s/it]
{'loss': '0.8551', 'grad_norm': '1.133', 'learning_rate': '2.31e-06', 'epoch': '0.9379', 'num_input_tokens_seen': 11450712, 'train_runtime': '1.152e+04', 'train_tokens_per_second': '993.7'}
94%|█████████▍| 1700/1813 [3:12:03<13:16, 7.05s/it]
94%|█████████▍| 1701/1813 [3:12:08<12:10, 6.52s/it]
94%|█████████▍| 1702/1813 [3:12:14<11:45, 6.35s/it]
94%|█████████▍| 1703/1813 [3:12:20<11:44, 6.40s/it]
94%|█████████▍| 1704/1813 [3:12:29<12:53, 7.09s/it]
94%|█████████▍| 1705/1813 [3:12:37<12:59, 7.22s/it]
94%|█████████▍| 1706/1813 [3:12:44<12:57, 7.27s/it]
94%|█████████▍| 1707/1813 [3:12:51<12:23, 7.02s/it]
94%|█████████▍| 1708/1813 [3:12:56<11:28, 6.55s/it]
94%|█████████▍| 1709/1813 [3:13:03<11:36, 6.69s/it]
94%|█████████▍| 1710/1813 [3:13:09<11:21, 6.62s/it]
{'loss': '0.9356', 'grad_norm': '1.195', 'learning_rate': '1.924e-06', 'epoch': '0.9434', 'num_input_tokens_seen': 11511984, 'train_runtime': '1.159e+04', 'train_tokens_per_second': '993.3'}
94%|█████████▍| 1710/1813 [3:13:09<11:21, 6.62s/it]
94%|█████████▍| 1711/1813 [3:13:16<10:57, 6.45s/it]
94%|█████████▍| 1712/1813 [3:13:22<10:53, 6.47s/it]
94%|█████████▍| 1713/1813 [3:13:29<10:53, 6.53s/it]
95%|█████████▍| 1714/1813 [3:13:35<10:48, 6.55s/it]
95%|█████████▍| 1715/1813 [3:13:42<10:34, 6.47s/it]
95%|█████████▍| 1716/1813 [3:13:47<10:05, 6.25s/it]
95%|█████████▍| 1717/1813 [3:13:53<09:53, 6.19s/it]
95%|█████████▍| 1718/1813 [3:14:01<10:15, 6.48s/it]
95%|█████████▍| 1719/1813 [3:14:08<10:30, 6.71s/it]
95%|█████████▍| 1720/1813 [3:14:15<10:28, 6.75s/it]
{'loss': '0.852', 'grad_norm': '0.8845', 'learning_rate': '1.573e-06', 'epoch': '0.949', 'num_input_tokens_seen': 11571368, 'train_runtime': '1.166e+04', 'train_tokens_per_second': '992.8'}
95%|█████████▍| 1720/1813 [3:14:15<10:28, 6.75s/it]
95%|█████████▍| 1721/1813 [3:14:23<11:07, 7.25s/it]
95%|█████████▍| 1722/1813 [3:14:30<10:50, 7.15s/it]
95%|█████████▌| 1723/1813 [3:14:37<10:37, 7.08s/it]
95%|█████████▌| 1724/1813 [3:14:44<10:25, 7.03s/it]
95%|█████████▌| 1725/1813 [3:14:52<10:51, 7.40s/it]
95%|█████████▌| 1726/1813 [3:15:01<11:13, 7.75s/it]
95%|█████████▌| 1727/1813 [3:15:07<10:43, 7.48s/it]
95%|█████████▌| 1728/1813 [3:15:13<09:46, 6.90s/it]
95%|█████████▌| 1729/1813 [3:15:19<09:18, 6.64s/it]
95%|█████████▌| 1730/1813 [3:15:27<09:35, 6.93s/it]
{'loss': '0.9187', 'grad_norm': '0.9346', 'learning_rate': '1.256e-06', 'epoch': '0.9545', 'num_input_tokens_seen': 11640392, 'train_runtime': '1.173e+04', 'train_tokens_per_second': '992.6'}
95%|█████████▌| 1730/1813 [3:15:27<09:35, 6.93s/it]
95%|█████████▌| 1731/1813 [3:15:34<09:32, 6.98s/it]
96%|█████████▌| 1732/1813 [3:15:42<09:44, 7.21s/it]
96%|█████████▌| 1733/1813 [3:15:47<09:03, 6.79s/it]
96%|█████████▌| 1734/1813 [3:15:54<08:53, 6.75s/it]
96%|█████████▌| 1735/1813 [3:16:01<09:03, 6.97s/it]
96%|█████████▌| 1736/1813 [3:16:09<09:16, 7.22s/it]
96%|█████████▌| 1737/1813 [3:16:16<09:04, 7.17s/it]
96%|█████████▌| 1738/1813 [3:16:22<08:23, 6.71s/it]
96%|█████████▌| 1739/1813 [3:16:31<09:11, 7.45s/it]
96%|█████████▌| 1740/1813 [3:16:38<09:02, 7.43s/it]
{'loss': '0.9058', 'grad_norm': '1.098', 'learning_rate': '9.755e-07', 'epoch': '0.96', 'num_input_tokens_seen': 11709120, 'train_runtime': '1.18e+04', 'train_tokens_per_second': '992.4'}
96%|█████████▌| 1740/1813 [3:16:38<09:02, 7.43s/it]
96%|█████████▌| 1741/1813 [3:16:45<08:35, 7.16s/it]
96%|█████████▌| 1742/1813 [3:16:53<08:44, 7.39s/it]
96%|█████████▌| 1743/1813 [3:17:01<08:51, 7.60s/it]
96%|█████████▌| 1744/1813 [3:17:09<08:53, 7.74s/it]
96%|█████████▌| 1745/1813 [3:17:16<08:26, 7.44s/it]
96%|█████████▋| 1746/1813 [3:17:24<08:37, 7.73s/it]
96%|█████████▋| 1747/1813 [3:17:30<07:47, 7.09s/it]
96%|█████████▋| 1748/1813 [3:17:38<08:07, 7.50s/it]
96%|█████████▋| 1749/1813 [3:17:44<07:33, 7.09s/it]
97%|█████████▋| 1750/1813 [3:17:51<07:07, 6.79s/it]
{'loss': '0.8536', 'grad_norm': '0.9043', 'learning_rate': '7.3e-07', 'epoch': '0.9655', 'num_input_tokens_seen': 11777768, 'train_runtime': '1.187e+04', 'train_tokens_per_second': '992.1'}
97%|█████████▋| 1750/1813 [3:17:51<07:07, 6.79s/it]
97%|█████████▋| 1751/1813 [3:17:57<07:02, 6.82s/it]
97%|█████████▋| 1752/1813 [3:18:04<06:54, 6.79s/it]
97%|█████████▋| 1753/1813 [3:18:13<07:21, 7.36s/it]
97%|█████████▋| 1754/1813 [3:18:21<07:30, 7.64s/it]
97%|█████████▋| 1755/1813 [3:18:29<07:19, 7.58s/it]
97%|█████████▋| 1756/1813 [3:18:35<06:47, 7.15s/it]
97%|█████████▋| 1757/1813 [3:18:41<06:27, 6.92s/it]
97%|█████████▋| 1758/1813 [3:18:47<06:11, 6.75s/it]
97%|█████████▋| 1759/1813 [3:18:54<06:04, 6.75s/it]
97%|█████████▋| 1760/1813 [3:19:00<05:44, 6.51s/it]
{'loss': '0.8667', 'grad_norm': '1.107', 'learning_rate': '5.199e-07', 'epoch': '0.971', 'num_input_tokens_seen': 11843192, 'train_runtime': '1.194e+04', 'train_tokens_per_second': '991.8'}
97%|█████████▋| 1760/1813 [3:19:00<05:44, 6.51s/it]
97%|█████████▋| 1761/1813 [3:19:06<05:32, 6.39s/it]
97%|█████████▋| 1762/1813 [3:19:11<05:06, 6.01s/it]
97%|█████████▋| 1763/1813 [3:19:20<05:42, 6.84s/it]
97%|█████████▋| 1764/1813 [3:19:26<05:20, 6.54s/it]
97%|█████████▋| 1765/1813 [3:19:32<05:08, 6.43s/it]
97%|█████████▋| 1766/1813 [3:19:38<04:59, 6.37s/it]
97%|█████████▋| 1767/1813 [3:19:45<04:52, 6.35s/it]
98%|█████████▊| 1768/1813 [3:19:51<04:50, 6.45s/it]
98%|█████████▊| 1769/1813 [3:19:58<04:44, 6.46s/it]
98%|█████████▊| 1770/1813 [3:20:06<04:54, 6.84s/it]
{'loss': '0.8791', 'grad_norm': '0.9812', 'learning_rate': '3.453e-07', 'epoch': '0.9766', 'num_input_tokens_seen': 11903728, 'train_runtime': '1.201e+04', 'train_tokens_per_second': '991.5'}
98%|█████████▊| 1770/1813 [3:20:06<04:54, 6.84s/it]
98%|█████████▊| 1771/1813 [3:20:13<04:51, 6.94s/it]
98%|█████████▊| 1772/1813 [3:20:20<04:48, 7.04s/it]
98%|█████████▊| 1773/1813 [3:20:28<04:52, 7.31s/it]
98%|█████████▊| 1774/1813 [3:20:33<04:19, 6.66s/it]
98%|█████████▊| 1775/1813 [3:20:42<04:35, 7.26s/it]
98%|█████████▊| 1776/1813 [3:20:50<04:41, 7.61s/it]
98%|█████████▊| 1777/1813 [3:20:59<04:45, 7.92s/it]
98%|█████████▊| 1778/1813 [3:21:05<04:20, 7.46s/it]
98%|█████████▊| 1779/1813 [3:21:12<04:01, 7.11s/it]
98%|█████████▊| 1780/1813 [3:21:18<03:51, 7.02s/it]
{'loss': '0.8568', 'grad_norm': '0.9052', 'learning_rate': '2.062e-07', 'epoch': '0.9821', 'num_input_tokens_seen': 11972864, 'train_runtime': '1.208e+04', 'train_tokens_per_second': '991.2'}
98%|█████████▊| 1780/1813 [3:21:18<03:51, 7.02s/it]
98%|█████████▊| 1781/1813 [3:21:25<03:45, 7.05s/it]
98%|█████████▊| 1782/1813 [3:21:32<03:35, 6.94s/it]
98%|█████████▊| 1783/1813 [3:21:39<03:26, 6.89s/it]
98%|█████████▊| 1784/1813 [3:21:47<03:25, 7.10s/it]
98%|█████████▊| 1785/1813 [3:21:53<03:17, 7.04s/it]
99%|█████████▊| 1786/1813 [3:22:00<03:10, 7.05s/it]
99%|█████████▊| 1787/1813 [3:22:07<02:57, 6.81s/it]
99%|█████████▊| 1788/1813 [3:22:14<02:55, 7.04s/it]
99%|█████████▊| 1789/1813 [3:22:24<03:08, 7.86s/it]
99%|█████████▊| 1790/1813 [3:22:32<03:03, 7.98s/it]
{'loss': '0.8838', 'grad_norm': '0.8536', 'learning_rate': '1.028e-07', 'epoch': '0.9876', 'num_input_tokens_seen': 12043496, 'train_runtime': '1.215e+04', 'train_tokens_per_second': '991'}
99%|█████████▊| 1790/1813 [3:22:32<03:03, 7.98s/it]
99%|█████████▉| 1791/1813 [3:22:38<02:42, 7.39s/it]
99%|█████████▉| 1792/1813 [3:22:45<02:33, 7.29s/it]
99%|█████████▉| 1793/1813 [3:22:53<02:28, 7.44s/it]
99%|█████████▉| 1794/1813 [3:23:01<02:25, 7.65s/it]
99%|█████████▉| 1795/1813 [3:23:09<02:18, 7.67s/it]
99%|█████████▉| 1796/1813 [3:23:17<02:10, 7.69s/it]
99%|█████████▉| 1797/1813 [3:23:24<02:00, 7.53s/it]
99%|█████████▉| 1798/1813 [3:23:35<02:06, 8.45s/it]
99%|█████████▉| 1799/1813 [3:23:42<01:53, 8.12s/it]
99%|█████████▉| 1800/1813 [3:23:47<01:33, 7.22s/it]
{'loss': '0.859', 'grad_norm': '1.005', 'learning_rate': '3.497e-08', 'epoch': '0.9931', 'num_input_tokens_seen': 12115448, 'train_runtime': '1.223e+04', 'train_tokens_per_second': '990.8'}
99%|█████████▉| 1800/1813 [3:23:47<01:33, 7.22s/it]
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:11, 13.87it/s]
0%| | 5/1000 [00:00<02:37, 6.33it/s]
1%| | 7/1000 [00:00<02:15, 7.32it/s]
1%| | 9/1000 [00:01<02:55, 5.64it/s]
1%| | 11/1000 [00:01<02:19, 7.09it/s]
1%| | 12/1000 [00:01<02:17, 7.16it/s]
1%|▏ | 13/1000 [00:01<02:48, 5.85it/s]
1%|▏ | 14/1000 [00:02<02:51, 5.74it/s]
2%|▏ | 15/1000 [00:02<03:17, 4.98it/s]
2%|▏ | 16/1000 [00:02<03:24, 4.82it/s]
2%|▏ | 18/1000 [00:03<03:09, 5.19it/s]
2%|▏ | 19/1000 [00:03<03:43, 4.39it/s]
2%|▏ | 20/1000 [00:03<04:10, 3.92it/s]
2%|▏ | 22/1000 [00:03<03:00, 5.41it/s]
2%|▏ | 23/1000 [00:04<03:21, 4.84it/s]
2%|▎ | 25/1000 [00:04<02:31, 6.42it/s]
3%|▎ | 26/1000 [00:04<02:58, 5.47it/s]
3%|▎ | 28/1000 [00:04<03:06, 5.22it/s]
3%|▎ | 29/1000 [00:05<02:55, 5.55it/s]
3%|▎ | 30/1000 [00:05<03:06, 5.20it/s]
3%|▎ | 31/1000 [00:05<03:27, 4.66it/s]
3%|▎ | 32/1000 [00:05<03:04, 5.24it/s]
3%|▎ | 33/1000 [00:05<03:12, 5.03it/s]
4%|▎ | 35/1000 [00:06<02:24, 6.69it/s]
4%|▎ | 37/1000 [00:06<02:05, 7.69it/s]
4%|▍ | 39/1000 [00:06<02:28, 6.48it/s]
4%|▍ | 40/1000 [00:06<02:24, 6.64it/s]
4%|▍ | 42/1000 [00:07<02:04, 7.68it/s]
4%|▍ | 44/1000 [00:07<01:48, 8.77it/s]
4%|▍ | 45/1000 [00:07<02:11, 7.28it/s]
5%|▍ | 47/1000 [00:07<02:30, 6.34it/s]
5%|▍ | 49/1000 [00:08<02:06, 7.49it/s]
5%|▌ | 51/1000 [00:08<01:51, 8.51it/s]
5%|▌ | 53/1000 [00:08<01:43, 9.18it/s]
6%|▌ | 55/1000 [00:08<01:43, 9.15it/s]
6%|▌ | 56/1000 [00:08<02:05, 7.54it/s]
6%|▌ | 58/1000 [00:09<01:56, 8.09it/s]
6%|▌ | 59/1000 [00:09<02:14, 6.99it/s]
6%|▌ | 61/1000 [00:09<01:54, 8.23it/s]
6%|▋ | 63/1000 [00:09<01:48, 8.60it/s]
6%|▋ | 64/1000 [00:09<02:18, 6.78it/s]
7%|▋ | 66/1000 [00:10<01:57, 7.94it/s]
7%|▋ | 67/1000 [00:10<02:27, 6.32it/s]
7%|▋ | 69/1000 [00:10<02:13, 6.97it/s]
7%|▋ | 70/1000 [00:10<02:41, 5.77it/s]
7%|▋ | 72/1000 [00:11<02:44, 5.64it/s]
7%|▋ | 74/1000 [00:11<02:15, 6.82it/s]
8%|▊ | 75/1000 [00:11<02:39, 5.79it/s]
8%|▊ | 76/1000 [00:11<02:43, 5.66it/s]
8%|▊ | 77/1000 [00:12<02:28, 6.21it/s]
8%|▊ | 78/1000 [00:12<02:59, 5.13it/s]
8%|▊ | 80/1000 [00:12<02:14, 6.84it/s]
8%|▊ | 82/1000 [00:12<01:52, 8.15it/s]
8%|▊ | 83/1000 [00:12<02:26, 6.25it/s]
8%|▊ | 85/1000 [00:13<02:33, 5.95it/s]
9%|▊ | 86/1000 [00:13<02:55, 5.21it/s]
9%|▊ | 87/1000 [00:13<03:18, 4.59it/s]
9%|▉ | 89/1000 [00:14<02:31, 6.00it/s]
9%|▉ | 90/1000 [00:14<02:25, 6.24it/s]
9%|▉ | 91/1000 [00:14<02:52, 5.25it/s]
9%|▉ | 92/1000 [00:14<02:52, 5.27it/s]
9%|▉ | 93/1000 [00:14<03:03, 4.94it/s]
9%|▉ | 94/1000 [00:15<02:40, 5.65it/s]
10%|▉ | 95/1000 [00:15<03:24, 4.42it/s]
10%|▉ | 97/1000 [00:15<02:35, 5.80it/s]
10%|▉ | 99/1000 [00:15<02:02, 7.33it/s]
10%|█ | 101/1000 [00:15<01:45, 8.54it/s]
10%|█ | 102/1000 [00:16<02:14, 6.68it/s]
10%|█ | 103/1000 [00:16<02:10, 6.86it/s]
10%|█ | 104/1000 [00:16<02:09, 6.94it/s]
11%|█ | 106/1000 [00:16<01:43, 8.62it/s]
11%|█ | 108/1000 [00:16<01:32, 9.63it/s]
11%|█ | 110/1000 [00:16<01:26, 10.26it/s]
11%|█ | 112/1000 [00:17<01:21, 10.93it/s]
11%|█▏ | 114/1000 [00:17<01:18, 11.27it/s]
12%|█▏ | 116/1000 [00:17<01:17, 11.47it/s]
12%|█▏ | 118/1000 [00:17<01:14, 11.78it/s]
12%|█▏ | 120/1000 [00:18<02:25, 6.04it/s]
12%|█▏ | 122/1000 [00:18<02:04, 7.08it/s]
12%|█▏ | 124/1000 [00:18<02:14, 6.53it/s]
12%|█▎ | 125/1000 [00:19<02:55, 5.00it/s]
13%|█▎ | 126/1000 [00:19<02:42, 5.37it/s]
13%|█▎ | 127/1000 [00:19<02:52, 5.05it/s]
13%|█▎ | 128/1000 [00:19<03:09, 4.61it/s]
13%|█▎ | 130/1000 [00:20<02:20, 6.21it/s]
13%|█▎ | 132/1000 [00:20<01:53, 7.63it/s]
13%|█▎ | 134/1000 [00:20<01:37, 8.88it/s]
14%|█▎ | 136/1000 [00:20<01:42, 8.46it/s]
14%|█▎ | 137/1000 [00:20<01:43, 8.30it/s]
14%|█▍ | 139/1000 [00:21<01:40, 8.59it/s]
14%|█▍ | 141/1000 [00:21<01:39, 8.66it/s]
14%|█▍ | 142/1000 [00:21<01:48, 7.93it/s]
14%|█▍ | 143/1000 [00:21<01:50, 7.74it/s]
14%|█▍ | 145/1000 [00:21<01:35, 8.92it/s]
15%|█▍ | 147/1000 [00:22<01:56, 7.34it/s]
15%|█▍ | 148/1000 [00:22<01:57, 7.28it/s]
15%|█▌ | 150/1000 [00:22<01:40, 8.49it/s]
15%|█▌ | 152/1000 [00:22<01:29, 9.49it/s]
15%|█▌ | 154/1000 [00:22<01:34, 8.94it/s]
16%|█▌ | 155/1000 [00:23<02:04, 6.77it/s]
16%|█▌ | 156/1000 [00:23<02:39, 5.29it/s]
16%|█▌ | 158/1000 [00:23<02:04, 6.77it/s]
16%|█▌ | 160/1000 [00:23<01:52, 7.46it/s]
16%|█▌ | 162/1000 [00:24<02:07, 6.58it/s]
16%|█▋ | 163/1000 [00:24<02:11, 6.35it/s]
16%|█▋ | 164/1000 [00:24<02:33, 5.44it/s]
16%|█▋ | 165/1000 [00:24<02:56, 4.73it/s]
17%|█▋ | 166/1000 [00:25<03:11, 4.36it/s]
17%|█▋ | 167/1000 [00:25<02:49, 4.92it/s]
17%|█▋ | 169/1000 [00:25<02:02, 6.77it/s]
17%|█▋ | 171/1000 [00:25<02:13, 6.22it/s]
17%|█▋ | 172/1000 [00:26<02:34, 5.35it/s]
17%|█▋ | 173/1000 [00:26<02:36, 5.28it/s]
17%|█▋ | 174/1000 [00:26<02:23, 5.75it/s]
18%|█▊ | 176/1000 [00:26<01:53, 7.26it/s]
18%|█▊ | 177/1000 [00:26<02:20, 5.87it/s]
18%|█▊ | 179/1000 [00:27<01:50, 7.45it/s]
18%|█▊ | 180/1000 [00:27<01:50, 7.40it/s]
18%|█▊ | 181/1000 [00:27<02:19, 5.89it/s]
18%|█▊ | 182/1000 [00:27<02:44, 4.98it/s]
18%|█▊ | 183/1000 [00:27<02:41, 5.05it/s]
18%|█▊ | 185/1000 [00:28<02:00, 6.76it/s]
19%|█▊ | 186/1000 [00:28<01:57, 6.90it/s]
19%|█▊ | 187/1000 [00:28<02:25, 5.59it/s]
19%|█▉ | 189/1000 [00:28<01:54, 7.11it/s]
19%|█▉ | 190/1000 [00:29<02:19, 5.82it/s]
19%|█▉ | 192/1000 [00:29<02:21, 5.70it/s]
19%|█▉ | 194/1000 [00:29<02:23, 5.62it/s]
20%|█▉ | 196/1000 [00:29<01:57, 6.82it/s]
20%|█▉ | 198/1000 [00:30<01:39, 8.09it/s]
20%|██ | 200/1000 [00:30<01:24, 9.46it/s]
20%|██ | 202/1000 [00:30<01:43, 7.73it/s]
20%|██ | 204/1000 [00:30<01:44, 7.59it/s]
21%|██ | 206/1000 [00:30<01:30, 8.79it/s]
21%|██ | 208/1000 [00:31<01:45, 7.51it/s]
21%|██ | 210/1000 [00:31<01:45, 7.46it/s]
21%|██ | 212/1000 [00:31<01:32, 8.51it/s]
21%|██▏ | 213/1000 [00:31<01:42, 7.68it/s]
21%|██▏ | 214/1000 [00:32<01:42, 7.68it/s]
22%|██▏ | 216/1000 [00:32<01:36, 8.17it/s]
22%|██▏ | 217/1000 [00:32<02:01, 6.45it/s]
22%|██▏ | 219/1000 [00:32<01:44, 7.50it/s]
22%|██▏ | 220/1000 [00:33<02:27, 5.30it/s]
22%|██▏ | 221/1000 [00:33<02:25, 5.36it/s]
22%|██▏ | 223/1000 [00:33<02:43, 4.74it/s]
22%|██▏ | 224/1000 [00:33<02:29, 5.20it/s]
22%|██▎ | 225/1000 [00:34<02:27, 5.26it/s]
23%|██▎ | 226/1000 [00:34<02:49, 4.57it/s]
23%|██▎ | 228/1000 [00:34<02:12, 5.83it/s]
23%|██▎ | 229/1000 [00:34<02:31, 5.09it/s]
23%|██▎ | 230/1000 [00:35<02:20, 5.48it/s]
23%|██▎ | 231/1000 [00:35<02:06, 6.06it/s]
23%|██▎ | 233/1000 [00:35<01:48, 7.09it/s]
24%|██▎ | 235/1000 [00:35<01:29, 8.59it/s]
24%|██▎ | 236/1000 [00:35<01:30, 8.42it/s]
24%|██▎ | 237/1000 [00:35<01:33, 8.12it/s]
24%|██▍ | 239/1000 [00:36<01:39, 7.67it/s]
24%|██▍ | 240/1000 [00:36<01:35, 7.97it/s]
24%|██▍ | 241/1000 [00:36<01:53, 6.67it/s]
24%|██▍ | 242/1000 [00:36<02:46, 4.54it/s]
24%|██▍ | 243/1000 [00:37<02:58, 4.23it/s]
24%|██▍ | 244/1000 [00:37<02:32, 4.97it/s]
24%|██▍ | 245/1000 [00:37<02:17, 5.51it/s]
25%|██▍ | 247/1000 [00:37<01:41, 7.42it/s]
25%|██▍ | 248/1000 [00:37<02:07, 5.88it/s]
25%|██▍ | 249/1000 [00:38<02:28, 5.04it/s]
25%|██▌ | 250/1000 [00:38<02:31, 4.96it/s]
25%|██▌ | 252/1000 [00:38<02:26, 5.11it/s]
25%|██▌ | 253/1000 [00:38<02:32, 4.89it/s]
26%|██▌ | 255/1000 [00:39<01:57, 6.36it/s]
26%|██▌ | 256/1000 [00:39<01:51, 6.67it/s]
26%|██▌ | 258/1000 [00:39<01:37, 7.58it/s]
26%|██▌ | 260/1000 [00:39<01:50, 6.68it/s]
26%|██▌ | 261/1000 [00:40<02:13, 5.53it/s]
26%|██▌ | 262/1000 [00:40<02:14, 5.48it/s]
26%|██▋ | 264/1000 [00:40<02:15, 5.44it/s]
26%|██▋ | 265/1000 [00:40<02:09, 5.68it/s]
27%|██▋ | 266/1000 [00:40<02:02, 5.98it/s]
27%|██▋ | 268/1000 [00:41<01:56, 6.29it/s]
27%|██▋ | 270/1000 [00:41<02:01, 6.00it/s]
27%|██▋ | 271/1000 [00:42<02:36, 4.65it/s]
27%|██▋ | 273/1000 [00:42<02:31, 4.80it/s]
28%|██▊ | 275/1000 [00:42<02:07, 5.68it/s]
28%|██▊ | 277/1000 [00:42<01:45, 6.88it/s]
28%|██▊ | 278/1000 [00:43<02:06, 5.71it/s]
28%|██▊ | 280/1000 [00:43<02:07, 5.65it/s]
28%|██▊ | 282/1000 [00:43<01:44, 6.87it/s]
28%|██▊ | 283/1000 [00:44<02:25, 4.94it/s]
28%|██▊ | 284/1000 [00:44<02:28, 4.83it/s]
29%|██▊ | 286/1000 [00:44<01:52, 6.33it/s]
29%|██▉ | 288/1000 [00:44<01:35, 7.47it/s]
29%|██▉ | 290/1000 [00:45<01:48, 6.57it/s]
29%|██▉ | 291/1000 [00:45<01:59, 5.93it/s]
29%|██▉ | 292/1000 [00:45<02:16, 5.18it/s]
29%|██▉ | 293/1000 [00:45<02:01, 5.82it/s]
29%|██▉ | 294/1000 [00:45<01:54, 6.17it/s]
30%|██▉ | 296/1000 [00:46<01:59, 5.91it/s]
30%|██▉ | 298/1000 [00:46<01:37, 7.21it/s]
30%|██▉ | 299/1000 [00:46<02:06, 5.55it/s]
30%|███ | 300/1000 [00:46<02:01, 5.78it/s]
30%|███ | 301/1000 [00:46<01:55, 6.05it/s]
30%|███ | 303/1000 [00:47<01:32, 7.57it/s]
30%|███ | 304/1000 [00:47<01:39, 6.99it/s]
30%|███ | 305/1000 [00:47<01:40, 6.91it/s]
31%|███ | 306/1000 [00:47<01:58, 5.86it/s]
31%|███ | 307/1000 [00:47<02:00, 5.75it/s]
31%|███ | 309/1000 [00:48<01:31, 7.56it/s]
31%|███ | 311/1000 [00:48<01:17, 8.84it/s]
31%|███ | 312/1000 [00:48<01:16, 9.02it/s]
31%|███▏ | 314/1000 [00:48<01:11, 9.58it/s]
32%|███▏ | 315/1000 [00:48<01:18, 8.70it/s]
32%|███▏ | 316/1000 [00:48<01:29, 7.64it/s]
32%|███▏ | 317/1000 [00:48<01:25, 7.97it/s]
32%|███▏ | 319/1000 [00:49<01:58, 5.73it/s]
32%|███▏ | 321/1000 [00:49<02:01, 5.59it/s]
32%|███▏ | 322/1000 [00:50<02:08, 5.29it/s]
32%|███▏ | 324/1000 [00:50<01:42, 6.60it/s]
32%|███▎ | 325/1000 [00:50<02:23, 4.69it/s]
33%|███▎ | 327/1000 [00:50<01:47, 6.26it/s]
33%|███▎ | 328/1000 [00:50<01:49, 6.11it/s]
33%|███▎ | 330/1000 [00:51<01:54, 5.85it/s]
33%|███▎ | 332/1000 [00:51<02:00, 5.57it/s]
33%|███▎ | 333/1000 [00:51<01:52, 5.92it/s]
33%|███▎ | 334/1000 [00:52<02:01, 5.47it/s]
34%|███▎ | 336/1000 [00:52<01:35, 6.94it/s]
34%|███▍ | 338/1000 [00:52<01:26, 7.66it/s]
34%|███▍ | 340/1000 [00:52<01:15, 8.75it/s]
34%|███▍ | 342/1000 [00:52<01:09, 9.50it/s]
34%|███▍ | 344/1000 [00:53<01:41, 6.49it/s]
34%|███▍ | 345/1000 [00:53<01:38, 6.62it/s]
35%|███▍ | 346/1000 [00:53<01:45, 6.23it/s]
35%|███▍ | 347/1000 [00:53<01:41, 6.44it/s]
35%|███▍ | 349/1000 [00:54<01:48, 6.01it/s]
35%|███▌ | 350/1000 [00:54<02:08, 5.06it/s]
35%|███▌ | 352/1000 [00:54<01:39, 6.52it/s]
35%|███▌ | 354/1000 [00:54<01:38, 6.53it/s]
36%|███▌ | 355/1000 [00:55<01:41, 6.38it/s]
36%|███▌ | 357/1000 [00:55<01:22, 7.77it/s]
36%|███▌ | 359/1000 [00:55<01:09, 9.28it/s]
36%|███▌ | 361/1000 [00:55<01:19, 8.03it/s]
36%|███▋ | 363/1000 [00:56<01:42, 6.20it/s]
36%|███▋ | 364/1000 [00:56<01:56, 5.45it/s]
36%|███▋ | 365/1000 [00:56<02:32, 4.17it/s]
37%|███▋ | 367/1000 [00:57<02:17, 4.60it/s]
37%|███▋ | 368/1000 [00:57<02:25, 4.33it/s]
37%|███▋ | 369/1000 [00:57<02:10, 4.83it/s]
37%|███▋ | 371/1000 [00:57<01:40, 6.23it/s]
37%|███▋ | 372/1000 [00:58<01:37, 6.45it/s]
37%|███▋ | 374/1000 [00:58<01:33, 6.70it/s]
38%|███▊ | 375/1000 [00:58<01:59, 5.24it/s]
38%|███▊ | 376/1000 [00:58<02:17, 4.55it/s]
38%|███▊ | 377/1000 [00:59<02:01, 5.13it/s]
38%|███▊ | 378/1000 [00:59<01:45, 5.87it/s]
38%|███▊ | 380/1000 [00:59<01:18, 7.93it/s]
38%|███▊ | 381/1000 [00:59<01:17, 7.96it/s]
38%|███▊ | 382/1000 [00:59<01:32, 6.69it/s]
38%|███▊ | 384/1000 [00:59<01:16, 8.02it/s]
38%|███▊ | 385/1000 [00:59<01:18, 7.88it/s]
39%|███▊ | 386/1000 [01:00<01:15, 8.13it/s]
39%|███▊ | 387/1000 [01:00<01:45, 5.78it/s]
39%|███▉ | 388/1000 [01:00<01:47, 5.71it/s]
39%|███▉ | 389/1000 [01:00<01:35, 6.37it/s]
39%|███▉ | 390/1000 [01:00<01:32, 6.60it/s]
39%|███▉ | 391/1000 [01:01<01:41, 6.02it/s]
39%|███▉ | 393/1000 [01:01<01:17, 7.78it/s]
40%|███▉ | 395/1000 [01:01<01:35, 6.35it/s]
40%|███▉ | 397/1000 [01:01<01:18, 7.64it/s]
40%|███▉ | 398/1000 [01:02<01:38, 6.09it/s]
40%|███▉ | 399/1000 [01:02<02:00, 5.00it/s]
40%|████ | 400/1000 [01:02<02:11, 4.56it/s]
40%|████ | 402/1000 [01:03<02:03, 4.84it/s]
40%|████ | 404/1000 [01:03<01:36, 6.18it/s]
41%|████ | 406/1000 [01:03<01:20, 7.38it/s]
41%|████ | 407/1000 [01:03<01:36, 6.12it/s]
41%|████ | 408/1000 [01:03<01:46, 5.55it/s]
41%|████ | 410/1000 [01:04<01:46, 5.56it/s]
41%|████ | 411/1000 [01:04<01:58, 4.98it/s]
41%|████ | 412/1000 [01:04<02:09, 4.55it/s]
41%|████▏ | 414/1000 [01:04<01:34, 6.20it/s]
42%|████▏ | 416/1000 [01:05<01:37, 5.97it/s]
42%|████▏ | 418/1000 [01:05<01:19, 7.29it/s]
42%|████▏ | 420/1000 [01:05<01:19, 7.27it/s]
42%|████▏ | 421/1000 [01:05<01:29, 6.46it/s]
42%|████▏ | 423/1000 [01:06<01:41, 5.66it/s]
42%|████▏ | 424/1000 [01:06<01:53, 5.06it/s]
42%|████▎ | 425/1000 [01:06<01:45, 5.47it/s]
43%|████▎ | 427/1000 [01:06<01:23, 6.85it/s]
43%|████▎ | 428/1000 [01:07<01:29, 6.36it/s]
43%|████▎ | 429/1000 [01:07<01:26, 6.63it/s]
43%|████▎ | 431/1000 [01:07<01:09, 8.16it/s]
43%|████▎ | 433/1000 [01:07<01:01, 9.23it/s]
44%|████▎ | 435/1000 [01:07<00:56, 10.01it/s]
44%|████▎ | 437/1000 [01:08<01:02, 9.03it/s]
44%|████▍ | 439/1000 [01:08<01:20, 6.96it/s]
44%|████▍ | 441/1000 [01:08<01:09, 8.05it/s]
44%|████▍ | 442/1000 [01:08<01:25, 6.56it/s]
44%|████▍ | 444/1000 [01:09<01:27, 6.36it/s]
45%|████▍ | 446/1000 [01:09<01:12, 7.60it/s]
45%|████▍ | 448/1000 [01:09<01:24, 6.51it/s]
45%|████▌ | 450/1000 [01:10<01:29, 6.12it/s]
45%|████▌ | 451/1000 [01:10<01:43, 5.30it/s]
45%|████▌ | 452/1000 [01:10<01:54, 4.80it/s]
45%|████▌ | 454/1000 [01:10<01:30, 6.06it/s]
46%|████▌ | 456/1000 [01:11<01:16, 7.14it/s]
46%|████▌ | 457/1000 [01:11<01:24, 6.40it/s]
46%|████▌ | 459/1000 [01:11<01:10, 7.64it/s]
46%|████▌ | 461/1000 [01:11<00:59, 9.02it/s]
46%|████▋ | 463/1000 [01:12<01:24, 6.35it/s]
46%|████▋ | 465/1000 [01:12<01:33, 5.71it/s]
47%|████▋ | 466/1000 [01:12<01:46, 5.03it/s]
47%|████▋ | 467/1000 [01:13<02:10, 4.08it/s]
47%|████▋ | 469/1000 [01:13<01:38, 5.37it/s]
47%|████▋ | 471/1000 [01:13<01:18, 6.73it/s]
47%|████▋ | 472/1000 [01:13<01:14, 7.07it/s]
47%|████▋ | 473/1000 [01:14<01:22, 6.39it/s]
47%|████▋ | 474/1000 [01:14<01:39, 5.27it/s]
48%|████▊ | 476/1000 [01:14<01:38, 5.32it/s]
48%|████▊ | 477/1000 [01:15<01:54, 4.56it/s]
48%|████▊ | 479/1000 [01:15<01:25, 6.13it/s]
48%|████▊ | 480/1000 [01:15<01:32, 5.62it/s]
48%|████▊ | 482/1000 [01:15<01:16, 6.74it/s]
48%|████▊ | 484/1000 [01:15<01:22, 6.24it/s]
48%|████▊ | 485/1000 [01:16<01:35, 5.41it/s]
49%|████▊ | 486/1000 [01:16<01:34, 5.42it/s]
49%|████▊ | 487/1000 [01:16<01:24, 6.07it/s]
49%|████▉ | 489/1000 [01:16<01:27, 5.81it/s]
49%|████▉ | 491/1000 [01:17<01:11, 7.15it/s]
49%|████▉ | 492/1000 [01:17<01:10, 7.23it/s]
49%|████▉ | 494/1000 [01:17<00:58, 8.64it/s]
50%|████▉ | 496/1000 [01:17<01:09, 7.30it/s]
50%|████▉ | 498/1000 [01:17<01:09, 7.20it/s]
50%|████▉ | 499/1000 [01:18<01:27, 5.73it/s]
50%|█████ | 500/1000 [01:18<01:37, 5.11it/s]
50%|█████ | 502/1000 [01:18<01:18, 6.33it/s]
50%|█████ | 503/1000 [01:19<01:25, 5.79it/s]
50%|█████ | 505/1000 [01:19<01:27, 5.66it/s]
51%|█████ | 506/1000 [01:19<01:40, 4.92it/s]
51%|█████ | 508/1000 [01:19<01:17, 6.36it/s]
51%|█████ | 510/1000 [01:19<01:03, 7.69it/s]
51%|█████ | 512/1000 [01:20<00:56, 8.61it/s]
51%|█████▏ | 514/1000 [01:20<01:18, 6.17it/s]
52%|█████▏ | 515/1000 [01:20<01:15, 6.43it/s]
52%|█████▏ | 516/1000 [01:21<01:19, 6.08it/s]
52%|█████▏ | 518/1000 [01:21<01:09, 6.97it/s]
52%|█████▏ | 519/1000 [01:21<01:27, 5.53it/s]
52%|█████▏ | 521/1000 [01:21<01:08, 6.98it/s]
52%|█████▏ | 522/1000 [01:21<01:22, 5.82it/s]
52%|█████▏ | 523/1000 [01:22<01:36, 4.93it/s]
52%|█████▏ | 524/1000 [01:22<01:39, 4.78it/s]
53%|█████▎ | 526/1000 [01:22<01:23, 5.70it/s]
53%|█████▎ | 528/1000 [01:23<01:23, 5.69it/s]
53%|█████▎ | 529/1000 [01:23<01:24, 5.56it/s]
53%|█████▎ | 531/1000 [01:23<01:07, 6.94it/s]
53%|█████▎ | 533/1000 [01:23<00:55, 8.39it/s]
53%|█████▎ | 534/1000 [01:23<01:09, 6.66it/s]
54%|█████▎ | 535/1000 [01:24<01:23, 5.59it/s]
54%|█████▎ | 536/1000 [01:24<01:30, 5.14it/s]
54%|█████▎ | 537/1000 [01:24<01:40, 4.62it/s]
54%|█████▍ | 539/1000 [01:25<01:32, 5.00it/s]
54%|█████▍ | 540/1000 [01:25<01:33, 4.89it/s]
54%|█████▍ | 541/1000 [01:25<01:42, 4.48it/s]
54%|█████▍ | 543/1000 [01:25<01:15, 6.03it/s]
54%|█████▍ | 544/1000 [01:25<01:09, 6.60it/s]
55%|█████▍ | 545/1000 [01:26<01:17, 5.86it/s]
55%|█████▍ | 546/1000 [01:26<01:25, 5.34it/s]
55%|█████▍ | 547/1000 [01:26<01:40, 4.50it/s]
55%|█████▍ | 549/1000 [01:26<01:32, 4.89it/s]
55%|█████▌ | 551/1000 [01:27<01:10, 6.40it/s]
55%|█████▌ | 552/1000 [01:27<01:11, 6.23it/s]
55%|█████▌ | 553/1000 [01:27<01:24, 5.28it/s]
55%|█████▌ | 554/1000 [01:27<01:27, 5.11it/s]
56%|█████▌ | 555/1000 [01:27<01:16, 5.84it/s]
56%|█████▌ | 557/1000 [01:28<01:11, 6.20it/s]
56%|█████▌ | 559/1000 [01:28<00:56, 7.74it/s]
56%|█████▌ | 561/1000 [01:28<00:49, 8.81it/s]
56%|█████▋ | 563/1000 [01:28<00:59, 7.33it/s]
56%|█████▋ | 565/1000 [01:29<01:02, 6.97it/s]
57%|█████▋ | 566/1000 [01:29<01:13, 5.91it/s]
57%|█████▋ | 568/1000 [01:29<01:15, 5.75it/s]
57%|█████▋ | 569/1000 [01:30<01:17, 5.53it/s]
57%|█████▋ | 571/1000 [01:30<01:17, 5.55it/s]
57%|█████▋ | 572/1000 [01:30<01:18, 5.45it/s]
57%|█████▋ | 574/1000 [01:31<01:19, 5.38it/s]
58%|█████▊ | 576/1000 [01:31<01:03, 6.67it/s]
58%|█████▊ | 577/1000 [01:31<01:26, 4.90it/s]
58%|█████▊ | 578/1000 [01:31<01:33, 4.53it/s]
58%|█████▊ | 580/1000 [01:32<01:09, 6.03it/s]
58%|█████▊ | 582/1000 [01:32<00:56, 7.41it/s]
58%|█████▊ | 583/1000 [01:32<01:10, 5.92it/s]
58%|█████▊ | 585/1000 [01:32<01:08, 6.06it/s]
59%|█████▊ | 587/1000 [01:33<01:05, 6.27it/s]
59%|█████▉ | 589/1000 [01:33<00:54, 7.48it/s]
59%|█████▉ | 590/1000 [01:33<01:09, 5.90it/s]
59%|█████▉ | 592/1000 [01:33<00:57, 7.09it/s]
59%|█████▉ | 593/1000 [01:34<01:08, 5.95it/s]
60%|█████▉ | 595/1000 [01:34<00:55, 7.35it/s]
60%|█████▉ | 596/1000 [01:34<01:08, 5.87it/s]
60%|█████▉ | 597/1000 [01:34<01:10, 5.71it/s]
60%|█████▉ | 599/1000 [01:35<01:11, 5.59it/s]
60%|██████ | 601/1000 [01:35<01:11, 5.56it/s]
60%|██████ | 602/1000 [01:35<01:10, 5.68it/s]
60%|██████ | 604/1000 [01:36<01:21, 4.87it/s]
61%|██████ | 606/1000 [01:36<01:04, 6.12it/s]
61%|██████ | 608/1000 [01:36<00:57, 6.81it/s]
61%|██████ | 610/1000 [01:36<00:53, 7.36it/s]
61%|██████ | 612/1000 [01:36<00:45, 8.45it/s]
61%|██████▏ | 614/1000 [01:37<00:41, 9.23it/s]
62%|██████▏ | 616/1000 [01:37<00:58, 6.52it/s]
62%|██████▏ | 617/1000 [01:37<00:57, 6.65it/s]
62%|██████▏ | 619/1000 [01:37<00:48, 7.82it/s]
62%|██████▏ | 621/1000 [01:38<00:55, 6.79it/s]
62%|██████▏ | 623/1000 [01:38<00:53, 7.00it/s]
62%|██████▎ | 625/1000 [01:38<00:58, 6.44it/s]
63%|██████▎ | 627/1000 [01:39<00:49, 7.50it/s]
63%|██████▎ | 628/1000 [01:39<00:59, 6.25it/s]
63%|██████▎ | 629/1000 [01:39<01:08, 5.43it/s]
63%|██████▎ | 631/1000 [01:39<00:54, 6.71it/s]
63%|██████▎ | 633/1000 [01:39<00:45, 8.08it/s]
63%|██████▎ | 634/1000 [01:40<01:06, 5.51it/s]
64%|██████▎ | 635/1000 [01:40<01:01, 5.89it/s]
64%|██████▎ | 636/1000 [01:40<00:57, 6.28it/s]
64%|██████▍ | 638/1000 [01:40<00:50, 7.14it/s]
64%|██████▍ | 640/1000 [01:41<00:43, 8.36it/s]
64%|██████▍ | 641/1000 [01:41<00:54, 6.58it/s]
64%|██████▍ | 643/1000 [01:41<00:53, 6.71it/s]
64%|██████▍ | 645/1000 [01:41<00:57, 6.23it/s]
65%|██████▍ | 647/1000 [01:42<00:53, 6.65it/s]
65%|██████▍ | 648/1000 [01:42<01:01, 5.72it/s]
65%|██████▌ | 650/1000 [01:42<01:00, 5.77it/s]
65%|██████▌ | 652/1000 [01:43<01:03, 5.52it/s]
65%|██████▌ | 654/1000 [01:43<00:51, 6.74it/s]
66%|██████▌ | 655/1000 [01:43<00:48, 7.16it/s]
66%|██████▌ | 657/1000 [01:43<00:52, 6.50it/s]
66%|██████▌ | 659/1000 [01:44<01:02, 5.46it/s]
66%|██████▌ | 661/1000 [01:44<00:50, 6.73it/s]
66%|██████▌ | 662/1000 [01:44<00:58, 5.79it/s]
66%|██████▋ | 664/1000 [01:45<01:05, 5.13it/s]
66%|██████▋ | 665/1000 [01:45<01:12, 4.63it/s]
67%|██████▋ | 667/1000 [01:45<01:08, 4.86it/s]
67%|██████▋ | 668/1000 [01:46<01:13, 4.53it/s]
67%|██████▋ | 669/1000 [01:46<01:07, 4.87it/s]
67%|██████▋ | 671/1000 [01:46<01:05, 5.06it/s]
67%|██████▋ | 673/1000 [01:46<00:58, 5.59it/s]
68%|██████▊ | 675/1000 [01:47<00:52, 6.19it/s]
68%|██████▊ | 677/1000 [01:47<00:43, 7.39it/s]
68%|██████▊ | 679/1000 [01:47<00:39, 8.16it/s]
68%|██████▊ | 681/1000 [01:47<00:34, 9.20it/s]
68%|██████▊ | 683/1000 [01:48<00:41, 7.65it/s]
68%|██████▊ | 685/1000 [01:48<00:37, 8.50it/s]
69%|██████▊ | 686/1000 [01:48<00:47, 6.57it/s]
69%|██████▊ | 687/1000 [01:48<00:55, 5.62it/s]
69%|██████▉ | 688/1000 [01:48<00:51, 6.00it/s]
69%|██████▉ | 690/1000 [01:49<00:53, 5.77it/s]
69%|██████▉ | 692/1000 [01:49<00:45, 6.77it/s]
69%|██████▉ | 694/1000 [01:49<00:49, 6.16it/s]
70%|██████▉ | 695/1000 [01:50<00:48, 6.35it/s]
70%|██████▉ | 696/1000 [01:50<00:55, 5.43it/s]
70%|██████▉ | 698/1000 [01:50<00:50, 6.00it/s]
70%|██████▉ | 699/1000 [01:50<00:57, 5.23it/s]
70%|███████ | 701/1000 [01:51<00:46, 6.43it/s]
70%|███████ | 702/1000 [01:51<01:01, 4.82it/s]
70%|███████ | 704/1000 [01:51<00:47, 6.24it/s]
70%|███████ | 705/1000 [01:52<01:04, 4.55it/s]
71%|███████ | 707/1000 [01:52<00:48, 5.98it/s]
71%|███████ | 709/1000 [01:52<00:44, 6.53it/s]
71%|███████ | 710/1000 [01:52<00:51, 5.61it/s]
71%|███████ | 712/1000 [01:53<00:42, 6.72it/s]
71%|███████▏ | 713/1000 [01:53<00:41, 6.86it/s]
72%|███████▏ | 715/1000 [01:53<00:34, 8.18it/s]
72%|███████▏ | 716/1000 [01:53<00:45, 6.28it/s]
72%|███████▏ | 718/1000 [01:53<00:47, 5.99it/s]
72%|███████▏ | 719/1000 [01:54<00:53, 5.24it/s]
72%|███████▏ | 720/1000 [01:54<00:49, 5.69it/s]
72%|███████▏ | 722/1000 [01:54<00:40, 6.91it/s]
72%|███████▏ | 723/1000 [01:54<00:39, 7.06it/s]
72%|███████▏ | 724/1000 [01:54<00:38, 7.11it/s]
72%|███████▎ | 725/1000 [01:54<00:38, 7.19it/s]
73%|███████▎ | 727/1000 [01:55<00:31, 8.77it/s]
73%|███████▎ | 729/1000 [01:55<00:26, 10.08it/s]
73%|███████▎ | 731/1000 [01:55<00:37, 7.25it/s]
73%|███████▎ | 733/1000 [01:55<00:32, 8.31it/s]
73%|███████▎ | 734/1000 [01:56<00:33, 7.99it/s]
74%|███████▎ | 736/1000 [01:56<00:34, 7.67it/s]
74%|███████▍ | 738/1000 [01:56<00:31, 8.30it/s]
74%|███████▍ | 740/1000 [01:56<00:28, 9.11it/s]
74%|███████▍ | 741/1000 [01:56<00:37, 6.88it/s]
74%|███████▍ | 743/1000 [01:57<00:36, 7.05it/s]
74%|███████▍ | 745/1000 [01:57<00:30, 8.28it/s]
75%|███████▍ | 747/1000 [01:57<00:27, 9.11it/s]
75%|███████▍ | 748/1000 [01:57<00:36, 6.96it/s]
75%|███████▌ | 750/1000 [01:58<00:37, 6.68it/s]
75%|███████▌ | 751/1000 [01:58<00:46, 5.37it/s]
75%|███████▌ | 753/1000 [01:58<00:39, 6.30it/s]
75%|███████▌ | 754/1000 [01:59<00:45, 5.43it/s]
76%|███████▌ | 756/1000 [01:59<00:44, 5.49it/s]
76%|███████▌ | 758/1000 [01:59<00:37, 6.52it/s]
76%|███████▌ | 759/1000 [01:59<00:38, 6.33it/s]
76%|███████▌ | 761/1000 [01:59<00:31, 7.56it/s]
76%|███████▋ | 763/1000 [02:00<00:35, 6.71it/s]
76%|███████▋ | 764/1000 [02:00<00:40, 5.78it/s]
77%|███████▋ | 766/1000 [02:00<00:41, 5.67it/s]
77%|███████▋ | 768/1000 [02:01<00:33, 6.84it/s]
77%|███████▋ | 769/1000 [02:01<00:39, 5.84it/s]
77%|███████▋ | 770/1000 [02:01<00:39, 5.76it/s]
77%|███████▋ | 772/1000 [02:01<00:31, 7.17it/s]
77%|███████▋ | 773/1000 [02:02<00:40, 5.58it/s]
77%|███████▋ | 774/1000 [02:02<00:38, 5.95it/s]
78%|███████▊ | 776/1000 [02:02<00:32, 6.93it/s]
78%|███████▊ | 778/1000 [02:02<00:26, 8.50it/s]
78%|███████▊ | 780/1000 [02:03<00:36, 6.08it/s]
78%|███████▊ | 782/1000 [02:03<00:29, 7.32it/s]
78%|███████▊ | 783/1000 [02:03<00:35, 6.10it/s]
78%|███████▊ | 784/1000 [02:03<00:34, 6.34it/s]
79%|███████▊ | 786/1000 [02:03<00:31, 6.74it/s]
79%|███████▉ | 788/1000 [02:04<00:28, 7.54it/s]
79%|███████▉ | 790/1000 [02:04<00:25, 8.09it/s]
79%|███████▉ | 791/1000 [02:04<00:28, 7.28it/s]
79%|███████▉ | 792/1000 [02:04<00:30, 6.82it/s]
79%|███████▉ | 793/1000 [02:04<00:29, 7.06it/s]
80%|███████▉ | 795/1000 [02:05<00:32, 6.34it/s]
80%|███████▉ | 797/1000 [02:05<00:33, 6.02it/s]
80%|███████▉ | 798/1000 [02:05<00:38, 5.28it/s]
80%|████████ | 800/1000 [02:06<00:33, 5.93it/s]
80%|████████ | 802/1000 [02:06<00:29, 6.74it/s]
80%|████████ | 804/1000 [02:06<00:28, 6.86it/s]
81%|████████ | 806/1000 [02:06<00:24, 7.86it/s]
81%|████████ | 807/1000 [02:06<00:24, 7.77it/s]
81%|████████ | 809/1000 [02:07<00:21, 8.86it/s]
81%|████████ | 811/1000 [02:07<00:19, 9.75it/s]
81%|████████▏ | 813/1000 [02:07<00:24, 7.65it/s]
81%|████████▏ | 814/1000 [02:07<00:24, 7.63it/s]
82%|████████▏ | 816/1000 [02:07<00:21, 8.62it/s]
82%|████████▏ | 817/1000 [02:08<00:26, 6.81it/s]
82%|████████▏ | 819/1000 [02:08<00:22, 7.97it/s]
82%|████████▏ | 820/1000 [02:08<00:28, 6.34it/s]
82%|████████▏ | 822/1000 [02:08<00:23, 7.58it/s]
82%|████████▏ | 823/1000 [02:09<00:26, 6.61it/s]
82%|████████▏ | 824/1000 [02:09<00:31, 5.54it/s]
82%|████████▎ | 825/1000 [02:09<00:30, 5.73it/s]
83%|████████▎ | 826/1000 [02:09<00:37, 4.69it/s]
83%|████████▎ | 828/1000 [02:10<00:39, 4.35it/s]
83%|████████▎ | 829/1000 [02:10<00:35, 4.83it/s]
83%|████████▎ | 831/1000 [02:10<00:28, 6.01it/s]
83%|████████▎ | 832/1000 [02:10<00:34, 4.91it/s]
83%|████████▎ | 833/1000 [02:11<00:31, 5.36it/s]
83%|████████▎ | 834/1000 [02:11<00:32, 5.06it/s]
84%|████████▎ | 835/1000 [02:11<00:29, 5.52it/s]
84%|████████▎ | 836/1000 [02:11<00:31, 5.21it/s]
84%|████████▍ | 838/1000 [02:11<00:25, 6.43it/s]
84%|████████▍ | 840/1000 [02:12<00:27, 5.72it/s]
84%|████████▍ | 842/1000 [02:12<00:22, 7.07it/s]
84%|████████▍ | 844/1000 [02:13<00:28, 5.55it/s]
84%|████████▍ | 845/1000 [02:13<00:30, 5.03it/s]
85%|████████▍ | 846/1000 [02:13<00:27, 5.60it/s]
85%|████████▍ | 847/1000 [02:13<00:29, 5.27it/s]
85%|████████▍ | 849/1000 [02:13<00:22, 6.68it/s]
85%|████████▌ | 850/1000 [02:14<00:26, 5.61it/s]
85%|████████▌ | 851/1000 [02:14<00:25, 5.79it/s]
85%|████████▌ | 853/1000 [02:14<00:19, 7.39it/s]
86%|████████▌ | 855/1000 [02:14<00:16, 8.86it/s]
86%|████████▌ | 856/1000 [02:14<00:16, 8.64it/s]
86%|████████▌ | 858/1000 [02:15<00:20, 7.08it/s]
86%|████████▌ | 860/1000 [02:15<00:17, 8.20it/s]
86%|████████▌ | 862/1000 [02:15<00:14, 9.25it/s]
86%|████████▋ | 864/1000 [02:15<00:13, 10.40it/s]
87%|████████▋ | 866/1000 [02:15<00:12, 10.58it/s]
87%|████████▋ | 868/1000 [02:16<00:16, 8.25it/s]
87%|████████▋ | 870/1000 [02:16<00:14, 9.02it/s]
87%|████████▋ | 872/1000 [02:16<00:15, 8.26it/s]
87%|████████▋ | 873/1000 [02:16<00:19, 6.46it/s]
87%|████████▋ | 874/1000 [02:17<00:21, 5.87it/s]
88%|████████▊ | 876/1000 [02:17<00:16, 7.33it/s]
88%|████████▊ | 878/1000 [02:17<00:18, 6.53it/s]
88%|████████▊ | 879/1000 [02:17<00:20, 5.95it/s]
88%|████████▊ | 880/1000 [02:17<00:18, 6.46it/s]
88%|████████▊ | 881/1000 [02:18<00:17, 6.62it/s]
88%|████████▊ | 882/1000 [02:18<00:22, 5.36it/s]
88%|████████▊ | 883/1000 [02:18<00:19, 6.03it/s]
88%|████████▊ | 885/1000 [02:18<00:14, 7.74it/s]
89%|████████▊ | 886/1000 [02:18<00:14, 7.97it/s]
89%|████████▉ | 888/1000 [02:18<00:12, 9.28it/s]
89%|████████▉ | 889/1000 [02:19<00:13, 8.08it/s]
89%|████████▉ | 891/1000 [02:19<00:11, 9.25it/s]
89%|████████▉ | 893/1000 [02:19<00:13, 8.07it/s]
89%|████████▉ | 894/1000 [02:19<00:16, 6.42it/s]
90%|████████▉ | 896/1000 [02:20<00:13, 7.52it/s]
90%|████████▉ | 897/1000 [02:20<00:16, 6.11it/s]
90%|████████▉ | 898/1000 [02:20<00:19, 5.25it/s]
90%|████████▉ | 899/1000 [02:20<00:17, 5.93it/s]
90%|█████████ | 901/1000 [02:20<00:14, 6.81it/s]
90%|█████████ | 902/1000 [02:21<00:13, 7.05it/s]
90%|█████████ | 904/1000 [02:21<00:11, 8.17it/s]
90%|█████████ | 905/1000 [02:21<00:13, 7.01it/s]
91%|█████████ | 906/1000 [02:21<00:16, 5.72it/s]
91%|█████████ | 908/1000 [02:21<00:12, 7.34it/s]
91%|█████████ | 910/1000 [02:22<00:13, 6.54it/s]
91%|█████████ | 912/1000 [02:22<00:11, 7.67it/s]
91%|█████████▏| 913/1000 [02:22<00:15, 5.70it/s]
92%|█████████▏| 915/1000 [02:22<00:12, 6.98it/s]
92%|█████████▏| 916/1000 [02:23<00:14, 5.90it/s]
92%|█████████▏| 917/1000 [02:23<00:13, 6.25it/s]
92%|█████████▏| 918/1000 [02:23<00:17, 4.58it/s]
92%|█████████▏| 919/1000 [02:23<00:17, 4.75it/s]
92%|█████████▏| 921/1000 [02:24<00:16, 4.70it/s]
92%|█████████▏| 922/1000 [02:24<00:15, 5.06it/s]
92%|█████████▏| 924/1000 [02:24<00:12, 6.07it/s]
93%|█████████▎| 926/1000 [02:24<00:10, 7.24it/s]
93%|█████████▎| 927/1000 [02:25<00:10, 6.86it/s]
93%|█████████▎| 928/1000 [02:25<00:12, 5.66it/s]
93%|█████████▎| 930/1000 [02:25<00:12, 5.57it/s]
93%|█████████▎| 931/1000 [02:25<00:11, 5.89it/s]
93%|█████████▎| 933/1000 [02:26<00:11, 5.63it/s]
93%|█████████▎| 934/1000 [02:26<00:12, 5.29it/s]
94%|█████████▎| 936/1000 [02:26<00:10, 6.31it/s]
94%|█████████▍| 938/1000 [02:26<00:08, 7.64it/s]
94%|█████████▍| 939/1000 [02:27<00:08, 6.99it/s]
94%|█████████▍| 940/1000 [02:27<00:08, 7.05it/s]
94%|█████████▍| 942/1000 [02:27<00:10, 5.48it/s]
94%|█████████▍| 944/1000 [02:27<00:09, 6.02it/s]
95%|█████████▍| 946/1000 [02:28<00:07, 7.16it/s]
95%|█████████▍| 948/1000 [02:28<00:06, 8.33it/s]
95%|█████████▍| 949/1000 [02:28<00:07, 7.19it/s]
95%|█████████▌| 951/1000 [02:28<00:05, 8.23it/s]
95%|█████████▌| 952/1000 [02:29<00:08, 5.92it/s]
95%|█████████▌| 954/1000 [02:29<00:09, 4.96it/s]
96%|█████████▌| 956/1000 [02:29<00:07, 6.21it/s]
96%|█████████▌| 957/1000 [02:30<00:08, 5.33it/s]
96%|█████████▌| 959/1000 [02:30<00:08, 4.80it/s]
96%|█████████▌| 961/1000 [02:30<00:06, 5.79it/s]
96%|█████████▌| 962/1000 [02:31<00:07, 5.16it/s]
96%|█████████▋| 964/1000 [02:31<00:05, 6.26it/s]
96%|█████████▋| 965/1000 [02:31<00:06, 5.47it/s]
97%|█████████▋| 966/1000 [02:31<00:06, 5.42it/s]
97%|█████████▋| 968/1000 [02:31<00:04, 6.90it/s]
97%|█████████▋| 970/1000 [02:32<00:03, 7.99it/s]
97%|█████████▋| 971/1000 [02:32<00:04, 6.38it/s]
97%|█████████▋| 973/1000 [02:32<00:03, 7.51it/s]
98%|█████████▊| 975/1000 [02:32<00:03, 8.00it/s]
98%|█████████▊| 977/1000 [02:32<00:02, 9.25it/s]
98%|█████████▊| 979/1000 [02:33<00:02, 9.30it/s]
98%|█████████▊| 980/1000 [02:33<00:02, 7.15it/s]
98%|█████████▊| 981/1000 [02:33<00:03, 5.91it/s]
98%|█████████▊| 982/1000 [02:34<00:04, 4.40it/s]
98%|█████████▊| 984/1000 [02:34<00:02, 5.82it/s]
99%|█████████▊| 986/1000 [02:34<00:01, 7.17it/s]
99%|█████████▊| 987/1000 [02:34<00:01, 6.66it/s]
99%|█████████▉| 988/1000 [02:34<00:02, 5.52it/s]
99%|█████████▉| 989/1000 [02:35<00:02, 4.74it/s]
99%|█████████▉| 991/1000 [02:35<00:01, 5.06it/s]
99%|█████████▉| 992/1000 [02:35<00:01, 4.00it/s]
99%|█████████▉| 994/1000 [02:36<00:01, 5.49it/s]
100%|█████████▉| 995/1000 [02:36<00:01, 4.62it/s]
100%|█████████▉| 997/1000 [02:36<00:00, 5.88it/s]
100%|█████████▉| 999/1000 [02:37<00:00, 5.71it/s]
100%|██████████| 1000/1000 [02:37<00:00, 5.67it/s]
{'eval_loss': '0.7405', 'eval_runtime': '157.4', 'eval_samples_per_second': '6.354', 'eval_steps_per_second': '6.354', 'epoch': '0.9931', 'num_input_tokens_seen': 12115448}
99%|█████████▉| 1800/1813 [3:26:24<01:33, 7.22s/it]
100%|██████████| 1000/1000 [02:37<00:00, 5.67it/s]
Saving model checkpoint to /home/schwarc/diplomovka/optuna_lr_hpo_1gpu/trials/trial_003_lr_2.000e-04/checkpoint-1800
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
99%|█████████▉| 1801/1813 [3:26:34<11:03, 55.27s/it]
99%|█████████▉| 1802/1813 [3:26:40<07:25, 40.48s/it]
99%|█████████▉| 1803/1813 [3:26:47<05:02, 30.24s/it]
100%|█████████▉| 1804/1813 [3:26:55<03:33, 23.75s/it]
100%|█████████▉| 1805/1813 [3:27:02<02:29, 18.68s/it]
100%|█████████▉| 1806/1813 [3:27:10<01:46, 15.28s/it]
100%|█████████▉| 1807/1813 [3:27:17<01:18, 13.09s/it]
100%|█████████▉| 1808/1813 [3:27:26<00:58, 11.71s/it]
100%|█████████▉| 1809/1813 [3:27:33<00:41, 10.38s/it]
100%|█████████▉| 1810/1813 [3:27:40<00:27, 9.20s/it]
{'loss': '0.8548', 'grad_norm': '0.8624', 'learning_rate': '2.855e-09', 'epoch': '0.9986', 'num_input_tokens_seen': 12187432, 'train_runtime': '1.246e+04', 'train_tokens_per_second': '978.1'}
100%|█████████▉| 1810/1813 [3:27:40<00:27, 9.20s/it]
100%|█████████▉| 1811/1813 [3:27:46<00:16, 8.33s/it]
100%|█████████▉| 1812/1813 [3:27:52<00:07, 7.66s/it]
100%|██████████| 1813/1813 [3:27:56<00:00, 6.40s/it]
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:71: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:281: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:172: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:202: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:254: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:13, 13.53it/s]
0%| | 5/1000 [00:00<02:43, 6.07it/s]
1%| | 7/1000 [00:00<02:19, 7.13it/s]
1%| | 9/1000 [00:01<02:58, 5.56it/s]
1%| | 11/1000 [00:01<02:27, 6.71it/s]
1%| | 12/1000 [00:01<02:23, 6.87it/s]
1%|▏ | 13/1000 [00:02<02:56, 5.59it/s]
1%|▏ | 14/1000 [00:02<02:57, 5.57it/s]
2%|▏ | 15/1000 [00:02<03:22, 4.87it/s]
2%|▏ | 16/1000 [00:02<03:27, 4.75it/s]
2%|▏ | 18/1000 [00:03<03:11, 5.14it/s]
2%|▏ | 19/1000 [00:03<03:45, 4.35it/s]
2%|▏ | 20/1000 [00:03<04:11, 3.90it/s]
2%|▏ | 22/1000 [00:03<03:01, 5.39it/s]
2%|▏ | 23/1000 [00:04<03:21, 4.84it/s]
2%|▎ | 25/1000 [00:04<02:31, 6.44it/s]
3%|▎ | 26/1000 [00:04<02:57, 5.47it/s]
3%|▎ | 28/1000 [00:05<03:05, 5.24it/s]
3%|▎ | 29/1000 [00:05<02:54, 5.55it/s]
3%|▎ | 30/1000 [00:05<03:06, 5.20it/s]
3%|▎ | 31/1000 [00:05<03:27, 4.68it/s]
3%|▎ | 32/1000 [00:05<03:04, 5.25it/s]
3%|▎ | 33/1000 [00:06<03:11, 5.05it/s]
4%|▎ | 35/1000 [00:06<02:23, 6.72it/s]
4%|▎ | 37/1000 [00:06<02:00, 7.98it/s]
4%|▍ | 39/1000 [00:06<02:25, 6.62it/s]
4%|▍ | 40/1000 [00:06<02:21, 6.76it/s]
4%|▍ | 42/1000 [00:07<01:59, 7.99it/s]
4%|▍ | 44/1000 [00:07<01:45, 9.08it/s]
4%|▍ | 45/1000 [00:07<02:07, 7.47it/s]
5%|▍ | 47/1000 [00:07<02:24, 6.61it/s]
5%|▍ | 49/1000 [00:08<02:02, 7.77it/s]
5%|▌ | 51/1000 [00:08<01:48, 8.75it/s]
5%|▌ | 53/1000 [00:08<01:38, 9.63it/s]
6%|▌ | 55/1000 [00:08<01:39, 9.47it/s]
6%|▌ | 57/1000 [00:08<01:55, 8.16it/s]
6%|▌ | 58/1000 [00:09<01:56, 8.06it/s]
6%|▌ | 59/1000 [00:09<02:15, 6.93it/s]
6%|▌ | 61/1000 [00:09<01:54, 8.18it/s]
6%|▋ | 63/1000 [00:09<01:48, 8.62it/s]
6%|▋ | 64/1000 [00:09<02:19, 6.72it/s]
7%|▋ | 66/1000 [00:10<02:01, 7.70it/s]
7%|▋ | 67/1000 [00:10<02:29, 6.26it/s]
7%|▋ | 69/1000 [00:10<02:11, 7.10it/s]
7%|▋ | 70/1000 [00:10<02:37, 5.89it/s]
7%|▋ | 72/1000 [00:11<02:41, 5.74it/s]
7%|▋ | 74/1000 [00:11<02:10, 7.08it/s]
8%|▊ | 75/1000 [00:11<02:39, 5.80it/s]
8%|▊ | 76/1000 [00:11<02:43, 5.65it/s]
8%|▊ | 77/1000 [00:12<02:28, 6.22it/s]
8%|▊ | 78/1000 [00:12<02:56, 5.21it/s]
8%|▊ | 80/1000 [00:12<02:18, 6.64it/s]
8%|▊ | 82/1000 [00:12<01:54, 8.02it/s]
8%|▊ | 83/1000 [00:12<02:24, 6.35it/s]
8%|▊ | 85/1000 [00:13<02:32, 6.00it/s]
9%|▊ | 86/1000 [00:13<02:54, 5.24it/s]
9%|▊ | 87/1000 [00:13<03:12, 4.73it/s]
9%|▉ | 89/1000 [00:14<02:27, 6.18it/s]
9%|▉ | 90/1000 [00:14<02:27, 6.19it/s]
9%|▉ | 91/1000 [00:14<02:54, 5.22it/s]
9%|▉ | 92/1000 [00:14<02:50, 5.32it/s]
9%|▉ | 93/1000 [00:14<03:02, 4.97it/s]
9%|▉ | 94/1000 [00:14<02:39, 5.68it/s]
10%|▉ | 95/1000 [00:15<03:18, 4.56it/s]
10%|▉ | 97/1000 [00:15<02:31, 5.94it/s]
10%|▉ | 99/1000 [00:15<02:03, 7.32it/s]
10%|█ | 101/1000 [00:15<01:46, 8.47it/s]
10%|█ | 102/1000 [00:16<02:15, 6.62it/s]
10%|█ | 103/1000 [00:16<02:12, 6.78it/s]
10%|█ | 104/1000 [00:16<02:14, 6.64it/s]
11%|█ | 106/1000 [00:16<01:47, 8.31it/s]
11%|█ | 108/1000 [00:16<01:35, 9.36it/s]
11%|█ | 110/1000 [00:16<01:32, 9.61it/s]
11%|█ | 112/1000 [00:17<01:24, 10.47it/s]
11%|█▏ | 114/1000 [00:17<01:21, 10.93it/s]
12%|█▏ | 116/1000 [00:17<01:19, 11.16it/s]
12%|█▏ | 118/1000 [00:17<01:16, 11.59it/s]
12%|█▏ | 120/1000 [00:18<02:29, 5.87it/s]
12%|█▏ | 122/1000 [00:18<02:06, 6.93it/s]
12%|█▏ | 124/1000 [00:18<02:16, 6.41it/s]
12%|█▎ | 125/1000 [00:19<03:00, 4.86it/s]
13%|█▎ | 126/1000 [00:19<02:46, 5.24it/s]
13%|█▎ | 127/1000 [00:19<02:56, 4.95it/s]
13%|█▎ | 128/1000 [00:19<03:16, 4.43it/s]
13%|█▎ | 130/1000 [00:20<02:24, 6.01it/s]
13%|█▎ | 132/1000 [00:20<01:56, 7.45it/s]
13%|█▎ | 134/1000 [00:20<01:39, 8.70it/s]
14%|█▎ | 136/1000 [00:20<01:46, 8.14it/s]
14%|█▎ | 137/1000 [00:20<01:47, 8.00it/s]
14%|█▍ | 139/1000 [00:21<01:42, 8.36it/s]
14%|█▍ | 141/1000 [00:21<01:44, 8.18it/s]
14%|█▍ | 142/1000 [00:21<01:52, 7.65it/s]
14%|█▍ | 143/1000 [00:21<01:53, 7.58it/s]
14%|█▍ | 145/1000 [00:21<01:37, 8.79it/s]
15%|█▍ | 147/1000 [00:22<01:57, 7.23it/s]
15%|█▍ | 148/1000 [00:22<01:56, 7.33it/s]
15%|█▍ | 149/1000 [00:22<01:49, 7.74it/s]
15%|█▌ | 151/1000 [00:22<01:31, 9.29it/s]
15%|█▌ | 153/1000 [00:22<01:21, 10.35it/s]
16%|█▌ | 155/1000 [00:23<01:59, 7.06it/s]
16%|█▌ | 156/1000 [00:23<02:35, 5.43it/s]
16%|█▌ | 158/1000 [00:23<02:03, 6.82it/s]
16%|█▌ | 160/1000 [00:23<01:54, 7.33it/s]
16%|█▌ | 162/1000 [00:24<02:05, 6.69it/s]
16%|█▋ | 163/1000 [00:24<02:10, 6.40it/s]
16%|█▋ | 164/1000 [00:24<02:36, 5.34it/s]
16%|█▋ | 165/1000 [00:25<02:54, 4.79it/s]
17%|█▋ | 166/1000 [00:25<03:08, 4.42it/s]
17%|█▋ | 167/1000 [00:25<02:47, 4.96it/s]
17%|█▋ | 169/1000 [00:25<02:02, 6.79it/s]
17%|█▋ | 171/1000 [00:25<02:16, 6.07it/s]
17%|█▋ | 172/1000 [00:26<02:38, 5.23it/s]
17%|█▋ | 173/1000 [00:26<02:40, 5.14it/s]
17%|█▋ | 174/1000 [00:26<02:26, 5.65it/s]
18%|█▊ | 176/1000 [00:26<01:54, 7.17it/s]
18%|█▊ | 177/1000 [00:27<02:21, 5.82it/s]
18%|█▊ | 179/1000 [00:27<01:52, 7.31it/s]
18%|█▊ | 180/1000 [00:27<01:52, 7.27it/s]
18%|█▊ | 181/1000 [00:27<02:24, 5.65it/s]
18%|█▊ | 182/1000 [00:27<02:48, 4.84it/s]
18%|█▊ | 183/1000 [00:28<02:45, 4.94it/s]
18%|█▊ | 185/1000 [00:28<02:02, 6.65it/s]
19%|█▊ | 186/1000 [00:28<01:59, 6.81it/s]
19%|█▊ | 187/1000 [00:28<02:31, 5.36it/s]
19%|█▉ | 189/1000 [00:28<01:57, 6.88it/s]
19%|█▉ | 190/1000 [00:29<02:22, 5.69it/s]
19%|█▉ | 191/1000 [00:29<02:07, 6.35it/s]
19%|█▉ | 192/1000 [00:29<02:34, 5.25it/s]
19%|█▉ | 194/1000 [00:29<02:31, 5.31it/s]
20%|█▉ | 195/1000 [00:30<02:16, 5.92it/s]
20%|█▉ | 197/1000 [00:30<01:49, 7.37it/s]
20%|█▉ | 199/1000 [00:30<01:30, 8.85it/s]
20%|██ | 201/1000 [00:30<01:21, 9.80it/s]
20%|██ | 203/1000 [00:30<01:44, 7.64it/s]
20%|██ | 204/1000 [00:31<01:52, 7.09it/s]
21%|██ | 206/1000 [00:31<01:35, 8.32it/s]
21%|██ | 207/1000 [00:31<01:58, 6.67it/s]
21%|██ | 209/1000 [00:31<01:40, 7.91it/s]
21%|██ | 210/1000 [00:31<01:49, 7.21it/s]
21%|██ | 212/1000 [00:32<01:31, 8.57it/s]
21%|██▏ | 213/1000 [00:32<01:43, 7.63it/s]
21%|██▏ | 214/1000 [00:32<01:46, 7.37it/s]
22%|██▏ | 216/1000 [00:32<01:38, 7.93it/s]
22%|██▏ | 217/1000 [00:32<02:05, 6.26it/s]
22%|██▏ | 219/1000 [00:33<01:42, 7.64it/s]
22%|██▏ | 220/1000 [00:33<02:27, 5.29it/s]
22%|██▏ | 221/1000 [00:33<02:26, 5.32it/s]
22%|██▏ | 222/1000 [00:33<02:11, 5.93it/s]
22%|██▏ | 223/1000 [00:34<02:58, 4.35it/s]
22%|██▏ | 224/1000 [00:34<02:36, 4.96it/s]
22%|██▎ | 225/1000 [00:34<02:38, 4.89it/s]
23%|██▎ | 226/1000 [00:34<02:53, 4.46it/s]
23%|██▎ | 228/1000 [00:35<02:11, 5.86it/s]
23%|██▎ | 229/1000 [00:35<02:31, 5.08it/s]
23%|██▎ | 230/1000 [00:35<02:19, 5.51it/s]
23%|██▎ | 232/1000 [00:35<01:49, 7.02it/s]
23%|██▎ | 233/1000 [00:35<01:46, 7.19it/s]
24%|██▎ | 235/1000 [00:35<01:27, 8.78it/s]
24%|██▎ | 236/1000 [00:36<01:29, 8.58it/s]
24%|██▎ | 237/1000 [00:36<01:32, 8.21it/s]
24%|██▍ | 239/1000 [00:36<01:41, 7.51it/s]
24%|██▍ | 241/1000 [00:36<01:47, 7.04it/s]
24%|██▍ | 242/1000 [00:37<02:31, 5.00it/s]
24%|██▍ | 243/1000 [00:37<02:45, 4.58it/s]
24%|██▍ | 245/1000 [00:37<02:15, 5.57it/s]
25%|██▍ | 247/1000 [00:37<01:47, 7.00it/s]
25%|██▍ | 248/1000 [00:38<02:08, 5.86it/s]
25%|██▍ | 249/1000 [00:38<02:30, 4.99it/s]
25%|██▌ | 250/1000 [00:38<02:30, 4.98it/s]
25%|██▌ | 252/1000 [00:38<02:24, 5.18it/s]
25%|██▌ | 253/1000 [00:39<02:31, 4.93it/s]
25%|██▌ | 254/1000 [00:39<02:13, 5.59it/s]
26%|██▌ | 256/1000 [00:39<01:50, 6.71it/s]
26%|██▌ | 258/1000 [00:39<01:37, 7.61it/s]
26%|██▌ | 260/1000 [00:40<01:49, 6.75it/s]
26%|██▌ | 261/1000 [00:40<02:08, 5.74it/s]
26%|██▌ | 262/1000 [00:40<02:14, 5.50it/s]
26%|██▋ | 264/1000 [00:40<02:14, 5.48it/s]
26%|██▋ | 265/1000 [00:41<02:08, 5.71it/s]
27%|██▋ | 266/1000 [00:41<02:06, 5.82it/s]
27%|██▋ | 268/1000 [00:41<01:53, 6.45it/s]
27%|██▋ | 270/1000 [00:41<02:00, 6.08it/s]
27%|██▋ | 271/1000 [00:42<02:38, 4.61it/s]
27%|██▋ | 273/1000 [00:42<02:28, 4.88it/s]
28%|██▊ | 275/1000 [00:42<02:05, 5.77it/s]
28%|██▊ | 277/1000 [00:43<01:46, 6.79it/s]
28%|██▊ | 278/1000 [00:43<02:04, 5.81it/s]
28%|██▊ | 280/1000 [00:43<02:06, 5.69it/s]
28%|██▊ | 282/1000 [00:43<01:44, 6.86it/s]
28%|██▊ | 283/1000 [00:44<02:22, 5.02it/s]
28%|██▊ | 284/1000 [00:44<02:25, 4.92it/s]
28%|██▊ | 285/1000 [00:44<02:08, 5.58it/s]
29%|██▊ | 287/1000 [00:44<01:36, 7.41it/s]
29%|██▉ | 288/1000 [00:44<01:31, 7.75it/s]
29%|██▉ | 290/1000 [00:45<01:45, 6.71it/s]
29%|██▉ | 291/1000 [00:45<01:59, 5.96it/s]
29%|██▉ | 292/1000 [00:45<02:21, 5.01it/s]
29%|██▉ | 294/1000 [00:46<01:55, 6.10it/s]
30%|██▉ | 296/1000 [00:46<02:01, 5.78it/s]
30%|██▉ | 298/1000 [00:46<01:40, 6.96it/s]
30%|██▉ | 299/1000 [00:46<02:07, 5.51it/s]
30%|███ | 300/1000 [00:47<01:59, 5.87it/s]
30%|███ | 301/1000 [00:47<01:53, 6.16it/s]
30%|███ | 303/1000 [00:47<01:31, 7.64it/s]
30%|███ | 304/1000 [00:47<01:38, 7.07it/s]
30%|███ | 305/1000 [00:47<01:37, 7.11it/s]
31%|███ | 306/1000 [00:47<01:54, 6.07it/s]
31%|███ | 307/1000 [00:48<01:56, 5.93it/s]
31%|███ | 309/1000 [00:48<01:30, 7.67it/s]
31%|███ | 311/1000 [00:48<01:16, 8.97it/s]
31%|███▏ | 313/1000 [00:48<01:09, 9.92it/s]
32%|███▏ | 315/1000 [00:48<01:15, 9.04it/s]
32%|███▏ | 316/1000 [00:49<01:25, 8.03it/s]
32%|███▏ | 317/1000 [00:49<01:22, 8.30it/s]
32%|███▏ | 319/1000 [00:49<01:53, 5.99it/s]
32%|███▏ | 321/1000 [00:49<01:57, 5.79it/s]
32%|███▏ | 322/1000 [00:50<02:05, 5.42it/s]
32%|███▏ | 324/1000 [00:50<01:41, 6.69it/s]
32%|███▎ | 325/1000 [00:50<02:18, 4.86it/s]
33%|███▎ | 327/1000 [00:50<01:45, 6.40it/s]
33%|███▎ | 328/1000 [00:51<01:48, 6.21it/s]
33%|███▎ | 330/1000 [00:51<01:53, 5.90it/s]
33%|███▎ | 332/1000 [00:51<01:56, 5.74it/s]
33%|███▎ | 333/1000 [00:51<01:49, 6.08it/s]
33%|███▎ | 334/1000 [00:52<01:59, 5.58it/s]
34%|███▎ | 336/1000 [00:52<01:34, 7.06it/s]
34%|███▎ | 337/1000 [00:52<01:28, 7.50it/s]
34%|███▍ | 338/1000 [00:52<01:27, 7.59it/s]
34%|███▍ | 340/1000 [00:52<01:13, 8.94it/s]
34%|███▍ | 341/1000 [00:52<01:12, 9.10it/s]
34%|███▍ | 343/1000 [00:53<01:30, 7.26it/s]
34%|███▍ | 344/1000 [00:53<01:41, 6.46it/s]
34%|███▍ | 345/1000 [00:53<01:38, 6.63it/s]
35%|███▍ | 346/1000 [00:53<01:46, 6.16it/s]
35%|███▍ | 347/1000 [00:53<01:41, 6.41it/s]
35%|███▍ | 349/1000 [00:54<01:48, 5.97it/s]
35%|███▌ | 350/1000 [00:54<02:07, 5.11it/s]
35%|███▌ | 352/1000 [00:54<01:37, 6.66it/s]
35%|███▌ | 354/1000 [00:55<01:38, 6.59it/s]
36%|███▌ | 355/1000 [00:55<01:40, 6.42it/s]
36%|███▌ | 357/1000 [00:55<01:21, 7.85it/s]
36%|███▌ | 359/1000 [00:55<01:08, 9.40it/s]
36%|███▌ | 361/1000 [00:55<01:17, 8.27it/s]
36%|███▋ | 363/1000 [00:56<01:41, 6.29it/s]
36%|███▋ | 364/1000 [00:56<01:55, 5.51it/s]
36%|███▋ | 365/1000 [00:57<02:28, 4.28it/s]
37%|███▋ | 367/1000 [00:57<02:14, 4.69it/s]
37%|███▋ | 368/1000 [00:57<02:23, 4.40it/s]
37%|███▋ | 369/1000 [00:57<02:08, 4.91it/s]
37%|███▋ | 371/1000 [00:57<01:34, 6.67it/s]
37%|███▋ | 372/1000 [00:58<01:32, 6.79it/s]
37%|███▋ | 374/1000 [00:58<01:30, 6.93it/s]
38%|███▊ | 375/1000 [00:58<01:57, 5.34it/s]
38%|███▊ | 376/1000 [00:58<02:12, 4.73it/s]
38%|███▊ | 377/1000 [00:59<01:56, 5.33it/s]
38%|███▊ | 379/1000 [00:59<01:27, 7.11it/s]
38%|███▊ | 381/1000 [00:59<01:17, 8.02it/s]
38%|███▊ | 382/1000 [00:59<01:32, 6.66it/s]
38%|███▊ | 384/1000 [00:59<01:17, 7.99it/s]
38%|███▊ | 385/1000 [00:59<01:18, 7.84it/s]
39%|███▊ | 386/1000 [01:00<01:16, 8.05it/s]
39%|███▊ | 387/1000 [01:00<01:42, 5.98it/s]
39%|███▉ | 388/1000 [01:00<01:44, 5.87it/s]
39%|███▉ | 389/1000 [01:00<01:34, 6.47it/s]
39%|███▉ | 390/1000 [01:00<01:31, 6.68it/s]
39%|███▉ | 391/1000 [01:01<01:39, 6.10it/s]
39%|███▉ | 393/1000 [01:01<01:17, 7.87it/s]
40%|███▉ | 395/1000 [01:01<01:35, 6.36it/s]
40%|███▉ | 397/1000 [01:01<01:18, 7.65it/s]
40%|███▉ | 398/1000 [01:02<01:39, 6.04it/s]
40%|███▉ | 399/1000 [01:02<02:00, 4.97it/s]
40%|████ | 400/1000 [01:02<02:12, 4.54it/s]
40%|████ | 402/1000 [01:03<02:04, 4.82it/s]
40%|████ | 404/1000 [01:03<01:36, 6.15it/s]
41%|████ | 406/1000 [01:03<01:20, 7.37it/s]
41%|████ | 407/1000 [01:03<01:37, 6.10it/s]
41%|████ | 408/1000 [01:03<01:51, 5.32it/s]
41%|████ | 409/1000 [01:04<01:39, 5.94it/s]
41%|████ | 410/1000 [01:04<01:56, 5.06it/s]
41%|████ | 411/1000 [01:04<02:12, 4.44it/s]
41%|████ | 412/1000 [01:04<02:21, 4.16it/s]
41%|████▏ | 414/1000 [01:05<01:38, 5.98it/s]
42%|████▏ | 415/1000 [01:05<01:28, 6.61it/s]
42%|████▏ | 416/1000 [01:05<01:47, 5.46it/s]
42%|████▏ | 418/1000 [01:05<01:21, 7.18it/s]
42%|████▏ | 420/1000 [01:05<01:18, 7.40it/s]
42%|████▏ | 421/1000 [01:06<01:30, 6.39it/s]
42%|████▏ | 422/1000 [01:06<01:24, 6.84it/s]
42%|████▏ | 423/1000 [01:06<01:50, 5.23it/s]
42%|████▏ | 424/1000 [01:06<02:03, 4.67it/s]
42%|████▎ | 425/1000 [01:06<01:50, 5.21it/s]
43%|████▎ | 427/1000 [01:07<01:23, 6.84it/s]
43%|████▎ | 428/1000 [01:07<01:28, 6.47it/s]
43%|████▎ | 429/1000 [01:07<01:27, 6.50it/s]
43%|████▎ | 431/1000 [01:07<01:09, 8.21it/s]
43%|████▎ | 433/1000 [01:07<00:59, 9.57it/s]
44%|████▎ | 435/1000 [01:07<00:54, 10.28it/s]
44%|████▎ | 437/1000 [01:08<01:03, 8.87it/s]
44%|████▍ | 439/1000 [01:08<01:21, 6.89it/s]
44%|████▍ | 441/1000 [01:08<01:09, 8.00it/s]
44%|████▍ | 442/1000 [01:09<01:25, 6.51it/s]
44%|████▍ | 444/1000 [01:09<01:28, 6.30it/s]
45%|████▍ | 446/1000 [01:09<01:13, 7.56it/s]
45%|████▍ | 448/1000 [01:09<01:24, 6.50it/s]
45%|████▌ | 450/1000 [01:10<01:29, 6.12it/s]
45%|████▌ | 451/1000 [01:10<01:41, 5.42it/s]
45%|████▌ | 452/1000 [01:10<01:51, 4.91it/s]
45%|████▌ | 454/1000 [01:11<01:26, 6.30it/s]
46%|████▌ | 456/1000 [01:11<01:12, 7.45it/s]
46%|████▌ | 457/1000 [01:11<01:19, 6.84it/s]
46%|████▌ | 459/1000 [01:11<01:06, 8.14it/s]
46%|████▌ | 461/1000 [01:11<00:56, 9.50it/s]
46%|████▋ | 463/1000 [01:12<01:20, 6.68it/s]
46%|████▋ | 465/1000 [01:12<01:30, 5.89it/s]
47%|████▋ | 466/1000 [01:12<01:41, 5.25it/s]
47%|████▋ | 467/1000 [01:13<02:06, 4.20it/s]
47%|████▋ | 469/1000 [01:13<01:36, 5.50it/s]
47%|████▋ | 471/1000 [01:13<01:17, 6.86it/s]
47%|████▋ | 472/1000 [01:13<01:13, 7.18it/s]
47%|████▋ | 473/1000 [01:13<01:21, 6.48it/s]
47%|████▋ | 474/1000 [01:14<01:37, 5.42it/s]
48%|████▊ | 476/1000 [01:14<01:36, 5.45it/s]
48%|████▊ | 477/1000 [01:14<01:52, 4.63it/s]
48%|████▊ | 479/1000 [01:15<01:24, 6.20it/s]
48%|████▊ | 480/1000 [01:15<01:31, 5.68it/s]
48%|████▊ | 482/1000 [01:15<01:13, 7.02it/s]
48%|████▊ | 484/1000 [01:15<01:20, 6.39it/s]
48%|████▊ | 485/1000 [01:16<01:33, 5.51it/s]
49%|████▊ | 486/1000 [01:16<01:33, 5.51it/s]
49%|████▉ | 488/1000 [01:16<01:13, 7.00it/s]
49%|████▉ | 489/1000 [01:16<01:28, 5.80it/s]
49%|████▉ | 490/1000 [01:16<01:20, 6.33it/s]
49%|████▉ | 492/1000 [01:17<01:10, 7.25it/s]
49%|████▉ | 494/1000 [01:17<00:58, 8.68it/s]
50%|████▉ | 496/1000 [01:17<01:10, 7.12it/s]
50%|████▉ | 498/1000 [01:17<01:09, 7.21it/s]
50%|████▉ | 499/1000 [01:18<01:27, 5.73it/s]
50%|█████ | 500/1000 [01:18<01:39, 5.02it/s]
50%|█████ | 502/1000 [01:18<01:17, 6.41it/s]
50%|█████ | 503/1000 [01:18<01:25, 5.81it/s]
50%|█████ | 504/1000 [01:19<01:18, 6.32it/s]
50%|█████ | 505/1000 [01:19<01:32, 5.34it/s]
51%|█████ | 506/1000 [01:19<01:44, 4.73it/s]
51%|█████ | 508/1000 [01:19<01:16, 6.43it/s]
51%|█████ | 510/1000 [01:19<01:02, 7.87it/s]
51%|█████ | 512/1000 [01:20<00:55, 8.80it/s]
51%|█████▏ | 514/1000 [01:20<01:18, 6.16it/s]
52%|█████▏ | 515/1000 [01:20<01:14, 6.47it/s]
52%|█████▏ | 516/1000 [01:20<01:19, 6.12it/s]
52%|█████▏ | 518/1000 [01:21<01:08, 7.04it/s]
52%|█████▏ | 519/1000 [01:21<01:26, 5.54it/s]
52%|█████▏ | 521/1000 [01:21<01:08, 6.98it/s]
52%|█████▏ | 522/1000 [01:21<01:22, 5.80it/s]
52%|█████▏ | 523/1000 [01:22<01:36, 4.93it/s]
52%|█████▏ | 524/1000 [01:22<01:39, 4.76it/s]
53%|█████▎ | 526/1000 [01:22<01:23, 5.70it/s]
53%|█████▎ | 528/1000 [01:23<01:23, 5.67it/s]
53%|█████▎ | 529/1000 [01:23<01:24, 5.55it/s]
53%|█████▎ | 531/1000 [01:23<01:06, 7.08it/s]
53%|█████▎ | 533/1000 [01:23<00:55, 8.35it/s]
53%|█████▎ | 534/1000 [01:23<01:10, 6.60it/s]
54%|█████▎ | 535/1000 [01:24<01:23, 5.57it/s]
54%|█████▎ | 536/1000 [01:24<01:27, 5.29it/s]
54%|█████▎ | 537/1000 [01:24<01:38, 4.70it/s]
54%|█████▍ | 539/1000 [01:24<01:31, 5.05it/s]
54%|█████▍ | 540/1000 [01:25<01:33, 4.92it/s]
54%|█████▍ | 541/1000 [01:25<01:44, 4.40it/s]
54%|█████▍ | 543/1000 [01:25<01:16, 5.95it/s]
55%|█████▍ | 545/1000 [01:25<01:15, 6.02it/s]
55%|█████▍ | 546/1000 [01:26<01:21, 5.56it/s]
55%|█████▍ | 547/1000 [01:26<01:32, 4.89it/s]
55%|█████▍ | 549/1000 [01:26<01:29, 5.04it/s]
55%|█████▌ | 551/1000 [01:27<01:09, 6.42it/s]
55%|█████▌ | 552/1000 [01:27<01:11, 6.24it/s]
55%|█████▌ | 553/1000 [01:27<01:23, 5.34it/s]
55%|█████▌ | 554/1000 [01:27<01:28, 5.02it/s]
56%|█████▌ | 556/1000 [01:27<01:07, 6.60it/s]
56%|█████▌ | 557/1000 [01:28<01:13, 6.01it/s]
56%|█████▌ | 559/1000 [01:28<00:57, 7.61it/s]
56%|█████▌ | 561/1000 [01:28<00:50, 8.75it/s]
56%|█████▌ | 562/1000 [01:28<00:49, 8.94it/s]
56%|█████▋ | 563/1000 [01:28<01:05, 6.66it/s]
56%|█████▋ | 565/1000 [01:29<01:06, 6.55it/s]
57%|█████▋ | 566/1000 [01:29<01:18, 5.55it/s]
57%|█████▋ | 568/1000 [01:29<01:18, 5.52it/s]
57%|█████▋ | 569/1000 [01:29<01:18, 5.48it/s]
57%|█████▋ | 571/1000 [01:30<01:17, 5.55it/s]
57%|█████▋ | 572/1000 [01:30<01:18, 5.46it/s]
57%|█████▋ | 574/1000 [01:30<01:17, 5.53it/s]
58%|█████▊ | 576/1000 [01:31<01:01, 6.86it/s]
58%|█████▊ | 577/1000 [01:31<01:24, 4.98it/s]
58%|█████▊ | 578/1000 [01:31<01:32, 4.58it/s]
58%|█████▊ | 580/1000 [01:31<01:08, 6.10it/s]
58%|█████▊ | 582/1000 [01:32<00:55, 7.51it/s]
58%|█████▊ | 583/1000 [01:32<01:07, 6.16it/s]
58%|█████▊ | 585/1000 [01:32<01:06, 6.23it/s]
59%|█████▊ | 587/1000 [01:32<01:04, 6.39it/s]
59%|█████▉ | 589/1000 [01:33<00:54, 7.59it/s]
59%|█████▉ | 590/1000 [01:33<01:08, 5.98it/s]
59%|█████▉ | 592/1000 [01:33<00:56, 7.21it/s]
59%|█████▉ | 593/1000 [01:33<01:07, 5.99it/s]
60%|█████▉ | 595/1000 [01:34<00:54, 7.37it/s]
60%|█████▉ | 596/1000 [01:34<01:06, 6.05it/s]
60%|█████▉ | 597/1000 [01:34<01:08, 5.88it/s]
60%|█████▉ | 599/1000 [01:34<01:10, 5.69it/s]
60%|██████ | 601/1000 [01:35<01:11, 5.61it/s]
60%|██████ | 602/1000 [01:35<01:07, 5.89it/s]
60%|██████ | 604/1000 [01:35<01:19, 4.97it/s]
61%|██████ | 606/1000 [01:36<01:03, 6.22it/s]
61%|██████ | 608/1000 [01:36<00:57, 6.87it/s]
61%|██████ | 610/1000 [01:36<00:52, 7.43it/s]
61%|██████ | 612/1000 [01:36<00:45, 8.53it/s]
61%|██████▏ | 613/1000 [01:36<00:44, 8.70it/s]
62%|██████▏ | 615/1000 [01:37<00:52, 7.36it/s]
62%|██████▏ | 616/1000 [01:37<00:58, 6.55it/s]
62%|██████▏ | 617/1000 [01:37<00:57, 6.69it/s]
62%|██████▏ | 619/1000 [01:37<00:47, 7.98it/s]
62%|██████▏ | 621/1000 [01:38<00:55, 6.84it/s]
62%|██████▏ | 623/1000 [01:38<00:53, 7.05it/s]
62%|██████▏ | 624/1000 [01:38<00:50, 7.44it/s]
62%|██████▎ | 625/1000 [01:38<01:02, 6.04it/s]
63%|██████▎ | 627/1000 [01:38<00:50, 7.41it/s]
63%|██████▎ | 628/1000 [01:39<01:01, 6.03it/s]
63%|██████▎ | 629/1000 [01:39<01:13, 5.07it/s]
63%|██████▎ | 631/1000 [01:39<00:55, 6.65it/s]
63%|██████▎ | 633/1000 [01:39<00:44, 8.16it/s]
63%|██████▎ | 634/1000 [01:40<01:08, 5.33it/s]
64%|██████▎ | 635/1000 [01:40<01:03, 5.73it/s]
64%|██████▎ | 636/1000 [01:40<00:59, 6.14it/s]
64%|██████▍ | 638/1000 [01:40<00:51, 7.07it/s]
64%|██████▍ | 640/1000 [01:40<00:44, 8.06it/s]
64%|██████▍ | 641/1000 [01:41<00:56, 6.39it/s]
64%|██████▍ | 643/1000 [01:41<00:53, 6.72it/s]
64%|██████▍ | 645/1000 [01:41<00:58, 6.07it/s]
65%|██████▍ | 647/1000 [01:42<00:54, 6.53it/s]
65%|██████▍ | 648/1000 [01:42<01:02, 5.64it/s]
65%|██████▌ | 650/1000 [01:42<01:02, 5.62it/s]
65%|██████▌ | 652/1000 [01:43<01:03, 5.45it/s]
65%|██████▌ | 654/1000 [01:43<00:52, 6.65it/s]
66%|██████▌ | 656/1000 [01:43<00:44, 7.73it/s]
66%|██████▌ | 657/1000 [01:43<00:53, 6.42it/s]
66%|██████▌ | 659/1000 [01:44<01:04, 5.30it/s]
66%|██████▌ | 661/1000 [01:44<00:51, 6.62it/s]
66%|██████▌ | 662/1000 [01:44<00:59, 5.70it/s]
66%|██████▋ | 664/1000 [01:45<01:06, 5.05it/s]
66%|██████▋ | 665/1000 [01:45<01:11, 4.68it/s]
67%|██████▋ | 667/1000 [01:45<01:09, 4.82it/s]
67%|██████▋ | 668/1000 [01:46<01:13, 4.49it/s]
67%|██████▋ | 669/1000 [01:46<01:06, 4.94it/s]
67%|██████▋ | 671/1000 [01:46<01:04, 5.10it/s]
67%|██████▋ | 673/1000 [01:46<00:58, 5.62it/s]
68%|██████▊ | 675/1000 [01:47<00:52, 6.25it/s]
68%|██████▊ | 677/1000 [01:47<00:43, 7.48it/s]
68%|██████▊ | 679/1000 [01:47<00:38, 8.41it/s]
68%|██████▊ | 681/1000 [01:47<00:33, 9.48it/s]
68%|██████▊ | 683/1000 [01:47<00:40, 7.74it/s]
68%|██████▊ | 685/1000 [01:48<00:36, 8.58it/s]
69%|██████▊ | 686/1000 [01:48<00:45, 6.83it/s]
69%|██████▊ | 687/1000 [01:48<00:55, 5.63it/s]
69%|██████▉ | 688/1000 [01:48<00:52, 5.99it/s]
69%|██████▉ | 690/1000 [01:49<00:53, 5.74it/s]
69%|██████▉ | 692/1000 [01:49<00:45, 6.77it/s]
69%|██████▉ | 693/1000 [01:49<00:42, 7.21it/s]
69%|██████▉ | 694/1000 [01:49<00:52, 5.85it/s]
70%|██████▉ | 695/1000 [01:49<00:49, 6.15it/s]
70%|██████▉ | 696/1000 [01:50<00:58, 5.19it/s]
70%|██████▉ | 698/1000 [01:50<00:51, 5.88it/s]
70%|██████▉ | 699/1000 [01:50<00:59, 5.02it/s]
70%|███████ | 701/1000 [01:50<00:45, 6.52it/s]
70%|███████ | 702/1000 [01:51<01:02, 4.78it/s]
70%|███████ | 704/1000 [01:51<00:47, 6.21it/s]
70%|███████ | 705/1000 [01:51<01:04, 4.57it/s]
71%|███████ | 707/1000 [01:52<00:48, 5.99it/s]
71%|███████ | 709/1000 [01:52<00:44, 6.54it/s]
71%|███████ | 710/1000 [01:52<00:51, 5.60it/s]
71%|███████ | 712/1000 [01:52<00:43, 6.59it/s]
71%|███████▏ | 713/1000 [01:52<00:42, 6.75it/s]
72%|███████▏ | 715/1000 [01:53<00:35, 8.10it/s]
72%|███████▏ | 716/1000 [01:53<00:44, 6.40it/s]
72%|███████▏ | 718/1000 [01:53<00:46, 6.08it/s]
72%|███████▏ | 719/1000 [01:54<00:54, 5.15it/s]
72%|███████▏ | 720/1000 [01:54<00:49, 5.61it/s]
72%|███████▏ | 722/1000 [01:54<00:39, 7.07it/s]
72%|███████▏ | 723/1000 [01:54<00:38, 7.13it/s]
72%|███████▏ | 724/1000 [01:54<00:38, 7.16it/s]
72%|███████▎ | 725/1000 [01:54<00:38, 7.22it/s]
73%|███████▎ | 727/1000 [01:54<00:31, 8.59it/s]
73%|███████▎ | 729/1000 [01:55<00:27, 9.89it/s]
73%|███████▎ | 731/1000 [01:55<00:37, 7.20it/s]
73%|███████▎ | 733/1000 [01:55<00:32, 8.27it/s]
73%|███████▎ | 734/1000 [01:55<00:32, 8.24it/s]
74%|███████▎ | 736/1000 [01:56<00:34, 7.72it/s]
74%|███████▍ | 738/1000 [01:56<00:31, 8.28it/s]
74%|███████▍ | 740/1000 [01:56<00:28, 9.10it/s]
74%|███████▍ | 741/1000 [01:56<00:36, 7.07it/s]
74%|███████▍ | 743/1000 [01:57<00:36, 7.01it/s]
74%|███████▍ | 745/1000 [01:57<00:30, 8.26it/s]
75%|███████▍ | 747/1000 [01:57<00:27, 9.09it/s]
75%|███████▍ | 748/1000 [01:57<00:35, 7.08it/s]
75%|███████▍ | 749/1000 [01:57<00:34, 7.37it/s]
75%|███████▌ | 750/1000 [01:57<00:38, 6.43it/s]
75%|███████▌ | 751/1000 [01:58<00:49, 4.99it/s]
75%|███████▌ | 753/1000 [01:58<00:40, 6.14it/s]
75%|███████▌ | 754/1000 [01:58<00:46, 5.27it/s]
76%|███████▌ | 756/1000 [01:59<00:44, 5.52it/s]
76%|███████▌ | 758/1000 [01:59<00:36, 6.62it/s]
76%|███████▌ | 759/1000 [01:59<00:38, 6.19it/s]
76%|███████▌ | 761/1000 [01:59<00:32, 7.47it/s]
76%|███████▋ | 763/1000 [02:00<00:35, 6.62it/s]
76%|███████▋ | 764/1000 [02:00<00:41, 5.71it/s]
77%|███████▋ | 766/1000 [02:00<00:42, 5.49it/s]
77%|███████▋ | 768/1000 [02:00<00:34, 6.66it/s]
77%|███████▋ | 769/1000 [02:01<00:40, 5.74it/s]
77%|███████▋ | 770/1000 [02:01<00:40, 5.68it/s]
77%|███████▋ | 771/1000 [02:01<00:36, 6.28it/s]
77%|███████▋ | 773/1000 [02:01<00:40, 5.62it/s]
77%|███████▋ | 774/1000 [02:02<00:37, 5.96it/s]
78%|███████▊ | 776/1000 [02:02<00:32, 6.91it/s]
78%|███████▊ | 778/1000 [02:02<00:26, 8.45it/s]
78%|███████▊ | 780/1000 [02:02<00:36, 6.08it/s]
78%|███████▊ | 782/1000 [02:03<00:29, 7.31it/s]
78%|███████▊ | 783/1000 [02:03<00:35, 6.08it/s]
78%|███████▊ | 784/1000 [02:03<00:34, 6.32it/s]
79%|███████▊ | 786/1000 [02:03<00:31, 6.73it/s]
79%|███████▉ | 788/1000 [02:03<00:28, 7.55it/s]
79%|███████▉ | 790/1000 [02:04<00:25, 8.11it/s]
79%|███████▉ | 791/1000 [02:04<00:28, 7.28it/s]
79%|███████▉ | 792/1000 [02:04<00:30, 6.83it/s]
79%|███████▉ | 793/1000 [02:04<00:29, 7.06it/s]
80%|███████▉ | 795/1000 [02:05<00:32, 6.34it/s]
80%|███████▉ | 797/1000 [02:05<00:33, 6.02it/s]
80%|███████▉ | 798/1000 [02:05<00:38, 5.28it/s]
80%|████████ | 800/1000 [02:05<00:33, 5.93it/s]
80%|████████ | 802/1000 [02:06<00:29, 6.74it/s]
80%|████████ | 804/1000 [02:06<00:28, 6.88it/s]
81%|████████ | 806/1000 [02:06<00:24, 8.05it/s]
81%|████████ | 807/1000 [02:06<00:24, 7.87it/s]
81%|████████ | 809/1000 [02:06<00:21, 8.97it/s]
81%|████████ | 811/1000 [02:07<00:19, 9.88it/s]
81%|████████▏ | 813/1000 [02:07<00:23, 7.97it/s]
81%|████████▏ | 814/1000 [02:07<00:23, 7.82it/s]
82%|████████▏ | 816/1000 [02:07<00:21, 8.75it/s]
82%|████████▏ | 817/1000 [02:08<00:26, 6.85it/s]
82%|████████▏ | 819/1000 [02:08<00:22, 7.99it/s]
82%|████████▏ | 820/1000 [02:08<00:28, 6.37it/s]
82%|████████▏ | 821/1000 [02:08<00:26, 6.86it/s]
82%|████████▏ | 823/1000 [02:08<00:26, 6.66it/s]
82%|████████▏ | 824/1000 [02:09<00:31, 5.60it/s]
82%|████████▎ | 825/1000 [02:09<00:29, 5.91it/s]
83%|████████▎ | 826/1000 [02:09<00:36, 4.71it/s]
83%|████████▎ | 828/1000 [02:10<00:39, 4.36it/s]
83%|████████▎ | 829/1000 [02:10<00:35, 4.84it/s]
83%|████████▎ | 831/1000 [02:10<00:28, 6.02it/s]
83%|████████▎ | 832/1000 [02:10<00:34, 4.92it/s]
83%|████████▎ | 833/1000 [02:10<00:31, 5.22it/s]
83%|████████▎ | 834/1000 [02:11<00:32, 5.11it/s]
84%|████████▎ | 835/1000 [02:11<00:29, 5.57it/s]
84%|████████▎ | 836/1000 [02:11<00:31, 5.23it/s]
84%|████████▍ | 838/1000 [02:11<00:25, 6.45it/s]
84%|████████▍ | 839/1000 [02:11<00:23, 6.89it/s]
84%|████████▍ | 840/1000 [02:12<00:30, 5.28it/s]
84%|████████▍ | 842/1000 [02:12<00:22, 6.91it/s]
84%|████████▍ | 844/1000 [02:12<00:28, 5.38it/s]
84%|████████▍ | 845/1000 [02:13<00:32, 4.75it/s]
85%|████████▍ | 847/1000 [02:13<00:29, 5.25it/s]
85%|████████▍ | 849/1000 [02:13<00:23, 6.43it/s]
85%|████████▌ | 850/1000 [02:13<00:27, 5.49it/s]
85%|████████▌ | 851/1000 [02:14<00:25, 5.78it/s]
85%|████████▌ | 853/1000 [02:14<00:20, 7.24it/s]
86%|████████▌ | 855/1000 [02:14<00:16, 8.67it/s]
86%|████████▌ | 856/1000 [02:14<00:16, 8.52it/s]
86%|████████▌ | 858/1000 [02:14<00:20, 7.07it/s]
86%|████████▌ | 860/1000 [02:15<00:17, 8.18it/s]
86%|████████▌ | 862/1000 [02:15<00:15, 9.18it/s]
86%|████████▋ | 864/1000 [02:15<00:13, 10.32it/s]
87%|████████▋ | 866/1000 [02:15<00:12, 10.44it/s]
87%|████████▋ | 868/1000 [02:15<00:16, 8.16it/s]
87%|████████▋ | 870/1000 [02:16<00:14, 8.96it/s]
87%|████████▋ | 872/1000 [02:16<00:15, 8.04it/s]
87%|████████▋ | 873/1000 [02:16<00:19, 6.48it/s]
87%|████████▋ | 874/1000 [02:16<00:21, 5.88it/s]
88%|████████▊ | 875/1000 [02:17<00:19, 6.43it/s]
88%|████████▊ | 877/1000 [02:17<00:15, 7.92it/s]
88%|████████▊ | 878/1000 [02:17<00:19, 6.24it/s]
88%|████████▊ | 879/1000 [02:17<00:21, 5.67it/s]
88%|████████▊ | 881/1000 [02:17<00:17, 6.64it/s]
88%|████████▊ | 882/1000 [02:18<00:21, 5.48it/s]
88%|████████▊ | 884/1000 [02:18<00:17, 6.80it/s]
89%|████████▊ | 886/1000 [02:18<00:14, 8.01it/s]
89%|████████▉ | 888/1000 [02:18<00:12, 9.13it/s]
89%|████████▉ | 889/1000 [02:18<00:14, 7.92it/s]
89%|████████▉ | 891/1000 [02:19<00:11, 9.14it/s]
89%|████████▉ | 893/1000 [02:19<00:13, 8.07it/s]
89%|████████▉ | 894/1000 [02:19<00:16, 6.30it/s]
90%|████████▉ | 896/1000 [02:19<00:13, 7.62it/s]
90%|████████▉ | 897/1000 [02:20<00:16, 6.20it/s]
90%|████████▉ | 898/1000 [02:20<00:19, 5.27it/s]
90%|█████████ | 900/1000 [02:20<00:15, 6.65it/s]
90%|█████████ | 901/1000 [02:20<00:14, 6.67it/s]
90%|█████████ | 902/1000 [02:20<00:14, 6.65it/s]
90%|█████████ | 904/1000 [02:21<00:11, 8.16it/s]
90%|█████████ | 905/1000 [02:21<00:13, 7.01it/s]
91%|█████████ | 906/1000 [02:21<00:17, 5.50it/s]
91%|█████████ | 908/1000 [02:21<00:12, 7.16it/s]
91%|█████████ | 910/1000 [02:22<00:13, 6.46it/s]
91%|█████████ | 912/1000 [02:22<00:11, 7.70it/s]
91%|█████████▏| 913/1000 [02:22<00:14, 5.85it/s]
92%|█████████▏| 915/1000 [02:22<00:11, 7.15it/s]
92%|█████████▏| 916/1000 [02:23<00:14, 5.96it/s]
92%|█████████▏| 917/1000 [02:23<00:13, 6.33it/s]
92%|█████████▏| 918/1000 [02:23<00:18, 4.49it/s]
92%|█████████▏| 919/1000 [02:23<00:17, 4.69it/s]
92%|█████████▏| 921/1000 [02:24<00:16, 4.67it/s]
92%|█████████▏| 922/1000 [02:24<00:15, 4.94it/s]
92%|█████████▏| 924/1000 [02:24<00:12, 6.04it/s]
93%|█████████▎| 926/1000 [02:24<00:09, 7.41it/s]
93%|█████████▎| 927/1000 [02:24<00:10, 6.97it/s]
93%|█████████▎| 928/1000 [02:25<00:12, 5.74it/s]
93%|█████████▎| 930/1000 [02:25<00:12, 5.52it/s]
93%|█████████▎| 931/1000 [02:25<00:11, 5.86it/s]
93%|█████████▎| 933/1000 [02:26<00:11, 5.75it/s]
93%|█████████▎| 934/1000 [02:26<00:12, 5.37it/s]
94%|█████████▎| 936/1000 [02:26<00:10, 6.38it/s]
94%|█████████▍| 938/1000 [02:26<00:08, 7.74it/s]
94%|█████████▍| 939/1000 [02:26<00:08, 7.05it/s]
94%|█████████▍| 940/1000 [02:27<00:08, 7.15it/s]
94%|█████████▍| 941/1000 [02:27<00:07, 7.49it/s]
94%|█████████▍| 942/1000 [02:27<00:11, 4.96it/s]
94%|█████████▍| 944/1000 [02:27<00:09, 5.70it/s]
95%|█████████▍| 946/1000 [02:28<00:07, 7.05it/s]
95%|█████████▍| 948/1000 [02:28<00:06, 8.36it/s]
95%|█████████▍| 949/1000 [02:28<00:07, 7.12it/s]
95%|█████████▌| 951/1000 [02:28<00:06, 8.03it/s]
95%|█████████▌| 952/1000 [02:28<00:08, 5.92it/s]
95%|█████████▌| 954/1000 [02:29<00:09, 4.94it/s]
96%|█████████▌| 956/1000 [02:29<00:07, 6.20it/s]
96%|█████████▌| 957/1000 [02:29<00:08, 5.23it/s]
96%|█████████▌| 959/1000 [02:30<00:08, 4.81it/s]
96%|█████████▌| 961/1000 [02:30<00:06, 5.76it/s]
96%|█████████▌| 962/1000 [02:30<00:07, 5.15it/s]
96%|█████████▋| 964/1000 [02:31<00:05, 6.28it/s]
96%|█████████▋| 965/1000 [02:31<00:06, 5.47it/s]
97%|█████████▋| 966/1000 [02:31<00:06, 5.40it/s]
97%|█████████▋| 968/1000 [02:31<00:04, 6.90it/s]
97%|█████████▋| 970/1000 [02:31<00:03, 8.15it/s]
97%|█████████▋| 971/1000 [02:32<00:04, 6.28it/s]
97%|█████████▋| 973/1000 [02:32<00:03, 7.60it/s]
98%|█████████▊| 975/1000 [02:32<00:03, 8.08it/s]
98%|█████████▊| 977/1000 [02:32<00:02, 8.96it/s]
98%|█████████▊| 979/1000 [02:32<00:02, 9.06it/s]
98%|█████████▊| 980/1000 [02:33<00:02, 7.03it/s]
98%|█████████▊| 981/1000 [02:33<00:03, 5.84it/s]
98%|█████████▊| 982/1000 [02:33<00:04, 4.45it/s]
98%|█████████▊| 984/1000 [02:34<00:02, 5.76it/s]
99%|█████████▊| 986/1000 [02:34<00:01, 7.08it/s]
99%|█████████▊| 987/1000 [02:34<00:01, 6.64it/s]
99%|█████████▉| 988/1000 [02:34<00:02, 5.52it/s]
99%|█████████▉| 989/1000 [02:35<00:02, 4.86it/s]
99%|█████████▉| 991/1000 [02:35<00:01, 5.16it/s]
99%|█████████▉| 992/1000 [02:35<00:01, 4.13it/s]
99%|█████████▉| 994/1000 [02:35<00:01, 5.48it/s]
100%|█████████▉| 995/1000 [02:36<00:01, 4.64it/s]
100%|█████████▉| 997/1000 [02:36<00:00, 6.03it/s]
100%|█████████▉| 999/1000 [02:36<00:00, 5.81it/s]
100%|██████████| 1000/1000 [02:37<00:00, 5.61it/s]
{'eval_loss': '0.7404', 'eval_runtime': '157.2', 'eval_samples_per_second': '6.36', 'eval_steps_per_second': '6.36', 'epoch': '1', 'num_input_tokens_seen': 12201816}
100%|██████████| 1813/1813 [3:30:33<00:00, 6.40s/it]
100%|██████████| 1000/1000 [02:37<00:00, 5.61it/s]
Saving model checkpoint to /home/schwarc/diplomovka/optuna_lr_hpo_1gpu/trials/trial_003_lr_2.000e-04/checkpoint-1813
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
Training completed. Do not forget to share your model on huggingface.co/models =)
{'train_runtime': '1.263e+04', 'train_samples_per_second': '2.295', 'train_steps_per_second': '0.143', 'train_loss': '0.952', 'epoch': '1', 'num_input_tokens_seen': 12201816}
100%|██████████| 1813/1813 [3:30:34<00:00, 6.40s/it]
100%|██████████| 1813/1813 [3:30:34<00:00, 6.97s/it]
Saving model checkpoint to /home/schwarc/diplomovka/optuna_lr_hpo_1gpu/trials/trial_003_lr_2.000e-04
loading configuration file config.json from cache at /home/schwarc/.cache/huggingface/hub/models--slovak-nlp--mistral-sk-7b/snapshots/089497ae0d72018e9591895c54f774bf0b4a83a4/config.json
Model config MistralConfig {
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"dtype": "bfloat16",
"eos_token_id": 2,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"sliding_window": 4096,
"tie_word_embeddings": false,
"transformers_version": "5.5.0",
"use_cache": true,
"vocab_size": 32000
}
***** train metrics *****
epoch = 1.0
num_input_tokens_seen = 12201816
total_flos = 487685654GF
train_loss = 0.952
train_runtime = 3:30:34.35
train_samples_per_second = 2.295
train_steps_per_second = 0.143
Figure saved at: /home/schwarc/diplomovka/optuna_lr_hpo_1gpu/trials/trial_003_lr_2.000e-04/training_loss.png
Figure saved at: /home/schwarc/diplomovka/optuna_lr_hpo_1gpu/trials/trial_003_lr_2.000e-04/training_eval_loss.png
[WARNING|2026-10-13 09:55:10] llamafactory.extras.ploting:149 >> No metric eval_accuracy to plot.
***** Running Evaluation *****
Num examples = 1000
Batch size = 1
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:71: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:281: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:172: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:202: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
/home/schwarc/miniconda3/envs/llama_factory_unsloth/lib/python3.11/site-packages/transformers/modeling_attn_mask_utils.py:254: FutureWarning: The attention mask API under `transformers.modeling_attn_mask_utils` (`AttentionMaskConverter`) is deprecated and will be removed in Transformers v5.10. Please use the new API in `transformers.masking_utils`.
warnings.warn(DEPRECATION_MESSAGE, FutureWarning)
0%| | 0/1000 [00:00<?, ?it/s]
0%| | 3/1000 [00:00<01:14, 13.35it/s]
0%| | 5/1000 [00:00<02:37, 6.30it/s]
1%| | 7/1000 [00:00<02:16, 7.30it/s]
1%| | 9/1000 [00:01<02:56, 5.63it/s]
1%| | 11/1000 [00:01<02:19, 7.09it/s]
1%| | 12/1000 [00:01<02:17, 7.17it/s]
1%|▏ | 13/1000 [00:01<02:48, 5.87it/s]
1%|▏ | 14/1000 [00:02<02:56, 5.60it/s]
2%|▏ | 15/1000 [00:02<03:21, 4.88it/s]
2%|▏ | 16/1000 [00:02<03:26, 4.76it/s]
2%|▏ | 18/1000 [00:03<03:15, 5.03it/s]
2%|▏ | 19/1000 [00:03<03:48, 4.29it/s]
2%|▏ | 20/1000 [00:03<04:14, 3.85it/s]
2%|▏ | 22/1000 [00:03<03:03, 5.33it/s]
2%|▏ | 23/1000 [00:04<03:29, 4.66it/s]
2%|▎ | 25/1000 [00:04<02:36, 6.23it/s]
3%|▎ | 26/1000 [00:04<03:01, 5.36it/s]
3%|▎ | 28/1000 [00:05<03:07, 5.17it/s]
3%|▎ | 29/1000 [00:05<02:57, 5.49it/s]
3%|▎ | 30/1000 [00:05<03:12, 5.05it/s]
3%|▎ | 31/1000 [00:05<03:31, 4.58it/s]
3%|▎ | 32/1000 [00:05<03:07, 5.15it/s]
3%|▎ | 33/1000 [00:06<03:19, 4.86it/s]
4%|▎ | 35/1000 [00:06<02:27, 6.55it/s]
4%|▎ | 37/1000 [00:06<02:03, 7.81it/s]
4%|▍ | 39/1000 [00:06<02:30, 6.39it/s]
4%|▍ | 40/1000 [00:06<02:26, 6.57it/s]
4%|▍ | 42/1000 [00:07<02:02, 7.80it/s]
4%|▍ | 44/1000 [00:07<01:48, 8.81it/s]
4%|▍ | 45/1000 [00:07<02:12, 7.20it/s]
5%|▍ | 47/1000 [00:07<02:27, 6.46it/s]
5%|▍ | 49/1000 [00:08<02:04, 7.64it/s]
5%|▌ | 50/1000 [00:08<01:58, 8.00it/s]
5%|▌ | 52/1000 [00:08<01:44, 9.10it/s]
5%|▌ | 54/1000 [00:08<01:36, 9.79it/s]
6%|▌ | 56/1000 [00:08<02:05, 7.55it/s]
6%|▌ | 58/1000 [00:09<01:57, 7.99it/s]
6%|▌ | 59/1000 [00:09<02:14, 6.99it/s]
6%|▌ | 61/1000 [00:09<01:54, 8.20it/s]
6%|▌ | 62/1000 [00:09<01:51, 8.43it/s]
6%|▋ | 63/1000 [00:09<01:52, 8.30it/s]
6%|▋ | 64/1000 [00:10<02:28, 6.30it/s]
7%|▋ | 66/1000 [00:10<02:02, 7.63it/s]
7%|▋ | 67/1000 [00:10<02:34, 6.03it/s]
7%|▋ | 68/1000 [00:10<02:20, 6.64it/s]
7%|▋ | 69/1000 [00:10<02:15, 6.87it/s]
7%|▋ | 70/1000 [00:11<02:49, 5.50it/s]
7%|▋ | 72/1000 [00:11<02:49, 5.47it/s]
7%|▋ | 74/1000 [00:11<02:16, 6.79it/s]
8%|▊ | 75/1000 [00:11<02:41, 5.74it/s]
8%|▊ | 76/1000 [00:12<02:44, 5.60it/s]
8%|▊ | 77/1000 [00:12<02:33, 6.01it/s]
8%|▊ | 78/1000 [00:12<03:01, 5.09it/s]
8%|▊ | 79/1000 [00:12<02:36, 5.87it/s]
8%|▊ | 81/1000 [00:12<02:00, 7.61it/s]
8%|▊ | 83/1000 [00:13<02:23, 6.40it/s]
8%|▊ | 85/1000 [00:13<02:30, 6.08it/s]
9%|▊ | 86/1000 [00:13<02:51, 5.33it/s]
9%|▊ | 87/1000 [00:14<03:10, 4.80it/s]
9%|▉ | 88/1000 [00:14<02:48, 5.41it/s]
9%|▉ | 90/1000 [00:14<02:21, 6.43it/s]
9%|▉ | 91/1000 [00:14<02:48, 5.40it/s]
9%|▉ | 92/1000 [00:14<02:46, 5.44it/s]
9%|▉ | 93/1000 [00:15<03:03, 4.95it/s]
9%|▉ | 94/1000 [00:15<02:40, 5.65it/s]
10%|▉ | 95/1000 [00:15<03:18, 4.55it/s]
10%|▉ | 97/1000 [00:15<02:32, 5.91it/s]
10%|▉ | 99/1000 [00:15<02:03, 7.28it/s]
10%|█ | 101/1000 [00:16<01:46, 8.45it/s]
10%|█ | 102/1000 [00:16<02:15, 6.61it/s]
10%|█ | 103/1000 [00:16<02:12, 6.77it/s]
10%|█ | 104/1000 [00:16<02:10, 6.86it/s]
10%|█ | 105/1000 [00:16<02:03, 7.27it/s]
11%|█ | 107/1000 [00:16<01:38, 9.06it/s]
11%|█ | 109/1000 [00:17<01:29, 9.98it/s]
11%|█ | 111/1000 [00:17<01:24, 10.49it/s]
11%|█▏ | 113/1000 [00:17<01:19, 11.17it/s]
12%|█▏ | 115/1000 [00:17<01:17, 11.47it/s]
12%|█▏ | 117/1000 [00:17<01:15, 11.64it/s]
12%|█▏ | 119/1000 [00:18<02:07, 6.89it/s]
12%|█▏ | 120/1000 [00:18<02:28, 5.91it/s]
12%|█▏ | 122/1000 [00:18<02:04, 7.06it/s]
12%|█▏ | 124/1000 [00:19<02:18, 6.32it/s]
12%|█▎ | 125/1000 [00:19<03:02, 4.80it/s]
13%|█▎ | 126/1000 [00:19<02:48, 5.20it/s]
13%|█▎ | 127/1000 [00:19<03:00, 4.83it/s]
13%|█▎ | 128/1000 [00:20<03:15, 4.45it/s]
13%|█▎ | 130/1000 [00:20<02:26, 5.94it/s]
13%|█▎ | 132/1000 [00:20<01:58, 7.35it/s]
13%|█▎ | 134/1000 [00:20<01:39, 8.67it/s]
14%|█▎ | 135/1000 [00:20<01:51, 7.79it/s]
14%|█▎ | 137/1000 [00:21<01:45, 8.17it/s]
14%|█▍ | 139/1000 [00:21<01:45, 8.20it/s]
14%|█▍ | 141/1000 [00:21<01:43, 8.32it/s]
14%|█▍ | 142/1000 [00:21<01:50, 7.73it/s]
14%|█▍ | 143/1000 [00:21<01:52, 7.60it/s]
14%|█▍ | 145/1000 [00:22<01:37, 8.79it/s]
15%|█▍ | 147/1000 [00:22<02:00, 7.08it/s]
15%|█▍ | 148/1000 [00:22<01:57, 7.22it/s]
15%|█▌ | 150/1000 [00:22<01:41, 8.36it/s]
15%|█▌ | 152/1000 [00:22<01:31, 9.25it/s]
15%|█▌ | 154/1000 [00:23<01:36, 8.77it/s]
16%|█▌ | 155/1000 [00:23<02:07, 6.63it/s]
16%|█▌ | 156/1000 [00:23<02:40, 5.26it/s]
16%|█▌ | 158/1000 [00:23<02:05, 6.71it/s]
16%|█▌ | 159/1000 [00:24<01:58, 7.09it/s]
16%|█▌ | 160/1000 [00:24<01:55, 7.27it/s]
16%|█▌ | 162/1000 [00:24<02:08, 6.53it/s]
16%|█▋ | 163/1000 [00:24<02:12, 6.31it/s]
16%|█▋ | 164/1000 [00:25<02:37, 5.32it/s]
16%|█▋ | 165/1000 [00:25<03:02, 4.59it/s]
17%|█▋ | 166/1000 [00:25<03:15, 4.26it/s]
17%|█▋ | 167/1000 [00:25<02:51, 4.85it/s]
17%|█▋ | 169/1000 [00:25<02:03, 6.73it/s]
17%|█▋ | 171/1000 [00:26<02:17, 6.01it/s]
17%|█▋ | 172/1000 [00:26<02:38, 5.21it/s]
17%|█▋ | 173/1000 [00:26<02:35, 5.33it/s]
17%|█▋ | 174/1000 [00:26<02:22, 5.79it/s]
18%|█▊ | 176/1000 [00:27<01:53, 7.29it/s]
18%|█▊ | 177/1000 [00:27<02:19, 5.91it/s]
18%|█▊ | 179/1000 [00:27<01:49, 7.49it/s]
18%|█▊ | 180/1000 [00:27<01:49, 7.47it/s]
18%|█▊ | 181/1000 [00:27<02:22, 5.75it/s]
18%|█▊ | 182/1000 [00:28<02:46, 4.90it/s]
18%|█▊ | 183/1000 [00:28<02:44, 4.98it/s]
18%|█▊ | 185/1000 [00:28<02:03, 6.59it/s]
19%|█▊ | 186/1000 [00:28<02:01, 6.73it/s]
19%|█▊ | 187/1000 [00:29<02:27, 5.50it/s]
19%|█▉ | 189/1000 [00:29<01:56, 6.99it/s]
19%|█▉ | 190/1000 [00:29<02:20, 5.76it/s]
19%|█▉ | 192/1000 [00:29<02:25, 5.55it/s]
19%|█▉ | 194/1000 [00:30<02:26, 5.50it/s]
20%|█▉ | 196/1000 [00:30<02:00, 6.67it/s]
20%|█▉ | 198/1000 [00:30<01:40, 7.95it/s]
20%|██ | 200/1000 [00:30<01:28, 9.05it/s]
20%|██ | 202/1000 [00:31<01:45, 7.54it/s]
20%|██ | 204/1000 [00:31<01:50, 7.22it/s]
21%|██ | 206/1000 [00:31<01:36, 8.20it/s]
21%|██ | 207/1000 [00:31<01:58, 6.67it/s]
21%|██ | 208/1000 [00:31<01:52, 7.04it/s]
21%|██ | 210/1000 [00:32<01:55, 6.82it/s]
21%|██ | 212/1000 [00:32<01:38, 7.98it/s]
21%|██▏ | 213/1000 [00:32<01:48, 7.27it/s]
21%|██▏ | 214/1000 [00:32<01:48, 7.27it/s]
22%|██▏ | 216/1000 [00:32<01:39, 7.86it/s]
22%|██▏ | 217/1000 [00:33<02:05, 6.24it/s]
22%|██▏ | 219/1000 [00:33<01:43, 7.57it/s]
22%|██▏ | 220/1000 [00:33<02:27, 5.30it/s]
22%|██▏ | 221/1000 [00:33<02:29, 5.21it/s]
22%|██▏ | 223/1000 [00:34<02:46, 4.66it/s]
22%|██▏ | 224/1000 [00:34<02:31, 5.12it/s]
22%|██▎ | 225/1000 [00:34<02:29, 5.19it/s]
23%|██▎ | 226/1000 [00:35<02:46, 4.66it/s]
23%|██▎ | 227/1000 [00:35<02:22, 5.41it/s]
23%|██▎ | 228/1000 [00:35<02:11, 5.89it/s]
23%|██▎ | 229/1000 [00:35<02:35, 4.97it/s]
23%|██▎ | 230/1000 [00:35<02:20, 5.49it/s]
23%|██▎ | 232/1000 [00:35<01:51, 6.87it/s]
23%|██▎ | 233/1000 [00:36<01:48, 7.10it/s]
24%|██▎ | 235/1000 [00:36<01:27, 8.76it/s]
24%|██▎ | 236/1000 [00:36<01:29, 8.58it/s]
24%|██▎ | 237/1000 [00:36<01:32, 8.22it/s]
24%|██▍ | 239/1000 [00:36<01:41, 7.47it/s]
24%|██▍ | 241/1000 [00:37<01:48, 7.02it/s]
24%|██▍ | 242/1000 [00:37<02:32, 4.98it/s]
24%|██▍ | 243/1000 [00:37<02:49, 4.46it/s]
24%|██▍ | 245/1000 [00:38<02:15, 5.58it/s]
25%|██▍ | 247/1000 [00:38<01:47, 7.03it/s]
25%|██▍ | 248/1000 [00:38<02:07, 5.91it/s]
25%|██▍ | 249/1000 [00:38<02:29, 5.02it/s]
25%|██▌ | 250/1000 [00:38<02:30, 4.98it/s]
25%|██▌ | 252/1000 [00:39<02:23, 5.20it/s]
25%|██▌ | 253/1000 [00:39<02:30, 4.96it/s]
26%|██▌ | 255/1000 [00:39<01:55, 6.42it/s]
26%|██▌ | 256/1000 [00:39<01:51, 6.70it/s]
26%|██▌ | 258/1000 [00:40<01:37, 7.58it/s]
26%|██▌ | 260/1000 [00:40<01:50, 6.71it/s]
26%|██▌ | 261/1000 [00:40<02:12, 5.56it/s]
26%|██▌ | 262/1000 [00:40<02:13, 5.53it/s]
26%|██▋ | 264/1000 [00:41<02:14, 5.49it/s]
26%|██▋ | 265/1000 [00:41<02:08, 5.73it/s]
27%|██▋ | 266/1000 [00:41<02:06, 5.80it/s]
27%|██▋ | 268/1000 [00:41<01:53, 6.44it/s]
27%|██▋ | 270/1000 [00:42<02:00, 6.06it/s]
27%|██▋ | 271/1000 [00:42<02:38, 4.59it/s]
27%|██▋ | 273/1000 [00:43<02:29, 4.88it/s]
27%|██▋ | 274/1000 [00:43<02:14, 5.38it/s]
28%|██▊ | 275/1000 [00:43<02:07, 5.71it/s]
28%|██▊ | 277/1000 [00:43<01:40, 7.21it/s]
28%|██▊ | 278/1000 [00:43<02:02, 5.91it/s]
28%|██▊ | 280/1000 [00:44<02:04, 5.76it/s]
28%|██▊ | 282/1000 [00:44<01:43, 6.92it/s]
28%|██▊ | 283/1000 [00:44<02:24, 4.97it/s]
28%|██▊ | 284/1000 [00:44<02:28, 4.81it/s]
29%|██▊ | 286/1000 [00:45<01:52, 6.34it/s]
29%|██▉ | 288/1000 [00:45<01:37, 7.34it/s]
29%|██▉ | 290/1000 [00:45<01:47, 6.63it/s]
29%|██▉ | 291/1000 [00:45<02:01, 5.84it/s]
29%|██▉ | 292/1000 [00:46<02:18, 5.11it/s]
29%|██▉ | 294/1000 [00:46<01:55, 6.11it/s]
30%|██▉ | 296/1000 [00:46<02:01, 5.80it/s]
30%|██▉ | 298/1000 [00:46<01:41, 6.95it/s]
30%|██▉ | 299/1000 [00:47<02:06, 5.52it/s]
30%|███ | 300/1000 [00:47<01:59, 5.86it/s]
30%|███ | 301/1000 [00:47<01:53, 6.16it/s]
30%|███ | 303/1000 [00:47<01:31, 7.64it/s]
30%|███ | 304/1000 [00:47<01:38, 7.07it/s]
30%|███ | 305/1000 [00:48<01:37, 7.12it/s]
31%|███ | 306/1000 [00:48<01:54, 6.05it/s]
31%|███ | 307/1000 [00:48<01:57, 5.90it/s]
31%|███ | 309/1000 [00:48<01:30, 7.66it/s]
31%|███ | 311/1000 [00:48<01:16, 8.96it/s]
31%|███▏ | 313/1000 [00:48<01:09, 9.91it/s]
32%|███▏ | 315/1000 [00:49<01:15, 9.02it/s]
32%|███▏ | 316/1000 [00:49<01:25, 8.03it/s]
32%|███▏ | 318/1000 [00:49<01:15, 9.01it/s]
32%|███▏ | 319/1000 [00:49<01:55, 5.92it/s]
32%|███▏ | 321/1000 [00:50<02:01, 5.57it/s]
32%|███▏ | 322/1000 [00:50<02:09, 5.25it/s]
32%|███▏ | 324/1000 [00:50<01:43, 6.54it/s]
32%|███▎ | 325/1000 [00:51<02:23, 4.69it/s]
33%|███▎ | 327/1000 [00:51<01:47, 6.24it/s]
33%|███▎ | 328/1000 [00:51<01:50, 6.09it/s]
33%|███▎ | 330/1000 [00:51<01:54, 5.84it/s]
33%|███▎ | 332/1000 [00:52<02:00, 5.57it/s]
33%|███▎ | 333/1000 [00:52<01:52, 5.95it/s]
33%|███▎ | 334/1000 [00:52<02:01, 5.47it/s]
34%|███▎ | 336/1000 [00:52<01:35, 6.96it/s]
34%|███▍ | 338/1000 [00:52<01:26, 7.69it/s]
34%|███▍ | 340/1000 [00:53<01:15, 8.78it/s]
34%|███▍ | 342/1000 [00:53<01:08, 9.57it/s]
34%|███▍ | 344/1000 [00:53<01:40, 6.52it/s]
34%|███▍ | 345/1000 [00:53<01:38, 6.62it/s]
35%|███▍ | 346/1000 [00:54<01:44, 6.24it/s]
35%|███▍ | 347/1000 [00:54<01:44, 6.22it/s]
35%|███▍ | 349/1000 [00:54<01:50, 5.91it/s]
35%|███▌ | 350/1000 [00:54<02:07, 5.12it/s]
35%|███▌ | 352/1000 [00:55<01:38, 6.60it/s]
35%|███▌ | 354/1000 [00:55<01:40, 6.44it/s]
36%|███▌ | 355/1000 [00:55<01:42, 6.31it/s]
36%|███▌ | 357/1000 [00:55<01:26, 7.43it/s]
36%|███▌ | 359/1000 [00:55<01:12, 8.86it/s]
36%|███▌ | 360/1000 [00:56<01:25, 7.51it/s]
36%|███▌ | 362/1000 [00:56<01:13, 8.67it/s]
36%|███▋ | 363/1000 [00:56<01:53, 5.62it/s]
36%|███▋ | 364/1000 [00:57<02:07, 4.98it/s]
36%|███▋ | 365/1000 [00:57<02:43, 3.89it/s]
37%|███▋ | 367/1000 [00:57<02:25, 4.36it/s]
37%|███▋ | 368/1000 [00:58<02:31, 4.16it/s]
37%|███▋ | 369/1000 [00:58<02:13, 4.71it/s]
37%|███▋ | 371/1000 [00:58<01:36, 6.53it/s]
37%|███▋ | 372/1000 [00:58<01:34, 6.65it/s]
37%|███▋ | 374/1000 [00:58<01:30, 6.92it/s]
38%|███▊ | 375/1000 [00:59<01:57, 5.30it/s]
38%|███▊ | 376/1000 [00:59<02:15, 4.60it/s]
38%|███▊ | 377/1000 [00:59<01:59, 5.23it/s]
38%|███▊ | 379/1000 [00:59<01:28, 7.06it/s]
38%|███▊ | 381/1000 [00:59<01:17, 7.99it/s]
38%|███▊ | 382/1000 [01:00<01:29, 6.87it/s]
38%|███▊ | 384/1000 [01:00<01:14, 8.22it/s]
38%|███▊ | 385/1000 [01:00<01:16, 7.99it/s]
39%|███▊ | 386/1000 [01:00<01:17, 7.88it/s]
39%|███▊ | 387/1000 [01:00<01:43, 5.91it/s]
39%|███▉ | 388/1000 [01:01<01:45, 5.79it/s]
39%|███▉ | 389/1000 [01:01<01:35, 6.39it/s]
39%|███▉ | 390/1000 [01:01<01:36, 6.33it/s]
39%|███▉ | 391/1000 [01:01<01:40, 6.07it/s]
39%|███▉ | 393/1000 [01:01<01:17, 7.88it/s]
40%|███▉ | 395/1000 [01:02<01:34, 6.40it/s]
40%|███▉ | 397/1000 [01:02<01:18, 7.71it/s]
40%|███▉ | 398/1000 [01:02<01:36, 6.23it/s]
40%|███▉ | 399/1000 [01:02<02:01, 4.96it/s]
40%|████ | 400/1000 [01:03<02:12, 4.53it/s]
40%|████ | 402/1000 [01:03<02:04, 4.81it/s]
40%|████ | 404/1000 [01:03<01:37, 6.13it/s]
41%|████ | 406/1000 [01:03<01:20, 7.35it/s]
41%|████ | 407/1000 [01:04<01:37, 6.09it/s]
41%|████ | 408/1000 [01:04<01:51, 5.31it/s]
41%|████ | 410/1000 [01:04<01:50, 5.35it/s]
41%|████ | 411/1000 [01:05<02:01, 4.84it/s]
41%|████ | 412/1000 [01:05<02:11, 4.47it/s]
41%|████▏ | 414/1000 [01:05<01:36, 6.08it/s]
42%|████▏ | 416/1000 [01:05<01:40, 5.80it/s]
42%|████▏ | 418/1000 [01:06<01:21, 7.14it/s]
42%|████▏ | 420/1000 [01:06<01:20, 7.17it/s]
42%|████▏ | 421/1000 [01:06<01:30, 6.38it/s]
42%|████▏ | 423/1000 [01:06<01:41, 5.71it/s]
42%|████▏ | 424/1000 [01:07<01:55, 4.98it/s]
42%|████▎ | 425/1000 [01:07<01:46, 5.41it/s]
43%|████▎ | 427/1000 [01:07<01:23, 6.83it/s]
43%|████▎ | 428/1000 [01:07<01:27, 6.51it/s]
43%|████▎ | 429/1000 [01:07<01:24, 6.79it/s]
43%|████▎ | 431/1000 [01:08<01:08, 8.26it/s]
43%|████▎ | 433/1000 [01:08<00:59, 9.58it/s]
44%|████▎ | 435/1000 [01:08<00:56, 9.92it/s]
44%|████▎ | 437/1000 [01:08<01:02, 9.00it/s]
44%|████▍ | 439/1000 [01:09<01:20, 6.94it/s]
44%|████▍ | 441/1000 [01:09<01:11, 7.86it/s]
44%|████▍ | 442/1000 [01:09<01:26, 6.44it/s]
44%|████▍ | 444/1000 [01:09<01:27, 6.37it/s]
45%|████▍ | 446/1000 [01:10<01:12, 7.61it/s]
45%|████▍ | 448/1000 [01:10<01:24, 6.55it/s]
45%|████▌ | 450/1000 [01:10<01:29, 6.16it/s]
45%|████▌ | 451/1000 [01:11<01:40, 5.44it/s]
45%|████▌ | 452/1000 [01:11<01:51, 4.91it/s]
45%|████▌ | 454/1000 [01:11<01:26, 6.32it/s]
46%|████▌ | 456/1000 [01:11<01:12, 7.47it/s]
46%|████▌ | 457/1000 [01:11<01:19, 6.84it/s]
46%|████▌ | 459/1000 [01:12<01:06, 8.14it/s]
46%|████▌ | 461/1000 [01:12<00:56, 9.50it/s]
46%|████▋ | 463/1000 [01:12<01:20, 6.66it/s]
46%|████▋ | 465/1000 [01:13<01:30, 5.89it/s]
47%|████▋ | 466/1000 [01:13<01:41, 5.26it/s]
47%|████▋ | 467/1000 [01:13<02:06, 4.21it/s]
47%|████▋ | 469/1000 [01:13<01:36, 5.50it/s]
47%|████▋ | 471/1000 [01:14<01:17, 6.86it/s]
47%|████▋ | 472/1000 [01:14<01:13, 7.18it/s]
47%|████▋ | 473/1000 [01:14<01:21, 6.47it/s]
47%|████▋ | 474/1000 [01:14<01:37, 5.41it/s]
48%|████▊ | 476/1000 [01:15<01:36, 5.42it/s]
48%|████▊ | 477/1000 [01:15<01:53, 4.62it/s]
48%|████▊ | 479/1000 [01:15<01:24, 6.19it/s]
48%|████▊ | 480/1000 [01:15<01:31, 5.68it/s]
48%|████▊ | 482/1000 [01:15<01:13, 7.04it/s]
48%|████▊ | 484/1000 [01:16<01:20, 6.40it/s]
48%|████▊ | 485/1000 [01:16<01:33, 5.51it/s]
49%|████▊ | 486/1000 [01:16<01:33, 5.48it/s]
49%|████▉ | 488/1000 [01:16<01:15, 6.80it/s]
49%|████▉ | 489/1000 [01:17<01:30, 5.67it/s]
49%|████▉ | 491/1000 [01:17<01:11, 7.09it/s]
49%|████▉ | 492/1000 [01:17<01:10, 7.18it/s]
49%|████▉ | 494/1000 [01:17<00:58, 8.71it/s]
50%|████▉ | 496/1000 [01:18<01:08, 7.34it/s]
50%|████▉ | 498/1000 [01:18<01:08, 7.36it/s]
50%|████▉ | 499/1000 [01:18<01:28, 5.64it/s]
50%|█████ | 500/1000 [01:18<01:38, 5.05it/s]
50%|█████ | 502/1000 [01:19<01:18, 6.38it/s]
50%|█████ | 503/1000 [01:19<01:27, 5.70it/s]
50%|█████ | 505/1000 [01:19<01:28, 5.60it/s]
51%|█████ | 506/1000 [01:20<01:40, 4.91it/s]
51%|█████ | 508/1000 [01:20<01:18, 6.25it/s]
51%|█████ | 510/1000 [01:20<01:04, 7.58it/s]
51%|█████ | 512/1000 [01:20<00:57, 8.46it/s]
51%|█████▏ | 514/1000 [01:21<01:20, 6.07it/s]
52%|█████▏ | 515/1000 [01:21<01:16, 6.34it/s]
52%|█████▏ | 516/1000 [01:21<01:20, 6.04it/s]
52%|█████▏ | 517/1000 [01:21<01:15, 6.40it/s]
52%|█████▏ | 518/1000 [01:21<01:12, 6.64it/s]
52%|█████▏ | 519/1000 [01:22<01:34, 5.12it/s]
52%|█████▏ | 521/1000 [01:22<01:11, 6.73it/s]
52%|█████▏ | 522/1000 [01:22<01:27, 5.48it/s]
52%|█████▏ | 523/1000 [01:22<01:38, 4.83it/s]
52%|█████▏ | 524/1000 [01:22<01:41, 4.69it/s]
53%|█████▎ | 526/1000 [01:23<01:23, 5.65it/s]
53%|█████▎ | 528/1000 [01:23<01:25, 5.50it/s]
53%|█████▎ | 529/1000 [01:23<01:26, 5.42it/s]
53%|█████▎ | 531/1000 [01:23<01:07, 6.95it/s]
53%|█████▎ | 533/1000 [01:24<00:55, 8.46it/s]
53%|█████▎ | 534/1000 [01:24<01:10, 6.65it/s]
54%|█████▎ | 535/1000 [01:24<01:26, 5.41it/s]
54%|█████▎ | 536/1000 [01:24<01:29, 5.17it/s]
54%|█████▎ | 537/1000 [01:25<01:39, 4.64it/s]
54%|█████▍ | 539/1000 [01:25<01:32, 5.00it/s]
54%|█████▍ | 540/1000 [01:25<01:34, 4.87it/s]
54%|█████▍ | 541/1000 [01:26<01:45, 4.36it/s]
54%|█████▍ | 543/1000 [01:26<01:17, 5.91it/s]
55%|█████▍ | 545/1000 [01:26<01:14, 6.08it/s]
55%|█████▍ | 546/1000 [01:26<01:21, 5.59it/s]
55%|█████▍ | 547/1000 [01:27<01:32, 4.89it/s]
55%|█████▍ | 549/1000 [01:27<01:29, 5.01it/s]
55%|█████▌ | 551/1000 [01:27<01:09, 6.43it/s]
55%|█████▌ | 552/1000 [01:27<01:11, 6.26it/s]
55%|█████▌ | 553/1000 [01:28<01:23, 5.34it/s]
55%|█████▌ | 554/1000 [01:28<01:29, 5.01it/s]
56%|█████▌ | 556/1000 [01:28<01:07, 6.61it/s]
56%|█████▌ | 557/1000 [01:28<01:13, 6.01it/s]
56%|█████▌ | 559/1000 [01:28<00:58, 7.59it/s]
56%|█████▌ | 561/1000 [01:29<00:52, 8.44it/s]
56%|█████▋ | 563/1000 [01:29<01:01, 7.14it/s]
56%|█████▋ | 565/1000 [01:29<01:03, 6.84it/s]
57%|█████▋ | 566/1000 [01:30<01:16, 5.69it/s]
57%|█████▋ | 568/1000 [01:30<01:17, 5.61it/s]
57%|█████▋ | 569/1000 [01:30<01:17, 5.53it/s]
57%|█████▋ | 571/1000 [01:30<01:17, 5.54it/s]
57%|█████▋ | 572/1000 [01:31<01:20, 5.31it/s]
57%|█████▋ | 574/1000 [01:31<01:18, 5.42it/s]
58%|█████▊ | 576/1000 [01:31<01:03, 6.69it/s]
58%|█████▊ | 577/1000 [01:32<01:26, 4.91it/s]
58%|█████▊ | 578/1000 [01:32<01:35, 4.44it/s]
58%|█████▊ | 580/1000 [01:32<01:12, 5.80it/s]
58%|█████▊ | 582/1000 [01:32<00:58, 7.13it/s]
58%|█████▊ | 583/1000 [01:33<01:11, 5.80it/s]
58%|█████▊ | 585/1000 [01:33<01:09, 5.96it/s]
59%|█████▊ | 587/1000 [01:33<01:07, 6.16it/s]
59%|█████▉ | 589/1000 [01:33<00:55, 7.34it/s]
59%|█████▉ | 590/1000 [01:34<01:11, 5.71it/s]
59%|█████▉ | 592/1000 [01:34<00:58, 6.94it/s]
59%|█████▉ | 593/1000 [01:34<01:09, 5.84it/s]
60%|█████▉ | 595/1000 [01:34<00:55, 7.24it/s]
60%|█████▉ | 596/1000 [01:35<01:10, 5.76it/s]
60%|█████▉ | 597/1000 [01:35<01:11, 5.65it/s]
60%|█████▉ | 599/1000 [01:35<01:12, 5.56it/s]
60%|██████ | 601/1000 [01:36<01:12, 5.53it/s]
60%|██████ | 602/1000 [01:36<01:10, 5.66it/s]
60%|██████ | 604/1000 [01:36<01:21, 4.84it/s]
61%|██████ | 606/1000 [01:36<01:06, 5.96it/s]
61%|██████ | 608/1000 [01:37<00:59, 6.64it/s]
61%|██████ | 610/1000 [01:37<00:53, 7.23it/s]
61%|██████ | 612/1000 [01:37<00:46, 8.36it/s]
61%|██████▏ | 614/1000 [01:37<00:41, 9.36it/s]
62%|██████▏ | 616/1000 [01:38<00:59, 6.47it/s]
62%|██████▏ | 617/1000 [01:38<00:58, 6.59it/s]
62%|██████▏ | 619/1000 [01:38<00:49, 7.71it/s]
62%|██████▏ | 621/1000 [01:38<00:55, 6.86it/s]
62%|██████▏ | 623/1000 [01:39<00:53, 7.03it/s]
62%|██████▎ | 625/1000 [01:39<00:59, 6.31it/s]
63%|██████▎ | 627/1000 [01:39<00:50, 7.33it/s]
63%|██████▎ | 628/1000 [01:39<01:00, 6.15it/s]
63%|██████▎ | 629/1000 [01:40<01:09, 5.36it/s]
63%|██████▎ | 631/1000 [01:40<00:54, 6.79it/s]
63%|██████▎ | 633/1000 [01:40<00:46, 7.96it/s]
63%|██████▎ | 634/1000 [01:40<01:06, 5.47it/s]
64%|██████▎ | 635/1000 [01:41<01:04, 5.66it/s]
64%|██████▎ | 636/1000 [01:41<00:59, 6.15it/s]
64%|██████▍ | 638/1000 [01:41<00:52, 6.96it/s]
64%|██████▍ | 640/1000 [01:41<00:43, 8.21it/s]
64%|██████▍ | 641/1000 [01:41<00:57, 6.29it/s]
64%|██████▍ | 643/1000 [01:42<00:53, 6.62it/s]
64%|██████▍ | 645/1000 [01:42<00:57, 6.19it/s]
65%|██████▍ | 647/1000 [01:42<00:54, 6.47it/s]
65%|██████▍ | 648/1000 [01:43<01:02, 5.61it/s]
65%|██████▌ | 650/1000 [01:43<01:01, 5.68it/s]
65%|██████▌ | 652/1000 [01:43<01:03, 5.46it/s]
65%|██████▌ | 654/1000 [01:44<00:53, 6.51it/s]
66%|██████▌ | 656/1000 [01:44<00:45, 7.56it/s]
66%|██████▌ | 657/1000 [01:44<00:54, 6.32it/s]
66%|██████▌ | 659/1000 [01:45<01:05, 5.22it/s]
66%|██████▌ | 661/1000 [01:45<00:51, 6.52it/s]
66%|██████▌ | 662/1000 [01:45<01:00, 5.63it/s]
66%|██████▋ | 664/1000 [01:45<01:07, 4.94it/s]
66%|██████▋ | 665/1000 [01:46<01:12, 4.59it/s]
67%|██████▋ | 667/1000 [01:46<01:08, 4.83it/s]
67%|██████▋ | 668/1000 [01:46<01:13, 4.52it/s]
67%|██████▋ | 669/1000 [01:47<01:06, 4.95it/s]
67%|██████▋ | 671/1000 [01:47<01:05, 4.99it/s]
67%|██████▋ | 673/1000 [01:47<00:57, 5.70it/s]
68%|██████▊ | 675/1000 [01:47<00:51, 6.27it/s]
68%|██████▊ | 677/1000 [01:48<00:43, 7.47it/s]
68%|██████▊ | 679/1000 [01:48<00:39, 8.15it/s]
68%|██████▊ | 681/1000 [01:48<00:33, 9.43it/s]
68%|██████▊ | 683/1000 [01:48<00:41, 7.70it/s]
68%|██████▊ | 685/1000 [01:48<00:36, 8.56it/s]
69%|██████▊ | 686/1000 [01:49<00:47, 6.62it/s]
69%|██████▊ | 687/1000 [01:49<00:55, 5.67it/s]
69%|██████▉ | 688/1000 [01:49<00:51, 6.05it/s]
69%|██████▉ | 690/1000 [01:50<00:53, 5.76it/s]
69%|██████▉ | 692/1000 [01:50<00:46, 6.63it/s]
69%|██████▉ | 694/1000 [01:50<00:50, 6.04it/s]
70%|██████▉ | 695/1000 [01:50<00:48, 6.26it/s]
70%|██████▉ | 696/1000 [01:51<00:56, 5.37it/s]
70%|██████▉ | 698/1000 [01:51<00:50, 5.94it/s]
70%|██████▉ | 699/1000 [01:51<00:59, 5.07it/s]
70%|███████ | 701/1000 [01:51<00:46, 6.47it/s]
70%|███████ | 702/1000 [01:52<01:01, 4.82it/s]
70%|███████ | 703/1000 [01:52<00:54, 5.41it/s]
70%|███████ | 705/1000 [01:52<01:01, 4.77it/s]
71%|███████ | 707/1000 [01:53<00:48, 6.10it/s]
71%|███████ | 709/1000 [01:53<00:44, 6.47it/s]
71%|███████ | 710/1000 [01:53<00:52, 5.57it/s]
71%|███████ | 712/1000 [01:53<00:44, 6.54it/s]
71%|███████▏ | 713/1000 [01:53<00:44, 6.51it/s]
72%|███████▏ | 715/1000 [01:54<00:36, 7.86it/s]
72%|███████▏ | 716/1000 [01:54<00:45, 6.29it/s]
72%|███████▏ | 717/1000 [01:54<00:41, 6.87it/s]
72%|███████▏ | 718/1000 [01:54<00:49, 5.66it/s]
72%|███████▏ | 719/1000 [01:55<00:57, 4.90it/s]
72%|███████▏ | 720/1000 [01:55<00:51, 5.47it/s]
72%|███████▏ | 722/1000 [01:55<00:39, 7.03it/s]
72%|███████▏ | 723/1000 [01:55<00:39, 7.01it/s]
72%|███████▏ | 724/1000 [01:55<00:39, 7.04it/s]
72%|███████▎ | 725/1000 [01:55<00:38, 7.16it/s]
73%|███████▎ | 727/1000 [01:55<00:30, 8.85it/s]
73%|███████▎ | 729/1000 [01:56<00:26, 10.16it/s]
73%|███████▎ | 731/1000 [01:56<00:37, 7.26it/s]
73%|███████▎ | 733/1000 [01:56<00:31, 8.34it/s]
73%|███████▎ | 734/1000 [01:56<00:32, 8.28it/s]
74%|███████▎ | 736/1000 [01:57<00:34, 7.66it/s]
74%|███████▍ | 738/1000 [01:57<00:31, 8.29it/s]
74%|███████▍ | 740/1000 [01:57<00:28, 9.09it/s]
74%|███████▍ | 741/1000 [01:57<00:36, 7.06it/s]
74%|███████▍ | 743/1000 [01:58<00:36, 7.02it/s]
74%|███████▍ | 745/1000 [01:58<00:30, 8.26it/s]
75%|███████▍ | 747/1000 [01:58<00:27, 9.07it/s]
75%|███████▍ | 748/1000 [01:58<00:36, 6.84it/s]
75%|███████▌ | 750/1000 [01:58<00:37, 6.68it/s]
75%|███████▌ | 751/1000 [01:59<00:46, 5.35it/s]
75%|███████▌ | 753/1000 [01:59<00:39, 6.28it/s]
75%|███████▌ | 754/1000 [01:59<00:46, 5.31it/s]
76%|███████▌ | 756/1000 [02:00<00:44, 5.51it/s]
76%|███████▌ | 758/1000 [02:00<00:36, 6.57it/s]
76%|███████▌ | 759/1000 [02:00<00:37, 6.35it/s]
76%|███████▌ | 761/1000 [02:00<00:31, 7.50it/s]
76%|███████▋ | 763/1000 [02:01<00:36, 6.56it/s]
76%|███████▋ | 764/1000 [02:01<00:41, 5.69it/s]
77%|███████▋ | 766/1000 [02:01<00:42, 5.51it/s]
77%|███████▋ | 768/1000 [02:01<00:34, 6.66it/s]
77%|███████▋ | 769/1000 [02:02<00:41, 5.59it/s]
77%|███████▋ | 770/1000 [02:02<00:41, 5.58it/s]
77%|███████▋ | 772/1000 [02:02<00:32, 6.96it/s]
77%|███████▋ | 773/1000 [02:02<00:41, 5.47it/s]
77%|███████▋ | 774/1000 [02:03<00:38, 5.83it/s]
78%|███████▊ | 776/1000 [02:03<00:33, 6.65it/s]
78%|███████▊ | 778/1000 [02:03<00:27, 8.08it/s]
78%|███████▊ | 780/1000 [02:03<00:37, 5.91it/s]
78%|███████▊ | 782/1000 [02:04<00:30, 7.15it/s]
78%|███████▊ | 783/1000 [02:04<00:37, 5.86it/s]
78%|███████▊ | 784/1000 [02:04<00:35, 6.14it/s]
79%|███████▊ | 786/1000 [02:04<00:32, 6.58it/s]
79%|███████▉ | 788/1000 [02:05<00:28, 7.43it/s]
79%|███████▉ | 789/1000 [02:05<00:27, 7.75it/s]
79%|███████▉ | 790/1000 [02:05<00:26, 7.81it/s]
79%|███████▉ | 791/1000 [02:05<00:30, 6.96it/s]
79%|███████▉ | 792/1000 [02:05<00:31, 6.50it/s]
79%|███████▉ | 793/1000 [02:05<00:30, 6.86it/s]
80%|███████▉ | 795/1000 [02:06<00:33, 6.15it/s]
80%|███████▉ | 796/1000 [02:06<00:30, 6.69it/s]
80%|███████▉ | 797/1000 [02:06<00:36, 5.52it/s]
80%|███████▉ | 798/1000 [02:06<00:41, 4.82it/s]
80%|████████ | 800/1000 [02:07<00:36, 5.54it/s]
80%|████████ | 802/1000 [02:07<00:30, 6.50it/s]
80%|████████ | 804/1000 [02:07<00:29, 6.73it/s]
80%|████████ | 805/1000 [02:07<00:27, 7.10it/s]
81%|████████ | 807/1000 [02:07<00:24, 7.81it/s]
81%|████████ | 809/1000 [02:08<00:21, 8.91it/s]
81%|████████ | 811/1000 [02:08<00:19, 9.82it/s]
81%|████████▏ | 813/1000 [02:08<00:23, 7.95it/s]
81%|████████▏ | 814/1000 [02:08<00:23, 7.80it/s]
82%|████████▏ | 816/1000 [02:08<00:21, 8.70it/s]
82%|████████▏ | 817/1000 [02:09<00:27, 6.62it/s]
82%|████████▏ | 819/1000 [02:09<00:23, 7.80it/s]
82%|████████▏ | 820/1000 [02:09<00:28, 6.28it/s]
82%|████████▏ | 821/1000 [02:09<00:26, 6.73it/s]
82%|████████▏ | 823/1000 [02:10<00:26, 6.64it/s]
82%|████████▏ | 824/1000 [02:10<00:31, 5.57it/s]
82%|████████▎ | 825/1000 [02:10<00:30, 5.82it/s]
83%|████████▎ | 826/1000 [02:10<00:36, 4.79it/s]
83%|████████▎ | 828/1000 [02:11<00:39, 4.30it/s]
83%|████████▎ | 829/1000 [02:11<00:35, 4.78it/s]
83%|████████▎ | 831/1000 [02:11<00:28, 5.98it/s]
83%|████████▎ | 832/1000 [02:12<00:34, 4.81it/s]
83%|████████▎ | 833/1000 [02:12<00:31, 5.25it/s]
83%|████████▎ | 834/1000 [02:12<00:32, 5.13it/s]
84%|████████▎ | 835/1000 [02:12<00:29, 5.57it/s]
84%|████████▎ | 836/1000 [02:12<00:32, 5.10it/s]
84%|████████▍ | 838/1000 [02:12<00:25, 6.33it/s]
84%|████████▍ | 840/1000 [02:13<00:28, 5.69it/s]
84%|████████▍ | 842/1000 [02:13<00:22, 7.02it/s]
84%|████████▍ | 843/1000 [02:13<00:21, 7.32it/s]
84%|████████▍ | 844/1000 [02:14<00:31, 5.02it/s]
84%|████████▍ | 845/1000 [02:14<00:34, 4.47it/s]
85%|████████▍ | 847/1000 [02:14<00:29, 5.10it/s]
85%|████████▍ | 849/1000 [02:14<00:23, 6.36it/s]
85%|████████▌ | 850/1000 [02:15<00:28, 5.34it/s]
85%|████████▌ | 851/1000 [02:15<00:25, 5.74it/s]
85%|████████▌ | 853/1000 [02:15<00:20, 7.25it/s]
86%|████████▌ | 855/1000 [02:15<00:16, 8.68it/s]
86%|████████▌ | 856/1000 [02:15<00:16, 8.49it/s]
86%|████████▌ | 858/1000 [02:16<00:20, 6.84it/s]
86%|████████▌ | 860/1000 [02:16<00:17, 7.99it/s]
86%|████████▌ | 862/1000 [02:16<00:15, 9.03it/s]
86%|████████▋ | 864/1000 [02:16<00:13, 10.14it/s]
87%|████████▋ | 866/1000 [02:16<00:13, 10.23it/s]
87%|████████▋ | 868/1000 [02:17<00:16, 8.04it/s]
87%|████████▋ | 870/1000 [02:17<00:14, 8.87it/s]
87%|████████▋ | 872/1000 [02:17<00:16, 7.99it/s]
87%|████████▋ | 873/1000 [02:17<00:19, 6.46it/s]
87%|████████▋ | 874/1000 [02:18<00:21, 5.75it/s]
88%|████████▊ | 876/1000 [02:18<00:17, 7.18it/s]
88%|████████▊ | 878/1000 [02:18<00:18, 6.49it/s]
88%|████████▊ | 879/1000 [02:18<00:20, 5.78it/s]
88%|████████▊ | 881/1000 [02:19<00:18, 6.59it/s]
88%|████████▊ | 882/1000 [02:19<00:21, 5.54it/s]
88%|████████▊ | 884/1000 [02:19<00:16, 6.95it/s]
89%|████████▊ | 886/1000 [02:19<00:14, 8.10it/s]
89%|████████▊ | 887/1000 [02:19<00:13, 8.33it/s]
89%|████████▉ | 889/1000 [02:20<00:13, 8.16it/s]
89%|████████▉ | 891/1000 [02:20<00:11, 9.21it/s]
89%|████████▉ | 893/1000 [02:20<00:13, 8.14it/s]
89%|████████▉ | 894/1000 [02:20<00:16, 6.54it/s]
90%|████████▉ | 896/1000 [02:21<00:13, 7.84it/s]
90%|████████▉ | 897/1000 [02:21<00:16, 6.13it/s]
90%|████████▉ | 898/1000 [02:21<00:19, 5.30it/s]
90%|█████████ | 900/1000 [02:21<00:14, 6.72it/s]
90%|█████████ | 901/1000 [02:21<00:14, 6.71it/s]
90%|█████████ | 902/1000 [02:22<00:14, 6.98it/s]
90%|█████████ | 904/1000 [02:22<00:11, 8.48it/s]
90%|█████████ | 905/1000 [02:22<00:13, 7.19it/s]
91%|█████████ | 906/1000 [02:22<00:16, 5.78it/s]
91%|█████████ | 908/1000 [02:22<00:12, 7.41it/s]
91%|█████████ | 910/1000 [02:23<00:13, 6.61it/s]
91%|█████████ | 912/1000 [02:23<00:11, 7.84it/s]
91%|█████████▏| 913/1000 [02:23<00:14, 5.91it/s]
92%|█████████▏| 915/1000 [02:23<00:11, 7.20it/s]
92%|█████████▏| 916/1000 [02:24<00:13, 6.01it/s]
92%|█████████▏| 917/1000 [02:24<00:13, 6.36it/s]
92%|█████████▏| 918/1000 [02:24<00:17, 4.61it/s]
92%|█████████▏| 919/1000 [02:24<00:16, 4.80it/s]
92%|█████████▏| 921/1000 [02:25<00:16, 4.74it/s]
92%|█████████▏| 922/1000 [02:25<00:15, 5.09it/s]
92%|█████████▏| 924/1000 [02:25<00:12, 6.26it/s]
93%|█████████▎| 926/1000 [02:25<00:09, 7.61it/s]
93%|█████████▎| 927/1000 [02:26<00:10, 7.11it/s]
93%|█████████▎| 928/1000 [02:26<00:12, 5.82it/s]
93%|█████████▎| 930/1000 [02:26<00:12, 5.68it/s]
93%|█████████▎| 931/1000 [02:26<00:11, 6.00it/s]
93%|█████████▎| 933/1000 [02:27<00:11, 5.81it/s]
93%|█████████▎| 934/1000 [02:27<00:12, 5.42it/s]
94%|█████████▎| 936/1000 [02:27<00:09, 6.43it/s]
94%|█████████▍| 938/1000 [02:27<00:07, 7.77it/s]
94%|█████████▍| 939/1000 [02:28<00:08, 7.07it/s]
94%|█████████▍| 940/1000 [02:28<00:08, 7.16it/s]
94%|█████████▍| 942/1000 [02:28<00:10, 5.54it/s]
94%|█████████▍| 944/1000 [02:28<00:09, 6.18it/s]
95%|█████████▍| 946/1000 [02:29<00:07, 7.24it/s]
95%|█████████▍| 948/1000 [02:29<00:06, 8.31it/s]
95%|█████████▍| 949/1000 [02:29<00:07, 7.15it/s]
95%|█████████▌| 951/1000 [02:29<00:05, 8.20it/s]
95%|█████████▌| 952/1000 [02:29<00:08, 5.94it/s]
95%|█████████▌| 954/1000 [02:30<00:09, 4.95it/s]
96%|█████████▌| 956/1000 [02:30<00:07, 6.21it/s]
96%|█████████▌| 957/1000 [02:30<00:08, 5.25it/s]
96%|█████████▌| 959/1000 [02:31<00:08, 4.81it/s]
96%|█████████▌| 961/1000 [02:31<00:06, 5.78it/s]
96%|█████████▌| 962/1000 [02:31<00:07, 5.07it/s]
96%|█████████▋| 964/1000 [02:32<00:05, 6.37it/s]
96%|█████████▋| 965/1000 [02:32<00:06, 5.50it/s]
97%|█████████▋| 966/1000 [02:32<00:06, 5.43it/s]
97%|█████████▋| 968/1000 [02:32<00:04, 6.93it/s]
97%|█████████▋| 970/1000 [02:32<00:03, 7.97it/s]
97%|█████████▋| 971/1000 [02:33<00:04, 6.36it/s]
97%|█████████▋| 973/1000 [02:33<00:03, 7.64it/s]
98%|█████████▊| 975/1000 [02:33<00:03, 8.10it/s]
98%|█████████▊| 977/1000 [02:33<00:02, 9.29it/s]
98%|█████████▊| 979/1000 [02:34<00:02, 9.09it/s]
98%|█████████▊| 980/1000 [02:34<00:02, 7.04it/s]
98%|█████████▊| 981/1000 [02:34<00:03, 5.86it/s]
98%|█████████▊| 982/1000 [02:34<00:04, 4.45it/s]
98%|█████████▊| 984/1000 [02:35<00:02, 5.85it/s]
99%|█████████▊| 986/1000 [02:35<00:01, 7.18it/s]
99%|█████████▊| 987/1000 [02:35<00:01, 6.70it/s]
99%|█████████▉| 988/1000 [02:35<00:02, 5.56it/s]
99%|█████████▉| 989/1000 [02:36<00:02, 4.77it/s]
99%|█████████▉| 991/1000 [02:36<00:01, 5.04it/s]
99%|█████████▉| 992/1000 [02:36<00:01, 4.07it/s]
99%|█████████▉| 994/1000 [02:37<00:01, 5.55it/s]
100%|█████████▉| 995/1000 [02:37<00:01, 4.59it/s]
100%|█████████▉| 997/1000 [02:37<00:00, 5.97it/s]
100%|█████████▉| 999/1000 [02:37<00:00, 5.79it/s]
100%|██████████| 1000/1000 [02:38<00:00, 5.55it/s]
100%|██████████| 1000/1000 [02:38<00:00, 6.32it/s]
***** eval metrics *****
epoch = 1.0
eval_loss = 0.7404
eval_runtime = 0:02:38.33
eval_samples_per_second = 6.316
eval_steps_per_second = 6.316
num_input_tokens_seen = 12201816
Dropping the following result as it does not have all the necessary fields:
{'task': {'name': 'Causal Language Modeling', 'type': 'text-generation'}}
Reference in New Issue View Git Blame Copy Permalink