forked from IIEKES/MLM_transfer
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathscreenlog_run_attention_based_yelp.log
8608 lines (8574 loc) · 339 KB
/
screenlog_run_attention_based_yelp.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
[01;32mxgg@1604[00m:[01;34m~/pros/MLM_transfer[00m$ bash scripts/ate[K[K[Kate[K[Kttention_based/fine_tune_yelp_attention_based.sh
+ PROJECTPATH=/home/xgg/pros/MLM_transfer
+ cp configs/bert_yelp_attention_based.config run.config
+ PYTHONPATH=/home/xgg/pros/MLM_transfer
+ /home/xgg/anaconda3/bin/python fine_tune_bert.py
03/12/2019 00:13:13 - INFO - dataloader - device cuda n_gpu 1 distributed training False
03/12/2019 00:13:15 - INFO - dataloader - *** Example ***
03/12/2019 00:13:15 - INFO - dataloader - guid: train-1
03/12/2019 00:13:15 - INFO - dataloader - tokens: [CLS] great breakfast ##s , lunch ##es and dinners . [SEP]
03/12/2019 00:13:15 - INFO - dataloader - init_ids: 101 2307 6350 2015 1010 6265 2229 1998 29236 1012 102
03/12/2019 00:13:15 - INFO - dataloader - input_ids: 101 103 6350 2015 1010 6265 2229 1998 29236 1012 102 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - input_mask: 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - segment_ids: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - masked_lm_labels: -1 2307 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1
03/12/2019 00:13:15 - INFO - dataloader - *** Example ***
03/12/2019 00:13:15 - INFO - dataloader - guid: train-2
03/12/2019 00:13:15 - INFO - dataloader - tokens: [CLS] love love love this place ! [SEP]
03/12/2019 00:13:15 - INFO - dataloader - init_ids: 101 2293 2293 2293 2023 2173 999 102
03/12/2019 00:13:15 - INFO - dataloader - input_ids: 101 2293 2293 103 2023 2173 999 102 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - input_mask: 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - segment_ids: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - masked_lm_labels: -1 -1 -1 2293 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1
03/12/2019 00:13:15 - INFO - dataloader - *** Example ***
03/12/2019 00:13:15 - INFO - dataloader - guid: train-3
03/12/2019 00:13:15 - INFO - dataloader - tokens: [CLS] bryan and scott go above and beyond . [SEP]
03/12/2019 00:13:15 - INFO - dataloader - init_ids: 101 8527 1998 3660 2175 2682 1998 3458 1012 102
03/12/2019 00:13:15 - INFO - dataloader - input_ids: 101 8527 1998 3660 2175 103 1998 3458 1012 102 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - input_mask: 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - segment_ids: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - masked_lm_labels: -1 -1 -1 -1 -1 2682 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1
03/12/2019 00:13:15 - INFO - dataloader - *** Example ***
03/12/2019 00:13:15 - INFO - dataloader - guid: train-4
03/12/2019 00:13:15 - INFO - dataloader - tokens: [CLS] great quality ! [SEP]
03/12/2019 00:13:15 - INFO - dataloader - init_ids: 101 2307 3737 999 102
03/12/2019 00:13:15 - INFO - dataloader - input_ids: 101 103 3737 999 102 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - input_mask: 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - segment_ids: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - masked_lm_labels: -1 2307 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1
03/12/2019 00:13:15 - INFO - dataloader - *** Example ***
03/12/2019 00:13:15 - INFO - dataloader - guid: train-5
03/12/2019 00:13:15 - INFO - dataloader - tokens: [CLS] i have gone to denny ' s later and had more cheer ##y people around me . [SEP]
03/12/2019 00:13:15 - INFO - dataloader - init_ids: 101 1045 2031 2908 2000 14465 1005 1055 2101 1998 2018 2062 15138 2100 2111 2105 2033 1012 102
03/12/2019 00:13:15 - INFO - dataloader - input_ids: 101 1045 2031 2908 2000 14465 1005 1055 2101 103 103 103 15138 103 2111 2105 2033 1012 102 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - input_mask: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - segment_ids: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
03/12/2019 00:13:15 - INFO - dataloader - masked_lm_labels: -1 -1 -1 -1 -1 -1 -1 -1 -1 1998 2018 2062 -1 2100 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1
03/12/2019 00:13:57 - INFO - dataloader - ***** Running training *****
03/12/2019 00:13:57 - INFO - dataloader - Num examples = 447223
03/12/2019 00:13:57 - INFO - dataloader - Batch size = 32
03/12/2019 00:13:57 - INFO - dataloader - Num steps = 139757
**********************************************************
Namespace(bert_model='/home/xgg/.pytorch_pretrained_bert/bert-base-uncased.tar.gz', data_dir='./processed_data_attention_based/yelp/', do_lower_case=True, do_train=True, eval_batch_size=8, gradient_accumulation_steps=1, learning_rate=2e-05, local_rank=-1, loss_scale=128, max_seq_length=32, no_cuda=False, num_train_epochs=10.0, optimize_on_cpu=False, output_dir='/tmp/yelp_output/', seed=42, task_name=None, train_batch_size=32, warmup_proportion=0.1)
03/12/2019 00:13:58 - INFO - pytorch_pretrained_bert.modeling - loading archive file /home/xgg/.pytorch_pretrained_bert/bert-base-uncased.tar.gz
03/12/2019 00:13:58 - INFO - pytorch_pretrained_bert.modeling - extracting archive file /home/xgg/.pytorch_pretrained_bert/bert-base-uncased.tar.gz to temp dir /tmp/tmpt4uwvsso
03/12/2019 00:14:01 - INFO - pytorch_pretrained_bert.modeling - Model config {
"attention_probs_dropout_prob": 0.1,
"hidden_act": "gelu",
"hidden_dropout_prob": 0.1,
"hidden_size": 768,
"initializer_range": 0.02,
"intermediate_size": 3072,
"max_position_embeddings": 512,
"num_attention_heads": 12,
"num_hidden_layers": 12,
"type_vocab_size": 2,
"vocab_size": 30522
}
03/12/2019 00:14:03 - INFO - pytorch_pretrained_bert.modeling - Weights from pretrained model not used in BertForMaskedLM: ['cls.seq_relationship.weight', 'cls.seq_relationship.bias']
Epoch: 0%| | 0/10 [00:00<?, ?it/s]avg_loss: 4.88016405582428
avg_loss: 4.6984915351867675
avg_loss: 4.455044717788696
avg_loss: 4.232588033676148
avg_loss: 4.209168267250061
avg_loss: 4.125122060775757
avg_loss: 3.746606297492981
avg_loss: 3.855332069396973
avg_loss: 3.6608036375045776
avg_loss: 3.4794873237609862
avg_loss: 3.5611400842666625
avg_loss: 3.302661294937134
avg_loss: 3.394572024345398
avg_loss: 3.387631683349609
avg_loss: 3.258156433105469
avg_loss: 3.2985280179977416
avg_loss: 3.3079639863967896
avg_loss: 3.205892071723938
avg_loss: 3.196837272644043
avg_loss: 3.0973183631896974
avg_loss: 3.1898420095443725
avg_loss: 3.067259488105774
avg_loss: 3.0070498323440553
avg_loss: 3.1761118841171263
avg_loss: 3.0338708925247193
avg_loss: 2.970087354183197
avg_loss: 3.040704650878906
avg_loss: 3.1360132598876955
avg_loss: 2.9772722363471984
avg_loss: 2.932211089134216
avg_loss: 2.899763855934143
avg_loss: 2.924162449836731
avg_loss: 2.9373402881622312
avg_loss: 2.8846318030357363
avg_loss: 2.8890233182907106
avg_loss: 2.92694895029068
avg_loss: 2.8815848064422607
avg_loss: 2.834694905281067
avg_loss: 2.8348430681228636
avg_loss: 2.8520753836631774
avg_loss: 2.9074486446380616
avg_loss: 2.7899228525161743
avg_loss: 2.8190498900413514
avg_loss: 2.77523841381073
avg_loss: 2.8971146726608277
avg_loss: 2.6840960717201234
avg_loss: 2.709867856502533
avg_loss: 2.750831651687622
avg_loss: 2.879984266757965
avg_loss: 2.7025121736526487
avg_loss: 2.6580095171928404
avg_loss: 2.712891421318054
avg_loss: 2.6212193751335144
avg_loss: 2.7073081302642823
avg_loss: 2.724839243888855
avg_loss: 2.7083555674552917
avg_loss: 2.6784539437294006
avg_loss: 2.659263038635254
avg_loss: 2.6723058724403383
avg_loss: 2.644746766090393
avg_loss: 2.6581489133834837
avg_loss: 2.6997070479393006
avg_loss: 2.645704050064087
avg_loss: 2.5458367037773133
avg_loss: 2.689613561630249
avg_loss: 2.5594299840927124
avg_loss: 2.6448590993881225
avg_loss: 2.561941456794739
avg_loss: 2.545992851257324
avg_loss: 2.5383735847473146
avg_loss: 2.6449956846237184
avg_loss: 2.569913856983185
avg_loss: 2.568808159828186
avg_loss: 2.5660448622703553
avg_loss: 2.5923266220092773
avg_loss: 2.574607768058777
avg_loss: 2.565587284564972
avg_loss: 2.599189667701721
avg_loss: 2.5602018666267394
avg_loss: 2.512506217956543
avg_loss: 2.4703863143920897
avg_loss: 2.494282920360565
avg_loss: 2.5352876377105713
avg_loss: 2.6364643740653992
avg_loss: 2.5691298770904543
avg_loss: 2.5588210010528565
avg_loss: 2.373652594089508
avg_loss: 2.458054847717285
avg_loss: 2.6515988302230835
avg_loss: 2.4761396074295043
avg_loss: 2.5148370122909545
avg_loss: 2.598599054813385
avg_loss: 2.415158293247223
avg_loss: 2.6175576043128967
avg_loss: 2.4061098742485045
avg_loss: 2.5275374341011045
avg_loss: 2.578612496852875
avg_loss: 2.4736163306236265
avg_loss: 2.5217376065254213
avg_loss: 2.4661928033828735
avg_loss: 2.4980598282814026
avg_loss: 2.5479179406166077
avg_loss: 2.4429174518585204
avg_loss: 2.4383540463447573
avg_loss: 2.4685201811790467
avg_loss: 2.465446150302887
avg_loss: 2.4588265228271484
avg_loss: 2.4320027589797975
avg_loss: 2.4521487975120544
avg_loss: 2.4817472887039185
avg_loss: 2.48146502494812
avg_loss: 2.4958518815040587
avg_loss: 2.4039692282676697
avg_loss: 2.461139621734619
avg_loss: 2.4889104890823366
avg_loss: 2.4227347373962402
avg_loss: 2.438558506965637
avg_loss: 2.538373517990112
avg_loss: 2.5194131112098694
avg_loss: 2.35799751996994
avg_loss: 2.2986817574501037
avg_loss: 2.4696590805053713
avg_loss: 2.3551507067680357
avg_loss: 2.3125578808784484
avg_loss: 2.3236043000221254
avg_loss: 2.473629066944122
avg_loss: 2.523537735939026
avg_loss: 2.347206702232361
avg_loss: 2.483402488231659
avg_loss: 2.314659261703491
avg_loss: 2.4293750429153445
avg_loss: 2.297415511608124
avg_loss: 2.4267200779914857
avg_loss: 2.2470176553726198
avg_loss: 2.39896279335022
avg_loss: 2.3797292518615722
avg_loss: 2.339791622161865
avg_loss: 2.3955618929862976
avg_loss: 2.410244035720825
avg_loss: 2.295628981590271
avg_loss: 2.3462533450126646
avg_loss: 2.327405366897583
avg_loss: 2.4081715631484983
avg_loss: 2.38372909784317
avg_loss: 2.3070783758163453
avg_loss: 2.315405344963074
avg_loss: 2.3302126789093016
avg_loss: 2.3912098693847654
avg_loss: 2.399410707950592
avg_loss: 2.4005026507377623
avg_loss: 2.386135928630829
avg_loss: 2.3987679529190062
avg_loss: 2.3339112615585327
avg_loss: 2.403260509967804
avg_loss: 2.3266223764419554
avg_loss: 2.3955002355575563
avg_loss: 2.4050703501701354
avg_loss: 2.3744394850730894
avg_loss: 2.430010118484497
avg_loss: 2.3921910429000857
avg_loss: 2.3810199666023255
avg_loss: 2.407580578327179
avg_loss: 2.341863389015198
avg_loss: 2.333704376220703
avg_loss: 2.352514319419861
avg_loss: 2.3762181210517883
avg_loss: 2.2432680463790895
avg_loss: 2.3708365392684936
avg_loss: 2.3924124383926393
avg_loss: 2.2521362996101377
avg_loss: 2.2792040634155275
avg_loss: 2.29509352684021
avg_loss: 2.3564504194259643
avg_loss: 2.11246311545372
avg_loss: 2.3480961966514586
avg_loss: 2.4229867815971375
avg_loss: 2.3660195755958555
avg_loss: 2.291697597503662
avg_loss: 2.3131322145462034
avg_loss: 2.286087396144867
avg_loss: 2.381036651134491
avg_loss: 2.3526020765304567
avg_loss: 2.409738714694977
avg_loss: 2.248151726722717
avg_loss: 2.439205300807953
avg_loss: 2.2558142566680908
avg_loss: 2.3297177362442016
avg_loss: 2.232541127204895
avg_loss: 2.349591336250305
avg_loss: 2.200279040336609
avg_loss: 2.3099862933158875
avg_loss: 2.273391604423523
avg_loss: 2.3291456961631773
avg_loss: 2.2607464575767517
avg_loss: 2.2639938688278196
avg_loss: 2.291778256893158
avg_loss: 2.3072378516197203
avg_loss: 2.2182756066322327
avg_loss: 2.285287435054779
avg_loss: 2.274091649055481
avg_loss: 2.382875108718872
avg_loss: 2.355284621715546
avg_loss: 2.289826874732971
avg_loss: 2.2933579683303833
avg_loss: 2.31420841217041
avg_loss: 2.2342517495155336
avg_loss: 2.218958203792572
avg_loss: 2.3116327786445616
avg_loss: 2.277682933807373
avg_loss: 2.258832726478577
avg_loss: 2.1917162775993346
avg_loss: 2.2265209317207337
avg_loss: 2.353377249240875
avg_loss: 2.3034614443778993
avg_loss: 2.2784738659858705
avg_loss: 2.318558077812195
avg_loss: 2.2756003546714783
avg_loss: 2.265463490486145
avg_loss: 2.2127432084083556
avg_loss: 2.3147967004776
avg_loss: 2.3003030586242676
avg_loss: 2.2564665627479554
avg_loss: 2.2260075426101684
avg_loss: 2.264634292125702
avg_loss: 2.193483278751373
avg_loss: 2.229279716014862
avg_loss: 2.2906769275665284
avg_loss: 2.1958377349376677
avg_loss: 2.2528810691833496
avg_loss: 2.2828475284576415
avg_loss: 2.3221759557724
avg_loss: 2.3238825154304505
avg_loss: 2.2941128277778624
avg_loss: 2.259045238494873
avg_loss: 2.2545866894721986
avg_loss: 2.1867921471595766
avg_loss: 2.306993451118469
avg_loss: 2.173955020904541
avg_loss: 2.238320767879486
avg_loss: 2.226007790565491
avg_loss: 2.327103252410889
avg_loss: 2.243364682197571
avg_loss: 2.1383968210220337
avg_loss: 2.2276017355918882
avg_loss: 2.194828131198883
avg_loss: 2.1828545045852663
avg_loss: 2.251677279472351
avg_loss: 2.2119764494895935
avg_loss: 2.154485242366791
avg_loss: 2.224479463100433
avg_loss: 2.2610128712654114
avg_loss: 2.088443579673767
avg_loss: 2.2637188911437987
avg_loss: 2.1858564043045043
avg_loss: 2.15172132730484
avg_loss: 2.213738601207733
avg_loss: 2.2156520962715147
avg_loss: 2.3283170461654663
avg_loss: 2.2315026688575745
avg_loss: 2.2508869433403014
avg_loss: 2.1815194702148437
avg_loss: 2.2834805965423586
avg_loss: 2.2999194359779356
avg_loss: 2.2453378772735597
avg_loss: 2.171478295326233
avg_loss: 2.1560603761672974
avg_loss: 2.2486592864990236
avg_loss: 2.1305075788497927
avg_loss: 2.29393146276474
avg_loss: 2.277539987564087
avg_loss: 2.0775099062919615
avg_loss: 2.137590765953064
avg_loss: 2.201895866394043
avg_loss: 2.2135879969596863
avg_loss: 2.1733967781066896
avg_loss: 2.185237424373627
avg_loss: 2.2990096950531007
avg_loss: 2.201726176738739
avg_loss: 2.155401473045349
Epoch: 10%|███████████████▋ | 1/10 [43:51<6:34:39, 2631.06s/it]avg_loss: 2.0265018224716185
avg_loss: 2.1117804312705992
avg_loss: 2.023546316623688
avg_loss: 2.070557701587677
avg_loss: 1.97964989900589
avg_loss: 2.088154556751251
avg_loss: 1.9820233583450317
avg_loss: 1.987215552330017
avg_loss: 1.9803769421577453
avg_loss: 2.014078094959259
avg_loss: 1.9685117721557617
avg_loss: 1.9771054553985596
avg_loss: 2.010862293243408
avg_loss: 2.00657879114151
avg_loss: 2.0411189126968385
avg_loss: 1.978959720134735
avg_loss: 1.9771296215057372
avg_loss: 1.9550275540351867
avg_loss: 2.005483784675598
avg_loss: 2.0122175788879395
avg_loss: 1.9282903695106506
avg_loss: 1.9858952283859252
avg_loss: 1.923118495941162
avg_loss: 1.8858853340148927
avg_loss: 2.021571060419083
avg_loss: 2.057600648403168
avg_loss: 2.049245681762695
avg_loss: 2.092614891529083
avg_loss: 1.993278648853302
avg_loss: 2.037365798950195
avg_loss: 2.051080672740936
avg_loss: 2.0222977590560913
avg_loss: 1.95311429977417
avg_loss: 2.002172782421112
avg_loss: 2.01782776594162
avg_loss: 2.111841015815735
avg_loss: 2.127430624961853
avg_loss: 1.9622267365455628
avg_loss: 2.086571457386017
avg_loss: 2.0252651286125185
avg_loss: 1.960146164894104
avg_loss: 2.039909496307373
avg_loss: 1.9911382699012756
avg_loss: 1.9731755137443543
avg_loss: 1.9728700923919678
avg_loss: 2.0028345441818236
avg_loss: 1.9526494479179382
avg_loss: 2.0061545395851135
avg_loss: 2.052937250137329
avg_loss: 2.0327127361297608
avg_loss: 1.9284967017173766
avg_loss: 2.00730774641037
avg_loss: 2.01257039308548
avg_loss: 2.0567222738265993
avg_loss: 1.9899001216888428
avg_loss: 1.9627556908130646
avg_loss: 2.0574989342689514
avg_loss: 2.067418251037598
avg_loss: 2.004835886955261
avg_loss: 1.950976278781891
avg_loss: 2.0302602362632753
avg_loss: 1.9323651814460754
avg_loss: 2.0428298044204714
avg_loss: 1.878586413860321
avg_loss: 1.963199257850647
avg_loss: 1.9700406503677368
avg_loss: 1.9729020690917969
avg_loss: 2.1417400860786437
avg_loss: 2.0318523335456846
avg_loss: 1.9822049713134766
avg_loss: 1.9143903064727783
avg_loss: 2.057860667705536
avg_loss: 2.0379560923576356
avg_loss: 1.9250972843170167
avg_loss: 1.9908880662918091
avg_loss: 1.952537682056427
avg_loss: 2.0070582842826843
avg_loss: 1.9357839512825012
avg_loss: 2.0379872119426725
avg_loss: 1.9711244583129883
avg_loss: 2.118856475353241
avg_loss: 1.9460450625419616
avg_loss: 2.03408433675766
avg_loss: 2.004560880661011
avg_loss: 2.0469127464294434
avg_loss: 1.9244916343688965
avg_loss: 1.96916898727417
avg_loss: 1.9805741500854492
avg_loss: 2.068382124900818
avg_loss: 1.9796332716941833
avg_loss: 2.049915566444397
avg_loss: 2.06075856924057
avg_loss: 1.9798969006538392
avg_loss: 1.9457200145721436
avg_loss: 1.9329581761360168
avg_loss: 2.0642755436897278
avg_loss: 1.9252749633789064
avg_loss: 1.9897660875320435
avg_loss: 1.9673710370063782
avg_loss: 1.933426992893219
avg_loss: 2.0143280696868895
avg_loss: 1.9758498978614807
avg_loss: 2.0100458455085755
avg_loss: 1.9804451298713683
avg_loss: 2.12182621717453
avg_loss: 1.9538592791557312
avg_loss: 1.900265974998474
avg_loss: 1.9324054551124572
avg_loss: 2.0469345927238463
avg_loss: 1.9111817789077759
avg_loss: 2.0381518244743346
avg_loss: 1.9837171840667724
avg_loss: 1.9821599483489991
avg_loss: 1.985900375843048
avg_loss: 1.9604382348060607
avg_loss: 2.0420620584487916
avg_loss: 1.9632129335403443
avg_loss: 1.9648467540740966
avg_loss: 2.005588881969452
avg_loss: 1.945275173187256
avg_loss: 2.0901358032226565
avg_loss: 2.101161231994629
avg_loss: 1.9548429036140442
avg_loss: 1.9346787595748902
avg_loss: 2.1665078830718993
avg_loss: 1.906431837081909
avg_loss: 1.9687856316566468
avg_loss: 1.9135258269309998
avg_loss: 1.9557911491394042
avg_loss: 2.011317720413208
avg_loss: 2.0872074484825136
avg_loss: 1.999658637046814
avg_loss: 1.967121067047119
avg_loss: 1.9511074137687683
avg_loss: 1.961824723482132
avg_loss: 1.8940170621871948
avg_loss: 1.9281394219398498
avg_loss: 1.8888150191307067
avg_loss: 1.9466920518875122
avg_loss: 2.0738569045066835
avg_loss: 2.052984001636505
avg_loss: 2.0494095039367677
avg_loss: 2.0198262453079225
avg_loss: 1.9406120228767394
avg_loss: 1.9529638719558715
avg_loss: 1.989797613620758
avg_loss: 2.0369172286987305
avg_loss: 1.9982016968727112
avg_loss: 1.9263085341453552
avg_loss: 2.0130109465122223
avg_loss: 1.946669716835022
avg_loss: 2.0188623523712157
avg_loss: 2.020418326854706
avg_loss: 1.9698140287399293
avg_loss: 1.979922173023224
avg_loss: 2.015847234725952
avg_loss: 1.9584411787986755
avg_loss: 1.9459382581710816
avg_loss: 1.884336621761322
avg_loss: 1.986366379261017
avg_loss: 1.927684519290924
avg_loss: 1.9513227820396424
avg_loss: 1.9714475393295288
avg_loss: 1.9672604823112487
avg_loss: 1.9917373657226562
avg_loss: 2.020494587421417
avg_loss: 1.9689541387557983
avg_loss: 1.9528528022766114
avg_loss: 1.9206907844543457
avg_loss: 1.8887692666053773
avg_loss: 1.9929780912399293
avg_loss: 2.0362762665748595
avg_loss: 2.072100143432617
avg_loss: 2.089734601974487
avg_loss: 1.950196053981781
avg_loss: 2.031334037780762
avg_loss: 2.0278673195838928
avg_loss: 1.9399677062034606
avg_loss: 2.0148680067062377
avg_loss: 1.8997267293930054
avg_loss: 1.899826431274414
avg_loss: 1.9563804864883423
avg_loss: 1.9276967525482178
avg_loss: 2.0250084519386293
avg_loss: 1.982971510887146
avg_loss: 1.904102280139923
avg_loss: 1.967037558555603
avg_loss: 1.9472809529304504
avg_loss: 1.9692459654808045
avg_loss: 1.8905973315238953
avg_loss: 1.9910960054397584
avg_loss: 1.9591800522804261
avg_loss: 1.9415224361419678
avg_loss: 2.007537262439728
avg_loss: 1.8712536811828613
avg_loss: 1.9750879859924317
avg_loss: 1.9286743211746216
avg_loss: 1.9731745934486389
avg_loss: 2.0116765213012697
avg_loss: 2.0044069600105288
avg_loss: 1.979413321018219
avg_loss: 1.9513316249847412
avg_loss: 1.9117861413955688
avg_loss: 1.8792844033241272
avg_loss: 1.9733729648590088
avg_loss: 1.8822334706783295
avg_loss: 2.084122722148895
avg_loss: 2.07710622549057
avg_loss: 1.8962678837776183
avg_loss: 1.9588131189346314
avg_loss: 1.9118129849433898
avg_loss: 2.023260843753815
avg_loss: 1.939205825328827
avg_loss: 1.9070798969268798
avg_loss: 1.930112988948822
avg_loss: 1.983624324798584
avg_loss: 2.0183752274513242
avg_loss: 2.0724340224266053
avg_loss: 1.8923404717445373
avg_loss: 2.0064689433574676
avg_loss: 1.9636912608146668
avg_loss: 1.930473154783249
avg_loss: 1.9354119110107422
avg_loss: 1.9765310049057008
avg_loss: 1.8534636354446412
avg_loss: 2.0112666964530943
avg_loss: 2.074378318786621
avg_loss: 1.95037109375
avg_loss: 1.88853271484375
avg_loss: 1.9330739784240722
avg_loss: 1.9884102058410644
avg_loss: 1.9342686986923219
avg_loss: 1.9255183339118958
avg_loss: 1.9546782088279724
avg_loss: 1.9256396079063416
avg_loss: 2.0825934314727785
avg_loss: 1.933988745212555
avg_loss: 2.0603622150421144
avg_loss: 1.9794936537742616
avg_loss: 1.9121494960784913
avg_loss: 1.9631288313865662
avg_loss: 1.9669189262390137
avg_loss: 1.97179931640625
avg_loss: 1.9053796672821044
avg_loss: 2.0385849404335024
avg_loss: 1.9188528895378112
avg_loss: 1.9806263971328735
avg_loss: 1.9542940640449524
avg_loss: 2.0049150681495664
avg_loss: 1.957160291671753
avg_loss: 2.013281674385071
avg_loss: 1.9553541493415834
avg_loss: 2.0289495968818665
avg_loss: 1.9723706984519958
avg_loss: 2.010410978794098
avg_loss: 1.9286040353775025
avg_loss: 1.969037573337555
avg_loss: 1.970126316547394
avg_loss: 1.9971751737594605
avg_loss: 1.9079260039329529
avg_loss: 1.9186833596229553
avg_loss: 1.8727039527893066
avg_loss: 1.86000675201416
avg_loss: 1.9767743611335755
avg_loss: 1.9740721225738525
avg_loss: 1.9931483578681946
avg_loss: 2.0325394582748415
avg_loss: 1.930847363471985
avg_loss: 1.9732119369506835
avg_loss: 1.854988567829132
avg_loss: 1.900266387462616
avg_loss: 1.9471381211280823
avg_loss: 1.99723646402359
avg_loss: 1.9282147073745728
avg_loss: 1.9192323541641236
avg_loss: 1.7977544701099395
avg_loss: 2.029882297515869
avg_loss: 2.065713789463043
avg_loss: 1.9557259929180146
Epoch: 20%|███████████████████████████████ | 2/10 [1:29:48<5:59:15, 2694.48s/it]avg_loss: 1.6166722464561463
avg_loss: 1.698397934436798
avg_loss: 1.7022340655326844
avg_loss: 1.5916106355190278
avg_loss: 1.6586023020744323
avg_loss: 1.7023480391502381
avg_loss: 1.6769006764888763
avg_loss: 1.7614821648597718
avg_loss: 1.59815713763237
avg_loss: 1.6356884455680847
avg_loss: 1.6313106751441955
avg_loss: 1.631155982017517
avg_loss: 1.605711452960968
avg_loss: 1.6638133573532103
avg_loss: 1.634447354078293
avg_loss: 1.614919296503067
avg_loss: 1.6041615974903107
avg_loss: 1.6469650506973266
avg_loss: 1.6882373905181884
avg_loss: 1.6927928698062897
avg_loss: 1.6726643419265748
avg_loss: 1.683733994960785
avg_loss: 1.6780744254589082
avg_loss: 1.7059584426879884
avg_loss: 1.6884924137592316
avg_loss: 1.6786364233493805
avg_loss: 1.707984344959259
avg_loss: 1.6737724792957307
avg_loss: 1.69200275182724
avg_loss: 1.5685738730430603
avg_loss: 1.629694652557373
avg_loss: 1.677038127183914
avg_loss: 1.6819454169273376
avg_loss: 1.5900154495239258
avg_loss: 1.7276310324668884
avg_loss: 1.6666019010543822
avg_loss: 1.6814672827720643
avg_loss: 1.736827983856201
avg_loss: 1.6188210904598237
avg_loss: 1.6441798448562621
avg_loss: 1.7084555292129517
avg_loss: 1.6956984758377076
avg_loss: 1.6498797488212587
avg_loss: 1.6952089297771453
avg_loss: 1.6512949204444884
avg_loss: 1.6692802274227143
avg_loss: 1.6854390025138855
avg_loss: 1.6061180329322815
avg_loss: 1.6390836358070373
avg_loss: 1.6756747245788575
avg_loss: 1.6737253260612488
avg_loss: 1.5762019288539886
avg_loss: 1.677259123325348
avg_loss: 1.7087623500823974
avg_loss: 1.659481999874115
avg_loss: 1.6072599744796754
avg_loss: 1.7070421648025513
avg_loss: 1.6312653636932373
avg_loss: 1.686373507976532
avg_loss: 1.610967069864273
avg_loss: 1.6428070378303528
avg_loss: 1.6985638976097106
avg_loss: 1.6548848676681518
avg_loss: 1.707020629644394
avg_loss: 1.7203947758674623
avg_loss: 1.6927579307556153
avg_loss: 1.7451810932159424
avg_loss: 1.7313415956497193
avg_loss: 1.6082423150539398
avg_loss: 1.6426222658157348
avg_loss: 1.6111437153816224
avg_loss: 1.6718125021457673
avg_loss: 1.6851843655109406
avg_loss: 1.6616750979423522
avg_loss: 1.7026547980308533
avg_loss: 1.6897861576080322
avg_loss: 1.6610237073898315
avg_loss: 1.7368180084228515
avg_loss: 1.6947770833969116
avg_loss: 1.6256436932086944
avg_loss: 1.746125259399414
avg_loss: 1.6945570015907288
avg_loss: 1.6816218209266662
avg_loss: 1.6353836858272552
avg_loss: 1.654011971950531
avg_loss: 1.6114515769481659
avg_loss: 1.6822823667526245
avg_loss: 1.7751840686798095
avg_loss: 1.7574969792366029
avg_loss: 1.6980915427207948
avg_loss: 1.6567215490341187
avg_loss: 1.6690976107120514
avg_loss: 1.650234167575836
avg_loss: 1.6445735454559327
avg_loss: 1.7414139676094056
avg_loss: 1.7154278874397277
avg_loss: 1.6285105156898498
avg_loss: 1.6011357474327088
avg_loss: 1.6866929841041565
avg_loss: 1.7209581804275513
avg_loss: 1.6131680309772491
avg_loss: 1.7090762162208557
avg_loss: 1.6666471672058105
avg_loss: 1.6675295639038086
avg_loss: 1.665301673412323
avg_loss: 1.6090650725364686
avg_loss: 1.6562864589691162
avg_loss: 1.6275192725658416
avg_loss: 1.7126894760131837
avg_loss: 1.6673758471012115
avg_loss: 1.6986078071594237
avg_loss: 1.6107923185825348
avg_loss: 1.5728082621097565
avg_loss: 1.6141751074790955
avg_loss: 1.680758180618286
avg_loss: 1.7798647904396057
avg_loss: 1.5814218616485596
avg_loss: 1.588696790933609
avg_loss: 1.7025853824615478
avg_loss: 1.7076729702949525
avg_loss: 1.733876918554306
avg_loss: 1.662280547618866
avg_loss: 1.6118770229816437
avg_loss: 1.7434826946258546
avg_loss: 1.6993596386909484
avg_loss: 1.6963952112197875
avg_loss: 1.665301662683487
avg_loss: 1.724515496492386
avg_loss: 1.7242301666736604
avg_loss: 1.6549077892303468
avg_loss: 1.683281080722809
avg_loss: 1.684141583442688
avg_loss: 1.6811969757080079
avg_loss: 1.5499451994895934
avg_loss: 1.6870464491844177
avg_loss: 1.6509528315067292
avg_loss: 1.7174939584732056
avg_loss: 1.6989298212528228
avg_loss: 1.7227105283737183
avg_loss: 1.662345609664917
avg_loss: 1.688260760307312
avg_loss: 1.6187527966499329
avg_loss: 1.701993579864502
avg_loss: 1.6733755588531494
avg_loss: 1.7387003803253174
avg_loss: 1.700653862953186
avg_loss: 1.6698261785507202
avg_loss: 1.601088958978653
avg_loss: 1.6430214202404023
avg_loss: 1.6831252789497375
avg_loss: 1.7637559819221496
avg_loss: 1.6906466317176818
avg_loss: 1.6772595036029816
avg_loss: 1.6717008018493653
avg_loss: 1.6293358778953553
avg_loss: 1.639628894329071
avg_loss: 1.5970250022411348
avg_loss: 1.7130701303482057
avg_loss: 1.7437258291244506
avg_loss: 1.6642929029464721
avg_loss: 1.6069499158859253
avg_loss: 1.633430597782135
avg_loss: 1.6804845559597015
avg_loss: 1.6397378289699553
avg_loss: 1.6608455455303193
avg_loss: 1.7421035599708556
avg_loss: 1.7010795152187348
avg_loss: 1.6915214133262635
avg_loss: 1.5797346365451812
avg_loss: 1.65858567237854
avg_loss: 1.6876398229599
avg_loss: 1.7236139571666718
avg_loss: 1.6526824927330017
avg_loss: 1.765064809322357
avg_loss: 1.6657052993774415
avg_loss: 1.6971662950515747
avg_loss: 1.6309523689746857
avg_loss: 1.668763642311096
avg_loss: 1.6227803921699524
avg_loss: 1.6280576539039613
avg_loss: 1.7183505856990815
avg_loss: 1.7431724977493286
avg_loss: 1.6372867584228517
avg_loss: 1.673446090221405
avg_loss: 1.6379800832271576
avg_loss: 1.6407055377960205
avg_loss: 1.6495262384414673
avg_loss: 1.6273897671699524
avg_loss: 1.7676248252391815
avg_loss: 1.649792971611023
avg_loss: 1.6711920893192291
avg_loss: 1.6774236929416657
avg_loss: 1.6620184564590454
avg_loss: 1.6700373816490173
avg_loss: 1.6100102686882019
avg_loss: 1.8086199140548707
avg_loss: 1.7103990292549134
avg_loss: 1.6455730974674225
avg_loss: 1.6522150719165802
avg_loss: 1.73649986743927
avg_loss: 1.7559530973434447
avg_loss: 1.6861206960678101
avg_loss: 1.7036721992492676
avg_loss: 1.6307150077819825
avg_loss: 1.7295484304428101
avg_loss: 1.664429123401642
avg_loss: 1.7404751300811767
avg_loss: 1.7346085107326508
avg_loss: 1.6817397093772888
avg_loss: 1.6938081860542298
avg_loss: 1.6769787430763246
avg_loss: 1.6598571562767028
avg_loss: 1.6472611916065216
avg_loss: 1.7294378399848938
avg_loss: 1.7044724941253662
avg_loss: 1.6519246184825898
avg_loss: 1.7344906401634217
avg_loss: 1.7564261221885682
avg_loss: 1.6985258913040162
avg_loss: 1.7576136302947998
avg_loss: 1.6666496896743774
avg_loss: 1.7962824869155884
avg_loss: 1.7361829388141632
avg_loss: 1.744488229751587
avg_loss: 1.651780718564987
avg_loss: 1.635430519580841
avg_loss: 1.641900738477707
avg_loss: 1.7081332802772522
avg_loss: 1.6617987203598021
avg_loss: 1.7594717311859132
avg_loss: 1.6969536805152894
avg_loss: 1.6625638806819916
avg_loss: 1.6986896181106568
avg_loss: 1.7218355917930603
avg_loss: 1.6825408625602722
avg_loss: 1.660248568058014
avg_loss: 1.6474772226810455
avg_loss: 1.735745313167572
avg_loss: 1.7484753000736237
avg_loss: 1.6894137263298035
avg_loss: 1.620346293449402
avg_loss: 1.6859989476203918
avg_loss: 1.6776449930667878
avg_loss: 1.750425078868866
avg_loss: 1.6869032979011536
avg_loss: 1.639254310131073
avg_loss: 1.666985321044922
avg_loss: 1.7374770188331603
avg_loss: 1.6996556329727173
avg_loss: 1.6629265785217284
avg_loss: 1.6540355849266053
avg_loss: 1.623516972064972
avg_loss: 1.6817984461784363
avg_loss: 1.6762748348712921
avg_loss: 1.689003553390503
avg_loss: 1.7382801377773285
avg_loss: 1.6809985613822938
avg_loss: 1.658299721479416
avg_loss: 1.6377972531318665
avg_loss: 1.6741950070858003
avg_loss: 1.6116339886188507
avg_loss: 1.6721265339851379
avg_loss: 1.6379854893684387
avg_loss: 1.7601490354537963
avg_loss: 1.7734714293479918
avg_loss: 1.6731226825714112
avg_loss: 1.6280170011520385
avg_loss: 1.707734887599945
avg_loss: 1.6824554300308228
avg_loss: 1.7205689120292664
avg_loss: 1.6843465220928193
avg_loss: 1.6939293777942657
avg_loss: 1.6963631582260132
avg_loss: 1.7255889368057251
avg_loss: 1.6610391736030579
avg_loss: 1.6738164269924163
avg_loss: 1.667240216732025
avg_loss: 1.6076856863498687
avg_loss: 1.6688603937625885
Epoch: 30%|██████████████████████████████████████████████▌ | 3/10 [2:15:32<5:16:16, 2710.91s/it]avg_loss: 1.4349126780033112
avg_loss: 1.403785389661789
avg_loss: 1.4351317620277404
avg_loss: 1.364872077703476
avg_loss: 1.5063552939891816
avg_loss: 1.4007451283931731
avg_loss: 1.4031326293945312
avg_loss: 1.416608830690384
avg_loss: 1.4347824442386627
avg_loss: 1.4289329612255097
avg_loss: 1.4156325602531432
avg_loss: 1.2809590315818786
avg_loss: 1.4343755042552948
avg_loss: 1.4319847416877747
avg_loss: 1.359183861017227
avg_loss: 1.4098418366909027
avg_loss: 1.4017302453517915
avg_loss: 1.364560616016388
avg_loss: 1.4144288146495818
avg_loss: 1.3885286450386047
avg_loss: 1.3561601412296296
avg_loss: 1.4732103097438811
avg_loss: 1.4278240752220155
avg_loss: 1.4669277060031891
avg_loss: 1.469710749387741
avg_loss: 1.3952922415733338
avg_loss: 1.3875789999961854
avg_loss: 1.440644749403
avg_loss: 1.4474097442626954
avg_loss: 1.3589736366271972
avg_loss: 1.4323835706710815
avg_loss: 1.3881747233867645
avg_loss: 1.4399765276908874
avg_loss: 1.3981423234939576
avg_loss: 1.3906060552597046
avg_loss: 1.4329310023784638
avg_loss: 1.4728052759170531
avg_loss: 1.4447337758541108
avg_loss: 1.3738035237789155
avg_loss: 1.3833172118663788
avg_loss: 1.5165860044956208
avg_loss: 1.382006254196167
avg_loss: 1.3974149680137635
avg_loss: 1.4344291520118713
avg_loss: 1.416109757423401
avg_loss: 1.4265417861938476
avg_loss: 1.4404889488220214
avg_loss: 1.3379624664783478
avg_loss: 1.4018743073940276
avg_loss: 1.3179018926620483
avg_loss: 1.4014608299732207
avg_loss: 1.450179626941681
avg_loss: 1.4580644190311431
avg_loss: 1.3984512460231782
avg_loss: 1.4650330030918122
avg_loss: 1.3678738462924958
avg_loss: 1.3816553902626039
avg_loss: 1.358542412519455
avg_loss: 1.4796532154083253
avg_loss: 1.4506742393970489
avg_loss: 1.496087510585785
avg_loss: 1.5075672698020934
avg_loss: 1.5250306499004365
avg_loss: 1.479354442358017
avg_loss: 1.4836246263980866
avg_loss: 1.474120445251465
avg_loss: 1.4937702083587647
avg_loss: 1.48208003282547
avg_loss: 1.4969591903686523
avg_loss: 1.4252868974208832
avg_loss: 1.447055767774582
avg_loss: 1.39626016497612
avg_loss: 1.4651009798049928
avg_loss: 1.4074108028411865
avg_loss: 1.4800568878650666
avg_loss: 1.4354050135612488
avg_loss: 1.3798717629909516
avg_loss: 1.4407391023635865
avg_loss: 1.4312043952941895
avg_loss: 1.4492977631092072
avg_loss: 1.4357496082782746
avg_loss: 1.3666301274299621
avg_loss: 1.431889922618866
avg_loss: 1.4296075928211212
avg_loss: 1.3970850682258606
avg_loss: 1.4654777729511261
avg_loss: 1.4594485354423523
avg_loss: 1.428851455450058
avg_loss: 1.45061030626297
avg_loss: 1.4411813807487488
avg_loss: 1.3955733013153075
avg_loss: 1.4784996151924132
avg_loss: 1.3895893132686614
avg_loss: 1.4818405055999755