Hugging Face's logo

azholder
/
multi_label_news_tagger

Text Classification
Safetensors
English
bert
news
journalism
multi-label
Model card Files
xet
Community
azholder commited on
Commit
a2ed5ef
·
verified ·
1 Parent(s): 0abd00a

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. checkpoint-1125/config.json +2584 -0
  2. checkpoint-1125/model.safetensors +3 -0
  3. checkpoint-1125/optimizer.pt +3 -0
  4. checkpoint-1125/rng_state.pth +3 -0
  5. checkpoint-1125/scheduler.pt +3 -0
  6. checkpoint-1125/special_tokens_map.json +7 -0
  7. checkpoint-1125/tokenizer.json +0 -0
  8. checkpoint-1125/tokenizer_config.json +56 -0
  9. checkpoint-1125/trainer_state.json +199 -0
  10. checkpoint-1125/training_args.bin +3 -0
  11. checkpoint-1125/vocab.txt +0 -0
  12. checkpoint-2250/config.json +2584 -0
  13. checkpoint-2250/model.safetensors +3 -0
  14. checkpoint-2250/optimizer.pt +3 -0
  15. checkpoint-2250/rng_state.pth +3 -0
  16. checkpoint-2250/scheduler.pt +3 -0
  17. checkpoint-2250/special_tokens_map.json +7 -0
  18. checkpoint-2250/tokenizer.json +0 -0
  19. checkpoint-2250/tokenizer_config.json +56 -0
  20. checkpoint-2250/trainer_state.json +371 -0
  21. checkpoint-2250/training_args.bin +3 -0
  22. checkpoint-2250/vocab.txt +0 -0
  23. checkpoint-30915/config.json +2584 -0
  24. checkpoint-30915/model.safetensors +3 -0
  25. checkpoint-30915/optimizer.pt +3 -0
  26. checkpoint-30915/rng_state.pth +3 -0
  27. checkpoint-30915/scheduler.pt +3 -0
  28. checkpoint-30915/special_tokens_map.json +7 -0
  29. checkpoint-30915/tokenizer.json +0 -0
  30. checkpoint-30915/tokenizer_config.json +56 -0
  31. checkpoint-30915/trainer_state.json +0 -0
  32. checkpoint-30915/training_args.bin +3 -0
  33. checkpoint-30915/vocab.txt +0 -0
  34. checkpoint-3375/config.json +2584 -0
  35. checkpoint-3375/model.safetensors +3 -0
  36. checkpoint-3375/optimizer.pt +3 -0
  37. checkpoint-3375/rng_state.pth +3 -0
  38. checkpoint-3375/scheduler.pt +3 -0
  39. checkpoint-3375/special_tokens_map.json +7 -0
  40. checkpoint-3375/tokenizer.json +0 -0
  41. checkpoint-3375/tokenizer_config.json +56 -0
  42. checkpoint-3375/trainer_state.json +536 -0
  43. checkpoint-3375/training_args.bin +3 -0
  44. checkpoint-3375/vocab.txt +0 -0
  45. checkpoint-61830/config.json +2584 -0
  46. checkpoint-61830/model.safetensors +3 -0
  47. checkpoint-61830/optimizer.pt +3 -0
  48. checkpoint-61830/rng_state.pth +3 -0
  49. checkpoint-61830/scheduler.pt +3 -0
  50. checkpoint-61830/special_tokens_map.json +7 -0
checkpoint-1125/config.json ADDED
@@ -0,0 +1,2584 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertForSequenceClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "id2label": {
12
+ "0": "1",
13
+ "1": "10",
14
+ "2": "100",
15
+ "3": "1003",
16
+ "4": "1004",
17
+ "5": "1005",
18
+ "6": "1006",
19
+ "7": "1007",
20
+ "8": "1008",
21
+ "9": "1009",
22
+ "10": "101",
23
+ "11": "1010",
24
+ "12": "1011",
25
+ "13": "1012",
26
+ "14": "1013",
27
+ "15": "1014",
28
+ "16": "1017",
29
+ "17": "1018",
30
+ "18": "1019",
31
+ "19": "102",
32
+ "20": "1020",
33
+ "21": "1021",
34
+ "22": "1022",
35
+ "23": "1023",
36
+ "24": "103",
37
+ "25": "1034",
38
+ "26": "1035",
39
+ "27": "104",
40
+ "28": "1040",
41
+ "29": "1043",
42
+ "30": "1046",
43
+ "31": "1047",
44
+ "32": "1048",
45
+ "33": "105",
46
+ "34": "1050",
47
+ "35": "1051",
48
+ "36": "1052",
49
+ "37": "1053",
50
+ "38": "1054",
51
+ "39": "1055",
52
+ "40": "1056",
53
+ "41": "1058",
54
+ "42": "1059",
55
+ "43": "1060",
56
+ "44": "1062",
57
+ "45": "107",
58
+ "46": "1071",
59
+ "47": "1073",
60
+ "48": "108",
61
+ "49": "1084",
62
+ "50": "1086",
63
+ "51": "1097",
64
+ "52": "1099",
65
+ "53": "11",
66
+ "54": "110",
67
+ "55": "1100",
68
+ "56": "1106",
69
+ "57": "1147",
70
+ "58": "1148",
71
+ "59": "1149",
72
+ "60": "1150",
73
+ "61": "1151",
74
+ "62": "1152",
75
+ "63": "1154",
76
+ "64": "1156",
77
+ "65": "1157",
78
+ "66": "1158",
79
+ "67": "1160",
80
+ "68": "1161",
81
+ "69": "1162",
82
+ "70": "1166",
83
+ "71": "1167",
84
+ "72": "1169",
85
+ "73": "1170",
86
+ "74": "1171",
87
+ "75": "1172",
88
+ "76": "1173",
89
+ "77": "1174",
90
+ "78": "1175",
91
+ "79": "1177",
92
+ "80": "1178",
93
+ "81": "1179",
94
+ "82": "118",
95
+ "83": "1180",
96
+ "84": "1181",
97
+ "85": "1184",
98
+ "86": "1185",
99
+ "87": "1186",
100
+ "88": "1187",
101
+ "89": "1188",
102
+ "90": "1189",
103
+ "91": "119",
104
+ "92": "1190",
105
+ "93": "1191",
106
+ "94": "1192",
107
+ "95": "1193",
108
+ "96": "1195",
109
+ "97": "1196",
110
+ "98": "1198",
111
+ "99": "1199",
112
+ "100": "12",
113
+ "101": "120",
114
+ "102": "1201",
115
+ "103": "1202",
116
+ "104": "1203",
117
+ "105": "1204",
118
+ "106": "1205",
119
+ "107": "1206",
120
+ "108": "1207",
121
+ "109": "1208",
122
+ "110": "121",
123
+ "111": "1210",
124
+ "112": "1211",
125
+ "113": "1212",
126
+ "114": "1213",
127
+ "115": "1217",
128
+ "116": "1218",
129
+ "117": "122",
130
+ "118": "1222",
131
+ "119": "1223",
132
+ "120": "1224",
133
+ "121": "1225",
134
+ "122": "1226",
135
+ "123": "1229",
136
+ "124": "123",
137
+ "125": "1230",
138
+ "126": "1231",
139
+ "127": "1232",
140
+ "128": "1233",
141
+ "129": "1234",
142
+ "130": "1235",
143
+ "131": "1236",
144
+ "132": "1238",
145
+ "133": "1239",
146
+ "134": "124",
147
+ "135": "1240",
148
+ "136": "1241",
149
+ "137": "1242",
150
+ "138": "1243",
151
+ "139": "1244",
152
+ "140": "1245",
153
+ "141": "1246",
154
+ "142": "1247",
155
+ "143": "1248",
156
+ "144": "1249",
157
+ "145": "125",
158
+ "146": "1250",
159
+ "147": "1251",
160
+ "148": "1252",
161
+ "149": "1253",
162
+ "150": "1256",
163
+ "151": "1257",
164
+ "152": "1258",
165
+ "153": "1259",
166
+ "154": "126",
167
+ "155": "1260",
168
+ "156": "1261",
169
+ "157": "1262",
170
+ "158": "1263",
171
+ "159": "1264",
172
+ "160": "1266",
173
+ "161": "1267",
174
+ "162": "1268",
175
+ "163": "1269",
176
+ "164": "127",
177
+ "165": "1270",
178
+ "166": "1271",
179
+ "167": "1272",
180
+ "168": "1273",
181
+ "169": "1274",
182
+ "170": "1275",
183
+ "171": "1276",
184
+ "172": "1277",
185
+ "173": "1278",
186
+ "174": "1279",
187
+ "175": "128",
188
+ "176": "1280",
189
+ "177": "1281",
190
+ "178": "1282",
191
+ "179": "1283",
192
+ "180": "1284",
193
+ "181": "1285",
194
+ "182": "1287",
195
+ "183": "1288",
196
+ "184": "1289",
197
+ "185": "1290",
198
+ "186": "1291",
199
+ "187": "1292",
200
+ "188": "1293",
201
+ "189": "1294",
202
+ "190": "1295",
203
+ "191": "1296",
204
+ "192": "1297",
205
+ "193": "1298",
206
+ "194": "1299",
207
+ "195": "13",
208
+ "196": "1300",
209
+ "197": "1301",
210
+ "198": "1302",
211
+ "199": "1303",
212
+ "200": "1304",
213
+ "201": "1305",
214
+ "202": "1306",
215
+ "203": "1307",
216
+ "204": "1308",
217
+ "205": "1309",
218
+ "206": "1310",
219
+ "207": "1311",
220
+ "208": "1312",
221
+ "209": "1313",
222
+ "210": "1314",
223
+ "211": "1315",
224
+ "212": "1316",
225
+ "213": "1317",
226
+ "214": "1318",
227
+ "215": "1319",
228
+ "216": "1320",
229
+ "217": "1321",
230
+ "218": "1322",
231
+ "219": "1323",
232
+ "220": "1324",
233
+ "221": "1325",
234
+ "222": "1326",
235
+ "223": "1327",
236
+ "224": "1328",
237
+ "225": "1329",
238
+ "226": "133",
239
+ "227": "1330",
240
+ "228": "1331",
241
+ "229": "1333",
242
+ "230": "1334",
243
+ "231": "1336",
244
+ "232": "1340",
245
+ "233": "1341",
246
+ "234": "1342",
247
+ "235": "1343",
248
+ "236": "1346",
249
+ "237": "135",
250
+ "238": "1350",
251
+ "239": "1351",
252
+ "240": "1357",
253
+ "241": "1359",
254
+ "242": "136",
255
+ "243": "1361",
256
+ "244": "1362",
257
+ "245": "1363",
258
+ "246": "1364",
259
+ "247": "1365",
260
+ "248": "1367",
261
+ "249": "1368",
262
+ "250": "1369",
263
+ "251": "137",
264
+ "252": "1370",
265
+ "253": "1371",
266
+ "254": "1372",
267
+ "255": "1373",
268
+ "256": "1374",
269
+ "257": "1376",
270
+ "258": "1377",
271
+ "259": "1378",
272
+ "260": "1379",
273
+ "261": "138",
274
+ "262": "1380",
275
+ "263": "1382",
276
+ "264": "1383",
277
+ "265": "1384",
278
+ "266": "1385",
279
+ "267": "1386",
280
+ "268": "1387",
281
+ "269": "1388",
282
+ "270": "1389",
283
+ "271": "139",
284
+ "272": "1391",
285
+ "273": "1396",
286
+ "274": "1397",
287
+ "275": "1398",
288
+ "276": "1399",
289
+ "277": "14",
290
+ "278": "140",
291
+ "279": "1400",
292
+ "280": "1401",
293
+ "281": "1402",
294
+ "282": "1403",
295
+ "283": "141",
296
+ "284": "1413",
297
+ "285": "1415",
298
+ "286": "1416",
299
+ "287": "1417",
300
+ "288": "1419",
301
+ "289": "142",
302
+ "290": "1420",
303
+ "291": "1421",
304
+ "292": "1422",
305
+ "293": "1423",
306
+ "294": "1425",
307
+ "295": "1426",
308
+ "296": "1427",
309
+ "297": "1428",
310
+ "298": "1429",
311
+ "299": "143",
312
+ "300": "1430",
313
+ "301": "1431",
314
+ "302": "1432",
315
+ "303": "1433",
316
+ "304": "1438",
317
+ "305": "1439",
318
+ "306": "144",
319
+ "307": "1441",
320
+ "308": "1443",
321
+ "309": "1444",
322
+ "310": "1445",
323
+ "311": "1446",
324
+ "312": "1447",
325
+ "313": "1448",
326
+ "314": "1449",
327
+ "315": "145",
328
+ "316": "1450",
329
+ "317": "1451",
330
+ "318": "1452",
331
+ "319": "1453",
332
+ "320": "1454",
333
+ "321": "1455",
334
+ "322": "1456",
335
+ "323": "1457",
336
+ "324": "1458",
337
+ "325": "1459",
338
+ "326": "146",
339
+ "327": "1460",
340
+ "328": "1461",
341
+ "329": "1462",
342
+ "330": "1463",
343
+ "331": "1464",
344
+ "332": "1465",
345
+ "333": "1466",
346
+ "334": "1467",
347
+ "335": "1468",
348
+ "336": "1469",
349
+ "337": "147",
350
+ "338": "1470",
351
+ "339": "1471",
352
+ "340": "1473",
353
+ "341": "1474",
354
+ "342": "1475",
355
+ "343": "1476",
356
+ "344": "1477",
357
+ "345": "1478",
358
+ "346": "1479",
359
+ "347": "1480",
360
+ "348": "1481",
361
+ "349": "1482",
362
+ "350": "1483",
363
+ "351": "1484",
364
+ "352": "1485",
365
+ "353": "1486",
366
+ "354": "1487",
367
+ "355": "1488",
368
+ "356": "1489",
369
+ "357": "1490",
370
+ "358": "1491",
371
+ "359": "1492",
372
+ "360": "1493",
373
+ "361": "1494",
374
+ "362": "1495",
375
+ "363": "1496",
376
+ "364": "1497",
377
+ "365": "1498",
378
+ "366": "1499",
379
+ "367": "15",
380
+ "368": "1500",
381
+ "369": "1501",
382
+ "370": "1502",
383
+ "371": "1507",
384
+ "372": "1509",
385
+ "373": "1510",
386
+ "374": "1511",
387
+ "375": "1512",
388
+ "376": "1513",
389
+ "377": "1514",
390
+ "378": "1515",
391
+ "379": "1516",
392
+ "380": "1517",
393
+ "381": "1518",
394
+ "382": "1519",
395
+ "383": "152",
396
+ "384": "1520",
397
+ "385": "1521",
398
+ "386": "1522",
399
+ "387": "1523",
400
+ "388": "1524",
401
+ "389": "1525",
402
+ "390": "1526",
403
+ "391": "1527",
404
+ "392": "1528",
405
+ "393": "1529",
406
+ "394": "153",
407
+ "395": "1530",
408
+ "396": "1531",
409
+ "397": "1532",
410
+ "398": "1533",
411
+ "399": "1534",
412
+ "400": "1535",
413
+ "401": "1536",
414
+ "402": "1537",
415
+ "403": "1538",
416
+ "404": "1539",
417
+ "405": "154",
418
+ "406": "1540",
419
+ "407": "1541",
420
+ "408": "1542",
421
+ "409": "1543",
422
+ "410": "1544",
423
+ "411": "1545",
424
+ "412": "1546",
425
+ "413": "1547",
426
+ "414": "1548",
427
+ "415": "1549",
428
+ "416": "155",
429
+ "417": "1550",
430
+ "418": "1551",
431
+ "419": "1552",
432
+ "420": "1553",
433
+ "421": "1554",
434
+ "422": "1555",
435
+ "423": "1556",
436
+ "424": "1557",
437
+ "425": "1558",
438
+ "426": "1559",
439
+ "427": "1560",
440
+ "428": "1561",
441
+ "429": "1562",
442
+ "430": "1563",
443
+ "431": "1564",
444
+ "432": "1565",
445
+ "433": "1566",
446
+ "434": "1567",
447
+ "435": "1568",
448
+ "436": "1569",
449
+ "437": "157",
450
+ "438": "1570",
451
+ "439": "1571",
452
+ "440": "1572",
453
+ "441": "1573",
454
+ "442": "1574",
455
+ "443": "1575",
456
+ "444": "1576",
457
+ "445": "1577",
458
+ "446": "1578",
459
+ "447": "1579",
460
+ "448": "158",
461
+ "449": "1580",
462
+ "450": "1581",
463
+ "451": "1582",
464
+ "452": "1583",
465
+ "453": "1584",
466
+ "454": "1585",
467
+ "455": "1586",
468
+ "456": "159",
469
+ "457": "160",
470
+ "458": "162",
471
+ "459": "163",
472
+ "460": "164",
473
+ "461": "165",
474
+ "462": "166",
475
+ "463": "167",
476
+ "464": "168",
477
+ "465": "169",
478
+ "466": "17",
479
+ "467": "170",
480
+ "468": "171",
481
+ "469": "172",
482
+ "470": "173",
483
+ "471": "174",
484
+ "472": "175",
485
+ "473": "177",
486
+ "474": "178",
487
+ "475": "179",
488
+ "476": "18",
489
+ "477": "180",
490
+ "478": "181",
491
+ "479": "182",
492
+ "480": "19",
493
+ "481": "192",
494
+ "482": "193",
495
+ "483": "194",
496
+ "484": "195",
497
+ "485": "197",
498
+ "486": "199",
499
+ "487": "20",
500
+ "488": "200",
501
+ "489": "202",
502
+ "490": "203",
503
+ "491": "204",
504
+ "492": "205",
505
+ "493": "206",
506
+ "494": "207",
507
+ "495": "208",
508
+ "496": "209",
509
+ "497": "210",
510
+ "498": "211",
511
+ "499": "212",
512
+ "500": "213",
513
+ "501": "214",
514
+ "502": "215",
515
+ "503": "216",
516
+ "504": "217",
517
+ "505": "218",
518
+ "506": "219",
519
+ "507": "22",
520
+ "508": "220",
521
+ "509": "221",
522
+ "510": "222",
523
+ "511": "223",
524
+ "512": "224",
525
+ "513": "225",
526
+ "514": "226",
527
+ "515": "227",
528
+ "516": "229",
529
+ "517": "23",
530
+ "518": "230",
531
+ "519": "231",
532
+ "520": "232",
533
+ "521": "233",
534
+ "522": "234",
535
+ "523": "236",
536
+ "524": "237",
537
+ "525": "238",
538
+ "526": "239",
539
+ "527": "24",
540
+ "528": "240",
541
+ "529": "241",
542
+ "530": "242",
543
+ "531": "243",
544
+ "532": "244",
545
+ "533": "245",
546
+ "534": "246",
547
+ "535": "247",
548
+ "536": "248",
549
+ "537": "249",
550
+ "538": "25",
551
+ "539": "250",
552
+ "540": "251",
553
+ "541": "252",
554
+ "542": "253",
555
+ "543": "254",
556
+ "544": "255",
557
+ "545": "256",
558
+ "546": "257",
559
+ "547": "259",
560
+ "548": "26",
561
+ "549": "260",
562
+ "550": "261",
563
+ "551": "262",
564
+ "552": "27",
565
+ "553": "28",
566
+ "554": "288",
567
+ "555": "289",
568
+ "556": "29",
569
+ "557": "290",
570
+ "558": "291",
571
+ "559": "292",
572
+ "560": "293",
573
+ "561": "294",
574
+ "562": "295",
575
+ "563": "296",
576
+ "564": "297",
577
+ "565": "298",
578
+ "566": "30",
579
+ "567": "300",
580
+ "568": "301",
581
+ "569": "302",
582
+ "570": "303",
583
+ "571": "304",
584
+ "572": "306",
585
+ "573": "307",
586
+ "574": "308",
587
+ "575": "309",
588
+ "576": "31",
589
+ "577": "310",
590
+ "578": "311",
591
+ "579": "312",
592
+ "580": "313",
593
+ "581": "315",
594
+ "582": "317",
595
+ "583": "318",
596
+ "584": "319",
597
+ "585": "32",
598
+ "586": "320",
599
+ "587": "321",
600
+ "588": "322",
601
+ "589": "323",
602
+ "590": "324",
603
+ "591": "325",
604
+ "592": "326",
605
+ "593": "327",
606
+ "594": "328",
607
+ "595": "329",
608
+ "596": "33",
609
+ "597": "330",
610
+ "598": "331",
611
+ "599": "332",
612
+ "600": "333",
613
+ "601": "334",
614
+ "602": "335",
615
+ "603": "336",
616
+ "604": "337",
617
+ "605": "338",
618
+ "606": "339",
619
+ "607": "34",
620
+ "608": "340",
621
+ "609": "341",
622
+ "610": "342",
623
+ "611": "343",
624
+ "612": "344",
625
+ "613": "345",
626
+ "614": "349",
627
+ "615": "35",
628
+ "616": "350",
629
+ "617": "351",
630
+ "618": "352",
631
+ "619": "353",
632
+ "620": "354",
633
+ "621": "355",
634
+ "622": "356",
635
+ "623": "358",
636
+ "624": "359",
637
+ "625": "36",
638
+ "626": "361",
639
+ "627": "362",
640
+ "628": "363",
641
+ "629": "364",
642
+ "630": "365",
643
+ "631": "366",
644
+ "632": "367",
645
+ "633": "368",
646
+ "634": "369",
647
+ "635": "37",
648
+ "636": "370",
649
+ "637": "371",
650
+ "638": "372",
651
+ "639": "373",
652
+ "640": "374",
653
+ "641": "375",
654
+ "642": "376",
655
+ "643": "377",
656
+ "644": "378",
657
+ "645": "379",
658
+ "646": "38",
659
+ "647": "380",
660
+ "648": "381",
661
+ "649": "382",
662
+ "650": "383",
663
+ "651": "384",
664
+ "652": "385",
665
+ "653": "386",
666
+ "654": "387",
667
+ "655": "388",
668
+ "656": "389",
669
+ "657": "39",
670
+ "658": "390",
671
+ "659": "391",
672
+ "660": "392",
673
+ "661": "393",
674
+ "662": "394",
675
+ "663": "395",
676
+ "664": "396",
677
+ "665": "397",
678
+ "666": "398",
679
+ "667": "399",
680
+ "668": "4",
681
+ "669": "40",
682
+ "670": "400",
683
+ "671": "401",
684
+ "672": "402",
685
+ "673": "403",
686
+ "674": "404",
687
+ "675": "405",
688
+ "676": "406",
689
+ "677": "407",
690
+ "678": "409",
691
+ "679": "41",
692
+ "680": "411",
693
+ "681": "412",
694
+ "682": "414",
695
+ "683": "415",
696
+ "684": "416",
697
+ "685": "418",
698
+ "686": "419",
699
+ "687": "42",
700
+ "688": "420",
701
+ "689": "421",
702
+ "690": "422",
703
+ "691": "423",
704
+ "692": "424",
705
+ "693": "425",
706
+ "694": "426",
707
+ "695": "427",
708
+ "696": "429",
709
+ "697": "43",
710
+ "698": "430",
711
+ "699": "431",
712
+ "700": "432",
713
+ "701": "433",
714
+ "702": "434",
715
+ "703": "435",
716
+ "704": "436",
717
+ "705": "437",
718
+ "706": "438",
719
+ "707": "439",
720
+ "708": "44",
721
+ "709": "440",
722
+ "710": "441",
723
+ "711": "442",
724
+ "712": "443",
725
+ "713": "444",
726
+ "714": "445",
727
+ "715": "446",
728
+ "716": "447",
729
+ "717": "448",
730
+ "718": "449",
731
+ "719": "45",
732
+ "720": "450",
733
+ "721": "451",
734
+ "722": "452",
735
+ "723": "453",
736
+ "724": "454",
737
+ "725": "455",
738
+ "726": "456",
739
+ "727": "457",
740
+ "728": "458",
741
+ "729": "459",
742
+ "730": "46",
743
+ "731": "460",
744
+ "732": "461",
745
+ "733": "462",
746
+ "734": "463",
747
+ "735": "464",
748
+ "736": "465",
749
+ "737": "466",
750
+ "738": "467",
751
+ "739": "468",
752
+ "740": "469",
753
+ "741": "47",
754
+ "742": "470",
755
+ "743": "471",
756
+ "744": "472",
757
+ "745": "473",
758
+ "746": "474",
759
+ "747": "475",
760
+ "748": "476",
761
+ "749": "477",
762
+ "750": "478",
763
+ "751": "479",
764
+ "752": "480",
765
+ "753": "481",
766
+ "754": "482",
767
+ "755": "483",
768
+ "756": "484",
769
+ "757": "485",
770
+ "758": "486",
771
+ "759": "487",
772
+ "760": "488",
773
+ "761": "489",
774
+ "762": "49",
775
+ "763": "490",
776
+ "764": "491",
777
+ "765": "492",
778
+ "766": "493",
779
+ "767": "494",
780
+ "768": "495",
781
+ "769": "496",
782
+ "770": "497",
783
+ "771": "499",
784
+ "772": "5",
785
+ "773": "50",
786
+ "774": "500",
787
+ "775": "501",
788
+ "776": "502",
789
+ "777": "503",
790
+ "778": "504",
791
+ "779": "505",
792
+ "780": "506",
793
+ "781": "507",
794
+ "782": "508",
795
+ "783": "509",
796
+ "784": "51",
797
+ "785": "510",
798
+ "786": "511",
799
+ "787": "512",
800
+ "788": "513",
801
+ "789": "514",
802
+ "790": "515",
803
+ "791": "516",
804
+ "792": "517",
805
+ "793": "518",
806
+ "794": "519",
807
+ "795": "52",
808
+ "796": "520",
809
+ "797": "521",
810
+ "798": "522",
811
+ "799": "523",
812
+ "800": "524",
813
+ "801": "525",
814
+ "802": "526",
815
+ "803": "527",
816
+ "804": "528",
817
+ "805": "529",
818
+ "806": "53",
819
+ "807": "530",
820
+ "808": "531",
821
+ "809": "532",
822
+ "810": "533",
823
+ "811": "534",
824
+ "812": "535",
825
+ "813": "536",
826
+ "814": "537",
827
+ "815": "538",
828
+ "816": "539",
829
+ "817": "54",
830
+ "818": "540",
831
+ "819": "541",
832
+ "820": "542",
833
+ "821": "543",
834
+ "822": "544",
835
+ "823": "546",
836
+ "824": "547",
837
+ "825": "548",
838
+ "826": "549",
839
+ "827": "55",
840
+ "828": "550",
841
+ "829": "551",
842
+ "830": "552",
843
+ "831": "553",
844
+ "832": "554",
845
+ "833": "555",
846
+ "834": "556",
847
+ "835": "557",
848
+ "836": "558",
849
+ "837": "559",
850
+ "838": "56",
851
+ "839": "560",
852
+ "840": "561",
853
+ "841": "562",
854
+ "842": "563",
855
+ "843": "564",
856
+ "844": "565",
857
+ "845": "566",
858
+ "846": "567",
859
+ "847": "568",
860
+ "848": "569",
861
+ "849": "57",
862
+ "850": "570",
863
+ "851": "571",
864
+ "852": "572",
865
+ "853": "573",
866
+ "854": "574",
867
+ "855": "575",
868
+ "856": "576",
869
+ "857": "577",
870
+ "858": "578",
871
+ "859": "579",
872
+ "860": "580",
873
+ "861": "581",
874
+ "862": "582",
875
+ "863": "583",
876
+ "864": "584",
877
+ "865": "585",
878
+ "866": "586",
879
+ "867": "587",
880
+ "868": "588",
881
+ "869": "589",
882
+ "870": "591",
883
+ "871": "593",
884
+ "872": "594",
885
+ "873": "595",
886
+ "874": "597",
887
+ "875": "598",
888
+ "876": "599",
889
+ "877": "6",
890
+ "878": "600",
891
+ "879": "601",
892
+ "880": "602",
893
+ "881": "603",
894
+ "882": "604",
895
+ "883": "605",
896
+ "884": "606",
897
+ "885": "607",
898
+ "886": "608",
899
+ "887": "609",
900
+ "888": "610",
901
+ "889": "611",
902
+ "890": "612",
903
+ "891": "613",
904
+ "892": "614",
905
+ "893": "615",
906
+ "894": "616",
907
+ "895": "618",
908
+ "896": "619",
909
+ "897": "620",
910
+ "898": "621",
911
+ "899": "622",
912
+ "900": "623",
913
+ "901": "624",
914
+ "902": "625",
915
+ "903": "626",
916
+ "904": "627",
917
+ "905": "628",
918
+ "906": "629",
919
+ "907": "630",
920
+ "908": "631",
921
+ "909": "632",
922
+ "910": "633",
923
+ "911": "634",
924
+ "912": "635",
925
+ "913": "636",
926
+ "914": "637",
927
+ "915": "638",
928
+ "916": "64",
929
+ "917": "640",
930
+ "918": "641",
931
+ "919": "643",
932
+ "920": "645",
933
+ "921": "646",
934
+ "922": "647",
935
+ "923": "648",
936
+ "924": "649",
937
+ "925": "65",
938
+ "926": "650",
939
+ "927": "651",
940
+ "928": "652",
941
+ "929": "653",
942
+ "930": "654",
943
+ "931": "655",
944
+ "932": "656",
945
+ "933": "657",
946
+ "934": "658",
947
+ "935": "659",
948
+ "936": "660",
949
+ "937": "661",
950
+ "938": "662",
951
+ "939": "663",
952
+ "940": "664",
953
+ "941": "665",
954
+ "942": "666",
955
+ "943": "667",
956
+ "944": "668",
957
+ "945": "669",
958
+ "946": "67",
959
+ "947": "670",
960
+ "948": "671",
961
+ "949": "672",
962
+ "950": "673",
963
+ "951": "675",
964
+ "952": "676",
965
+ "953": "677",
966
+ "954": "679",
967
+ "955": "680",
968
+ "956": "681",
969
+ "957": "682",
970
+ "958": "683",
971
+ "959": "684",
972
+ "960": "685",
973
+ "961": "686",
974
+ "962": "687",
975
+ "963": "688",
976
+ "964": "689",
977
+ "965": "69",
978
+ "966": "690",
979
+ "967": "691",
980
+ "968": "692",
981
+ "969": "694",
982
+ "970": "695",
983
+ "971": "696",
984
+ "972": "697",
985
+ "973": "698",
986
+ "974": "699",
987
+ "975": "7",
988
+ "976": "70",
989
+ "977": "700",
990
+ "978": "701",
991
+ "979": "702",
992
+ "980": "703",
993
+ "981": "704",
994
+ "982": "705",
995
+ "983": "706",
996
+ "984": "707",
997
+ "985": "708",
998
+ "986": "709",
999
+ "987": "71",
1000
+ "988": "710",
1001
+ "989": "711",
1002
+ "990": "712",
1003
+ "991": "713",
1004
+ "992": "714",
1005
+ "993": "72",
1006
+ "994": "721",
1007
+ "995": "722",
1008
+ "996": "723",
1009
+ "997": "724",
1010
+ "998": "725",
1011
+ "999": "726",
1012
+ "1000": "727",
1013
+ "1001": "728",
1014
+ "1002": "729",
1015
+ "1003": "73",
1016
+ "1004": "730",
1017
+ "1005": "731",
1018
+ "1006": "732",
1019
+ "1007": "733",
1020
+ "1008": "734",
1021
+ "1009": "735",
1022
+ "1010": "736",
1023
+ "1011": "737",
1024
+ "1012": "738",
1025
+ "1013": "739",
1026
+ "1014": "740",
1027
+ "1015": "741",
1028
+ "1016": "742",
1029
+ "1017": "743",
1030
+ "1018": "744",
1031
+ "1019": "745",
1032
+ "1020": "746",
1033
+ "1021": "747",
1034
+ "1022": "748",
1035
+ "1023": "749",
1036
+ "1024": "75",
1037
+ "1025": "750",
1038
+ "1026": "752",
1039
+ "1027": "753",
1040
+ "1028": "754",
1041
+ "1029": "755",
1042
+ "1030": "756",
1043
+ "1031": "757",
1044
+ "1032": "758",
1045
+ "1033": "759",
1046
+ "1034": "76",
1047
+ "1035": "760",
1048
+ "1036": "761",
1049
+ "1037": "762",
1050
+ "1038": "763",
1051
+ "1039": "764",
1052
+ "1040": "765",
1053
+ "1041": "766",
1054
+ "1042": "767",
1055
+ "1043": "768",
1056
+ "1044": "769",
1057
+ "1045": "77",
1058
+ "1046": "770",
1059
+ "1047": "772",
1060
+ "1048": "773",
1061
+ "1049": "774",
1062
+ "1050": "775",
1063
+ "1051": "776",
1064
+ "1052": "777",
1065
+ "1053": "778",
1066
+ "1054": "779",
1067
+ "1055": "78",
1068
+ "1056": "780",
1069
+ "1057": "781",
1070
+ "1058": "782",
1071
+ "1059": "783",
1072
+ "1060": "784",
1073
+ "1061": "785",
1074
+ "1062": "786",
1075
+ "1063": "787",
1076
+ "1064": "788",
1077
+ "1065": "789",
1078
+ "1066": "79",
1079
+ "1067": "790",
1080
+ "1068": "791",
1081
+ "1069": "792",
1082
+ "1070": "793",
1083
+ "1071": "794",
1084
+ "1072": "795",
1085
+ "1073": "796",
1086
+ "1074": "797",
1087
+ "1075": "798",
1088
+ "1076": "8",
1089
+ "1077": "80",
1090
+ "1078": "800",
1091
+ "1079": "801",
1092
+ "1080": "802",
1093
+ "1081": "803",
1094
+ "1082": "804",
1095
+ "1083": "805",
1096
+ "1084": "806",
1097
+ "1085": "807",
1098
+ "1086": "808",
1099
+ "1087": "809",
1100
+ "1088": "81",
1101
+ "1089": "810",
1102
+ "1090": "811",
1103
+ "1091": "812",
1104
+ "1092": "813",
1105
+ "1093": "814",
1106
+ "1094": "815",
1107
+ "1095": "816",
1108
+ "1096": "817",
1109
+ "1097": "818",
1110
+ "1098": "819",
1111
+ "1099": "82",
1112
+ "1100": "820",
1113
+ "1101": "821",
1114
+ "1102": "822",
1115
+ "1103": "824",
1116
+ "1104": "825",
1117
+ "1105": "826",
1118
+ "1106": "827",
1119
+ "1107": "828",
1120
+ "1108": "829",
1121
+ "1109": "83",
1122
+ "1110": "830",
1123
+ "1111": "831",
1124
+ "1112": "832",
1125
+ "1113": "833",
1126
+ "1114": "834",
1127
+ "1115": "835",
1128
+ "1116": "836",
1129
+ "1117": "837",
1130
+ "1118": "838",
1131
+ "1119": "839",
1132
+ "1120": "84",
1133
+ "1121": "840",
1134
+ "1122": "841",
1135
+ "1123": "842",
1136
+ "1124": "843",
1137
+ "1125": "844",
1138
+ "1126": "845",
1139
+ "1127": "846",
1140
+ "1128": "847",
1141
+ "1129": "848",
1142
+ "1130": "849",
1143
+ "1131": "85",
1144
+ "1132": "850",
1145
+ "1133": "851",
1146
+ "1134": "852",
1147
+ "1135": "853",
1148
+ "1136": "854",
1149
+ "1137": "855",
1150
+ "1138": "856",
1151
+ "1139": "857",
1152
+ "1140": "858",
1153
+ "1141": "859",
1154
+ "1142": "86",
1155
+ "1143": "863",
1156
+ "1144": "864",
1157
+ "1145": "865",
1158
+ "1146": "866",
1159
+ "1147": "868",
1160
+ "1148": "87",
1161
+ "1149": "870",
1162
+ "1150": "871",
1163
+ "1151": "872",
1164
+ "1152": "873",
1165
+ "1153": "874",
1166
+ "1154": "875",
1167
+ "1155": "876",
1168
+ "1156": "877",
1169
+ "1157": "878",
1170
+ "1158": "879",
1171
+ "1159": "88",
1172
+ "1160": "880",
1173
+ "1161": "881",
1174
+ "1162": "882",
1175
+ "1163": "883",
1176
+ "1164": "884",
1177
+ "1165": "885",
1178
+ "1166": "886",
1179
+ "1167": "887",
1180
+ "1168": "888",
1181
+ "1169": "889",
1182
+ "1170": "89",
1183
+ "1171": "890",
1184
+ "1172": "891",
1185
+ "1173": "892",
1186
+ "1174": "893",
1187
+ "1175": "894",
1188
+ "1176": "895",
1189
+ "1177": "896",
1190
+ "1178": "897",
1191
+ "1179": "898",
1192
+ "1180": "899",
1193
+ "1181": "9",
1194
+ "1182": "90",
1195
+ "1183": "900",
1196
+ "1184": "901",
1197
+ "1185": "903",
1198
+ "1186": "906",
1199
+ "1187": "909",
1200
+ "1188": "910",
1201
+ "1189": "911",
1202
+ "1190": "912",
1203
+ "1191": "913",
1204
+ "1192": "914",
1205
+ "1193": "915",
1206
+ "1194": "916",
1207
+ "1195": "917",
1208
+ "1196": "918",
1209
+ "1197": "92",
1210
+ "1198": "921",
1211
+ "1199": "922",
1212
+ "1200": "923",
1213
+ "1201": "924",
1214
+ "1202": "925",
1215
+ "1203": "926",
1216
+ "1204": "927",
1217
+ "1205": "928",
1218
+ "1206": "929",
1219
+ "1207": "930",
1220
+ "1208": "931",
1221
+ "1209": "932",
1222
+ "1210": "933",
1223
+ "1211": "934",
1224
+ "1212": "935",
1225
+ "1213": "936",
1226
+ "1214": "937",
1227
+ "1215": "938",
1228
+ "1216": "939",
1229
+ "1217": "940",
1230
+ "1218": "941",
1231
+ "1219": "942",
1232
+ "1220": "943",
1233
+ "1221": "944",
1234
+ "1222": "945",
1235
+ "1223": "946",
1236
+ "1224": "947",
1237
+ "1225": "948",
1238
+ "1226": "949",
1239
+ "1227": "950",
1240
+ "1228": "951",
1241
+ "1229": "952",
1242
+ "1230": "953",
1243
+ "1231": "954",
1244
+ "1232": "955",
1245
+ "1233": "956",
1246
+ "1234": "957",
1247
+ "1235": "958",
1248
+ "1236": "959",
1249
+ "1237": "960",
1250
+ "1238": "961",
1251
+ "1239": "962",
1252
+ "1240": "963",
1253
+ "1241": "964",
1254
+ "1242": "965",
1255
+ "1243": "966",
1256
+ "1244": "967",
1257
+ "1245": "968",
1258
+ "1246": "969",
1259
+ "1247": "97",
1260
+ "1248": "970",
1261
+ "1249": "971",
1262
+ "1250": "972",
1263
+ "1251": "973",
1264
+ "1252": "974",
1265
+ "1253": "975",
1266
+ "1254": "976",
1267
+ "1255": "977",
1268
+ "1256": "978",
1269
+ "1257": "979",
1270
+ "1258": "980",
1271
+ "1259": "981",
1272
+ "1260": "982",
1273
+ "1261": "983",
1274
+ "1262": "984",
1275
+ "1263": "985",
1276
+ "1264": "986",
1277
+ "1265": "989",
1278
+ "1266": "99",
1279
+ "1267": "990",
1280
+ "1268": "991",
1281
+ "1269": "992",
1282
+ "1270": "993",
1283
+ "1271": "994",
1284
+ "1272": "995",
1285
+ "1273": "996",
1286
+ "1274": "997",
1287
+ "1275": "998",
1288
+ "1276": "999"
1289
+ },
1290
+ "initializer_range": 0.02,
1291
+ "intermediate_size": 3072,
1292
+ "label2id": {
1293
+ "1": 0,
1294
+ "10": 1,
1295
+ "100": 2,
1296
+ "1003": 3,
1297
+ "1004": 4,
1298
+ "1005": 5,
1299
+ "1006": 6,
1300
+ "1007": 7,
1301
+ "1008": 8,
1302
+ "1009": 9,
1303
+ "101": 10,
1304
+ "1010": 11,
1305
+ "1011": 12,
1306
+ "1012": 13,
1307
+ "1013": 14,
1308
+ "1014": 15,
1309
+ "1017": 16,
1310
+ "1018": 17,
1311
+ "1019": 18,
1312
+ "102": 19,
1313
+ "1020": 20,
1314
+ "1021": 21,
1315
+ "1022": 22,
1316
+ "1023": 23,
1317
+ "103": 24,
1318
+ "1034": 25,
1319
+ "1035": 26,
1320
+ "104": 27,
1321
+ "1040": 28,
1322
+ "1043": 29,
1323
+ "1046": 30,
1324
+ "1047": 31,
1325
+ "1048": 32,
1326
+ "105": 33,
1327
+ "1050": 34,
1328
+ "1051": 35,
1329
+ "1052": 36,
1330
+ "1053": 37,
1331
+ "1054": 38,
1332
+ "1055": 39,
1333
+ "1056": 40,
1334
+ "1058": 41,
1335
+ "1059": 42,
1336
+ "1060": 43,
1337
+ "1062": 44,
1338
+ "107": 45,
1339
+ "1071": 46,
1340
+ "1073": 47,
1341
+ "108": 48,
1342
+ "1084": 49,
1343
+ "1086": 50,
1344
+ "1097": 51,
1345
+ "1099": 52,
1346
+ "11": 53,
1347
+ "110": 54,
1348
+ "1100": 55,
1349
+ "1106": 56,
1350
+ "1147": 57,
1351
+ "1148": 58,
1352
+ "1149": 59,
1353
+ "1150": 60,
1354
+ "1151": 61,
1355
+ "1152": 62,
1356
+ "1154": 63,
1357
+ "1156": 64,
1358
+ "1157": 65,
1359
+ "1158": 66,
1360
+ "1160": 67,
1361
+ "1161": 68,
1362
+ "1162": 69,
1363
+ "1166": 70,
1364
+ "1167": 71,
1365
+ "1169": 72,
1366
+ "1170": 73,
1367
+ "1171": 74,
1368
+ "1172": 75,
1369
+ "1173": 76,
1370
+ "1174": 77,
1371
+ "1175": 78,
1372
+ "1177": 79,
1373
+ "1178": 80,
1374
+ "1179": 81,
1375
+ "118": 82,
1376
+ "1180": 83,
1377
+ "1181": 84,
1378
+ "1184": 85,
1379
+ "1185": 86,
1380
+ "1186": 87,
1381
+ "1187": 88,
1382
+ "1188": 89,
1383
+ "1189": 90,
1384
+ "119": 91,
1385
+ "1190": 92,
1386
+ "1191": 93,
1387
+ "1192": 94,
1388
+ "1193": 95,
1389
+ "1195": 96,
1390
+ "1196": 97,
1391
+ "1198": 98,
1392
+ "1199": 99,
1393
+ "12": 100,
1394
+ "120": 101,
1395
+ "1201": 102,
1396
+ "1202": 103,
1397
+ "1203": 104,
1398
+ "1204": 105,
1399
+ "1205": 106,
1400
+ "1206": 107,
1401
+ "1207": 108,
1402
+ "1208": 109,
1403
+ "121": 110,
1404
+ "1210": 111,
1405
+ "1211": 112,
1406
+ "1212": 113,
1407
+ "1213": 114,
1408
+ "1217": 115,
1409
+ "1218": 116,
1410
+ "122": 117,
1411
+ "1222": 118,
1412
+ "1223": 119,
1413
+ "1224": 120,
1414
+ "1225": 121,
1415
+ "1226": 122,
1416
+ "1229": 123,
1417
+ "123": 124,
1418
+ "1230": 125,
1419
+ "1231": 126,
1420
+ "1232": 127,
1421
+ "1233": 128,
1422
+ "1234": 129,
1423
+ "1235": 130,
1424
+ "1236": 131,
1425
+ "1238": 132,
1426
+ "1239": 133,
1427
+ "124": 134,
1428
+ "1240": 135,
1429
+ "1241": 136,
1430
+ "1242": 137,
1431
+ "1243": 138,
1432
+ "1244": 139,
1433
+ "1245": 140,
1434
+ "1246": 141,
1435
+ "1247": 142,
1436
+ "1248": 143,
1437
+ "1249": 144,
1438
+ "125": 145,
1439
+ "1250": 146,
1440
+ "1251": 147,
1441
+ "1252": 148,
1442
+ "1253": 149,
1443
+ "1256": 150,
1444
+ "1257": 151,
1445
+ "1258": 152,
1446
+ "1259": 153,
1447
+ "126": 154,
1448
+ "1260": 155,
1449
+ "1261": 156,
1450
+ "1262": 157,
1451
+ "1263": 158,
1452
+ "1264": 159,
1453
+ "1266": 160,
1454
+ "1267": 161,
1455
+ "1268": 162,
1456
+ "1269": 163,
1457
+ "127": 164,
1458
+ "1270": 165,
1459
+ "1271": 166,
1460
+ "1272": 167,
1461
+ "1273": 168,
1462
+ "1274": 169,
1463
+ "1275": 170,
1464
+ "1276": 171,
1465
+ "1277": 172,
1466
+ "1278": 173,
1467
+ "1279": 174,
1468
+ "128": 175,
1469
+ "1280": 176,
1470
+ "1281": 177,
1471
+ "1282": 178,
1472
+ "1283": 179,
1473
+ "1284": 180,
1474
+ "1285": 181,
1475
+ "1287": 182,
1476
+ "1288": 183,
1477
+ "1289": 184,
1478
+ "1290": 185,
1479
+ "1291": 186,
1480
+ "1292": 187,
1481
+ "1293": 188,
1482
+ "1294": 189,
1483
+ "1295": 190,
1484
+ "1296": 191,
1485
+ "1297": 192,
1486
+ "1298": 193,
1487
+ "1299": 194,
1488
+ "13": 195,
1489
+ "1300": 196,
1490
+ "1301": 197,
1491
+ "1302": 198,
1492
+ "1303": 199,
1493
+ "1304": 200,
1494
+ "1305": 201,
1495
+ "1306": 202,
1496
+ "1307": 203,
1497
+ "1308": 204,
1498
+ "1309": 205,
1499
+ "1310": 206,
1500
+ "1311": 207,
1501
+ "1312": 208,
1502
+ "1313": 209,
1503
+ "1314": 210,
1504
+ "1315": 211,
1505
+ "1316": 212,
1506
+ "1317": 213,
1507
+ "1318": 214,
1508
+ "1319": 215,
1509
+ "1320": 216,
1510
+ "1321": 217,
1511
+ "1322": 218,
1512
+ "1323": 219,
1513
+ "1324": 220,
1514
+ "1325": 221,
1515
+ "1326": 222,
1516
+ "1327": 223,
1517
+ "1328": 224,
1518
+ "1329": 225,
1519
+ "133": 226,
1520
+ "1330": 227,
1521
+ "1331": 228,
1522
+ "1333": 229,
1523
+ "1334": 230,
1524
+ "1336": 231,
1525
+ "1340": 232,
1526
+ "1341": 233,
1527
+ "1342": 234,
1528
+ "1343": 235,
1529
+ "1346": 236,
1530
+ "135": 237,
1531
+ "1350": 238,
1532
+ "1351": 239,
1533
+ "1357": 240,
1534
+ "1359": 241,
1535
+ "136": 242,
1536
+ "1361": 243,
1537
+ "1362": 244,
1538
+ "1363": 245,
1539
+ "1364": 246,
1540
+ "1365": 247,
1541
+ "1367": 248,
1542
+ "1368": 249,
1543
+ "1369": 250,
1544
+ "137": 251,
1545
+ "1370": 252,
1546
+ "1371": 253,
1547
+ "1372": 254,
1548
+ "1373": 255,
1549
+ "1374": 256,
1550
+ "1376": 257,
1551
+ "1377": 258,
1552
+ "1378": 259,
1553
+ "1379": 260,
1554
+ "138": 261,
1555
+ "1380": 262,
1556
+ "1382": 263,
1557
+ "1383": 264,
1558
+ "1384": 265,
1559
+ "1385": 266,
1560
+ "1386": 267,
1561
+ "1387": 268,
1562
+ "1388": 269,
1563
+ "1389": 270,
1564
+ "139": 271,
1565
+ "1391": 272,
1566
+ "1396": 273,
1567
+ "1397": 274,
1568
+ "1398": 275,
1569
+ "1399": 276,
1570
+ "14": 277,
1571
+ "140": 278,
1572
+ "1400": 279,
1573
+ "1401": 280,
1574
+ "1402": 281,
1575
+ "1403": 282,
1576
+ "141": 283,
1577
+ "1413": 284,
1578
+ "1415": 285,
1579
+ "1416": 286,
1580
+ "1417": 287,
1581
+ "1419": 288,
1582
+ "142": 289,
1583
+ "1420": 290,
1584
+ "1421": 291,
1585
+ "1422": 292,
1586
+ "1423": 293,
1587
+ "1425": 294,
1588
+ "1426": 295,
1589
+ "1427": 296,
1590
+ "1428": 297,
1591
+ "1429": 298,
1592
+ "143": 299,
1593
+ "1430": 300,
1594
+ "1431": 301,
1595
+ "1432": 302,
1596
+ "1433": 303,
1597
+ "1438": 304,
1598
+ "1439": 305,
1599
+ "144": 306,
1600
+ "1441": 307,
1601
+ "1443": 308,
1602
+ "1444": 309,
1603
+ "1445": 310,
1604
+ "1446": 311,
1605
+ "1447": 312,
1606
+ "1448": 313,
1607
+ "1449": 314,
1608
+ "145": 315,
1609
+ "1450": 316,
1610
+ "1451": 317,
1611
+ "1452": 318,
1612
+ "1453": 319,
1613
+ "1454": 320,
1614
+ "1455": 321,
1615
+ "1456": 322,
1616
+ "1457": 323,
1617
+ "1458": 324,
1618
+ "1459": 325,
1619
+ "146": 326,
1620
+ "1460": 327,
1621
+ "1461": 328,
1622
+ "1462": 329,
1623
+ "1463": 330,
1624
+ "1464": 331,
1625
+ "1465": 332,
1626
+ "1466": 333,
1627
+ "1467": 334,
1628
+ "1468": 335,
1629
+ "1469": 336,
1630
+ "147": 337,
1631
+ "1470": 338,
1632
+ "1471": 339,
1633
+ "1473": 340,
1634
+ "1474": 341,
1635
+ "1475": 342,
1636
+ "1476": 343,
1637
+ "1477": 344,
1638
+ "1478": 345,
1639
+ "1479": 346,
1640
+ "1480": 347,
1641
+ "1481": 348,
1642
+ "1482": 349,
1643
+ "1483": 350,
1644
+ "1484": 351,
1645
+ "1485": 352,
1646
+ "1486": 353,
1647
+ "1487": 354,
1648
+ "1488": 355,
1649
+ "1489": 356,
1650
+ "1490": 357,
1651
+ "1491": 358,
1652
+ "1492": 359,
1653
+ "1493": 360,
1654
+ "1494": 361,
1655
+ "1495": 362,
1656
+ "1496": 363,
1657
+ "1497": 364,
1658
+ "1498": 365,
1659
+ "1499": 366,
1660
+ "15": 367,
1661
+ "1500": 368,
1662
+ "1501": 369,
1663
+ "1502": 370,
1664
+ "1507": 371,
1665
+ "1509": 372,
1666
+ "1510": 373,
1667
+ "1511": 374,
1668
+ "1512": 375,
1669
+ "1513": 376,
1670
+ "1514": 377,
1671
+ "1515": 378,
1672
+ "1516": 379,
1673
+ "1517": 380,
1674
+ "1518": 381,
1675
+ "1519": 382,
1676
+ "152": 383,
1677
+ "1520": 384,
1678
+ "1521": 385,
1679
+ "1522": 386,
1680
+ "1523": 387,
1681
+ "1524": 388,
1682
+ "1525": 389,
1683
+ "1526": 390,
1684
+ "1527": 391,
1685
+ "1528": 392,
1686
+ "1529": 393,
1687
+ "153": 394,
1688
+ "1530": 395,
1689
+ "1531": 396,
1690
+ "1532": 397,
1691
+ "1533": 398,
1692
+ "1534": 399,
1693
+ "1535": 400,
1694
+ "1536": 401,
1695
+ "1537": 402,
1696
+ "1538": 403,
1697
+ "1539": 404,
1698
+ "154": 405,
1699
+ "1540": 406,
1700
+ "1541": 407,
1701
+ "1542": 408,
1702
+ "1543": 409,
1703
+ "1544": 410,
1704
+ "1545": 411,
1705
+ "1546": 412,
1706
+ "1547": 413,
1707
+ "1548": 414,
1708
+ "1549": 415,
1709
+ "155": 416,
1710
+ "1550": 417,
1711
+ "1551": 418,
1712
+ "1552": 419,
1713
+ "1553": 420,
1714
+ "1554": 421,
1715
+ "1555": 422,
1716
+ "1556": 423,
1717
+ "1557": 424,
1718
+ "1558": 425,
1719
+ "1559": 426,
1720
+ "1560": 427,
1721
+ "1561": 428,
1722
+ "1562": 429,
1723
+ "1563": 430,
1724
+ "1564": 431,
1725
+ "1565": 432,
1726
+ "1566": 433,
1727
+ "1567": 434,
1728
+ "1568": 435,
1729
+ "1569": 436,
1730
+ "157": 437,
1731
+ "1570": 438,
1732
+ "1571": 439,
1733
+ "1572": 440,
1734
+ "1573": 441,
1735
+ "1574": 442,
1736
+ "1575": 443,
1737
+ "1576": 444,
1738
+ "1577": 445,
1739
+ "1578": 446,
1740
+ "1579": 447,
1741
+ "158": 448,
1742
+ "1580": 449,
1743
+ "1581": 450,
1744
+ "1582": 451,
1745
+ "1583": 452,
1746
+ "1584": 453,
1747
+ "1585": 454,
1748
+ "1586": 455,
1749
+ "159": 456,
1750
+ "160": 457,
1751
+ "162": 458,
1752
+ "163": 459,
1753
+ "164": 460,
1754
+ "165": 461,
1755
+ "166": 462,
1756
+ "167": 463,
1757
+ "168": 464,
1758
+ "169": 465,
1759
+ "17": 466,
1760
+ "170": 467,
1761
+ "171": 468,
1762
+ "172": 469,
1763
+ "173": 470,
1764
+ "174": 471,
1765
+ "175": 472,
1766
+ "177": 473,
1767
+ "178": 474,
1768
+ "179": 475,
1769
+ "18": 476,
1770
+ "180": 477,
1771
+ "181": 478,
1772
+ "182": 479,
1773
+ "19": 480,
1774
+ "192": 481,
1775
+ "193": 482,
1776
+ "194": 483,
1777
+ "195": 484,
1778
+ "197": 485,
1779
+ "199": 486,
1780
+ "20": 487,
1781
+ "200": 488,
1782
+ "202": 489,
1783
+ "203": 490,
1784
+ "204": 491,
1785
+ "205": 492,
1786
+ "206": 493,
1787
+ "207": 494,
1788
+ "208": 495,
1789
+ "209": 496,
1790
+ "210": 497,
1791
+ "211": 498,
1792
+ "212": 499,
1793
+ "213": 500,
1794
+ "214": 501,
1795
+ "215": 502,
1796
+ "216": 503,
1797
+ "217": 504,
1798
+ "218": 505,
1799
+ "219": 506,
1800
+ "22": 507,
1801
+ "220": 508,
1802
+ "221": 509,
1803
+ "222": 510,
1804
+ "223": 511,
1805
+ "224": 512,
1806
+ "225": 513,
1807
+ "226": 514,
1808
+ "227": 515,
1809
+ "229": 516,
1810
+ "23": 517,
1811
+ "230": 518,
1812
+ "231": 519,
1813
+ "232": 520,
1814
+ "233": 521,
1815
+ "234": 522,
1816
+ "236": 523,
1817
+ "237": 524,
1818
+ "238": 525,
1819
+ "239": 526,
1820
+ "24": 527,
1821
+ "240": 528,
1822
+ "241": 529,
1823
+ "242": 530,
1824
+ "243": 531,
1825
+ "244": 532,
1826
+ "245": 533,
1827
+ "246": 534,
1828
+ "247": 535,
1829
+ "248": 536,
1830
+ "249": 537,
1831
+ "25": 538,
1832
+ "250": 539,
1833
+ "251": 540,
1834
+ "252": 541,
1835
+ "253": 542,
1836
+ "254": 543,
1837
+ "255": 544,
1838
+ "256": 545,
1839
+ "257": 546,
1840
+ "259": 547,
1841
+ "26": 548,
1842
+ "260": 549,
1843
+ "261": 550,
1844
+ "262": 551,
1845
+ "27": 552,
1846
+ "28": 553,
1847
+ "288": 554,
1848
+ "289": 555,
1849
+ "29": 556,
1850
+ "290": 557,
1851
+ "291": 558,
1852
+ "292": 559,
1853
+ "293": 560,
1854
+ "294": 561,
1855
+ "295": 562,
1856
+ "296": 563,
1857
+ "297": 564,
1858
+ "298": 565,
1859
+ "30": 566,
1860
+ "300": 567,
1861
+ "301": 568,
1862
+ "302": 569,
1863
+ "303": 570,
1864
+ "304": 571,
1865
+ "306": 572,
1866
+ "307": 573,
1867
+ "308": 574,
1868
+ "309": 575,
1869
+ "31": 576,
1870
+ "310": 577,
1871
+ "311": 578,
1872
+ "312": 579,
1873
+ "313": 580,
1874
+ "315": 581,
1875
+ "317": 582,
1876
+ "318": 583,
1877
+ "319": 584,
1878
+ "32": 585,
1879
+ "320": 586,
1880
+ "321": 587,
1881
+ "322": 588,
1882
+ "323": 589,
1883
+ "324": 590,
1884
+ "325": 591,
1885
+ "326": 592,
1886
+ "327": 593,
1887
+ "328": 594,
1888
+ "329": 595,
1889
+ "33": 596,
1890
+ "330": 597,
1891
+ "331": 598,
1892
+ "332": 599,
1893
+ "333": 600,
1894
+ "334": 601,
1895
+ "335": 602,
1896
+ "336": 603,
1897
+ "337": 604,
1898
+ "338": 605,
1899
+ "339": 606,
1900
+ "34": 607,
1901
+ "340": 608,
1902
+ "341": 609,
1903
+ "342": 610,
1904
+ "343": 611,
1905
+ "344": 612,
1906
+ "345": 613,
1907
+ "349": 614,
1908
+ "35": 615,
1909
+ "350": 616,
1910
+ "351": 617,
1911
+ "352": 618,
1912
+ "353": 619,
1913
+ "354": 620,
1914
+ "355": 621,
1915
+ "356": 622,
1916
+ "358": 623,
1917
+ "359": 624,
1918
+ "36": 625,
1919
+ "361": 626,
1920
+ "362": 627,
1921
+ "363": 628,
1922
+ "364": 629,
1923
+ "365": 630,
1924
+ "366": 631,
1925
+ "367": 632,
1926
+ "368": 633,
1927
+ "369": 634,
1928
+ "37": 635,
1929
+ "370": 636,
1930
+ "371": 637,
1931
+ "372": 638,
1932
+ "373": 639,
1933
+ "374": 640,
1934
+ "375": 641,
1935
+ "376": 642,
1936
+ "377": 643,
1937
+ "378": 644,
1938
+ "379": 645,
1939
+ "38": 646,
1940
+ "380": 647,
1941
+ "381": 648,
1942
+ "382": 649,
1943
+ "383": 650,
1944
+ "384": 651,
1945
+ "385": 652,
1946
+ "386": 653,
1947
+ "387": 654,
1948
+ "388": 655,
1949
+ "389": 656,
1950
+ "39": 657,
1951
+ "390": 658,
1952
+ "391": 659,
1953
+ "392": 660,
1954
+ "393": 661,
1955
+ "394": 662,
1956
+ "395": 663,
1957
+ "396": 664,
1958
+ "397": 665,
1959
+ "398": 666,
1960
+ "399": 667,
1961
+ "4": 668,
1962
+ "40": 669,
1963
+ "400": 670,
1964
+ "401": 671,
1965
+ "402": 672,
1966
+ "403": 673,
1967
+ "404": 674,
1968
+ "405": 675,
1969
+ "406": 676,
1970
+ "407": 677,
1971
+ "409": 678,
1972
+ "41": 679,
1973
+ "411": 680,
1974
+ "412": 681,
1975
+ "414": 682,
1976
+ "415": 683,
1977
+ "416": 684,
1978
+ "418": 685,
1979
+ "419": 686,
1980
+ "42": 687,
1981
+ "420": 688,
1982
+ "421": 689,
1983
+ "422": 690,
1984
+ "423": 691,
1985
+ "424": 692,
1986
+ "425": 693,
1987
+ "426": 694,
1988
+ "427": 695,
1989
+ "429": 696,
1990
+ "43": 697,
1991
+ "430": 698,
1992
+ "431": 699,
1993
+ "432": 700,
1994
+ "433": 701,
1995
+ "434": 702,
1996
+ "435": 703,
1997
+ "436": 704,
1998
+ "437": 705,
1999
+ "438": 706,
2000
+ "439": 707,
2001
+ "44": 708,
2002
+ "440": 709,
2003
+ "441": 710,
2004
+ "442": 711,
2005
+ "443": 712,
2006
+ "444": 713,
2007
+ "445": 714,
2008
+ "446": 715,
2009
+ "447": 716,
2010
+ "448": 717,
2011
+ "449": 718,
2012
+ "45": 719,
2013
+ "450": 720,
2014
+ "451": 721,
2015
+ "452": 722,
2016
+ "453": 723,
2017
+ "454": 724,
2018
+ "455": 725,
2019
+ "456": 726,
2020
+ "457": 727,
2021
+ "458": 728,
2022
+ "459": 729,
2023
+ "46": 730,
2024
+ "460": 731,
2025
+ "461": 732,
2026
+ "462": 733,
2027
+ "463": 734,
2028
+ "464": 735,
2029
+ "465": 736,
2030
+ "466": 737,
2031
+ "467": 738,
2032
+ "468": 739,
2033
+ "469": 740,
2034
+ "47": 741,
2035
+ "470": 742,
2036
+ "471": 743,
2037
+ "472": 744,
2038
+ "473": 745,
2039
+ "474": 746,
2040
+ "475": 747,
2041
+ "476": 748,
2042
+ "477": 749,
2043
+ "478": 750,
2044
+ "479": 751,
2045
+ "480": 752,
2046
+ "481": 753,
2047
+ "482": 754,
2048
+ "483": 755,
2049
+ "484": 756,
2050
+ "485": 757,
2051
+ "486": 758,
2052
+ "487": 759,
2053
+ "488": 760,
2054
+ "489": 761,
2055
+ "49": 762,
2056
+ "490": 763,
2057
+ "491": 764,
2058
+ "492": 765,
2059
+ "493": 766,
2060
+ "494": 767,
2061
+ "495": 768,
2062
+ "496": 769,
2063
+ "497": 770,
2064
+ "499": 771,
2065
+ "5": 772,
2066
+ "50": 773,
2067
+ "500": 774,
2068
+ "501": 775,
2069
+ "502": 776,
2070
+ "503": 777,
2071
+ "504": 778,
2072
+ "505": 779,
2073
+ "506": 780,
2074
+ "507": 781,
2075
+ "508": 782,
2076
+ "509": 783,
2077
+ "51": 784,
2078
+ "510": 785,
2079
+ "511": 786,
2080
+ "512": 787,
2081
+ "513": 788,
2082
+ "514": 789,
2083
+ "515": 790,
2084
+ "516": 791,
2085
+ "517": 792,
2086
+ "518": 793,
2087
+ "519": 794,
2088
+ "52": 795,
2089
+ "520": 796,
2090
+ "521": 797,
2091
+ "522": 798,
2092
+ "523": 799,
2093
+ "524": 800,
2094
+ "525": 801,
2095
+ "526": 802,
2096
+ "527": 803,
2097
+ "528": 804,
2098
+ "529": 805,
2099
+ "53": 806,
2100
+ "530": 807,
2101
+ "531": 808,
2102
+ "532": 809,
2103
+ "533": 810,
2104
+ "534": 811,
2105
+ "535": 812,
2106
+ "536": 813,
2107
+ "537": 814,
2108
+ "538": 815,
2109
+ "539": 816,
2110
+ "54": 817,
2111
+ "540": 818,
2112
+ "541": 819,
2113
+ "542": 820,
2114
+ "543": 821,
2115
+ "544": 822,
2116
+ "546": 823,
2117
+ "547": 824,
2118
+ "548": 825,
2119
+ "549": 826,
2120
+ "55": 827,
2121
+ "550": 828,
2122
+ "551": 829,
2123
+ "552": 830,
2124
+ "553": 831,
2125
+ "554": 832,
2126
+ "555": 833,
2127
+ "556": 834,
2128
+ "557": 835,
2129
+ "558": 836,
2130
+ "559": 837,
2131
+ "56": 838,
2132
+ "560": 839,
2133
+ "561": 840,
2134
+ "562": 841,
2135
+ "563": 842,
2136
+ "564": 843,
2137
+ "565": 844,
2138
+ "566": 845,
2139
+ "567": 846,
2140
+ "568": 847,
2141
+ "569": 848,
2142
+ "57": 849,
2143
+ "570": 850,
2144
+ "571": 851,
2145
+ "572": 852,
2146
+ "573": 853,
2147
+ "574": 854,
2148
+ "575": 855,
2149
+ "576": 856,
2150
+ "577": 857,
2151
+ "578": 858,
2152
+ "579": 859,
2153
+ "580": 860,
2154
+ "581": 861,
2155
+ "582": 862,
2156
+ "583": 863,
2157
+ "584": 864,
2158
+ "585": 865,
2159
+ "586": 866,
2160
+ "587": 867,
2161
+ "588": 868,
2162
+ "589": 869,
2163
+ "591": 870,
2164
+ "593": 871,
2165
+ "594": 872,
2166
+ "595": 873,
2167
+ "597": 874,
2168
+ "598": 875,
2169
+ "599": 876,
2170
+ "6": 877,
2171
+ "600": 878,
2172
+ "601": 879,
2173
+ "602": 880,
2174
+ "603": 881,
2175
+ "604": 882,
2176
+ "605": 883,
2177
+ "606": 884,
2178
+ "607": 885,
2179
+ "608": 886,
2180
+ "609": 887,
2181
+ "610": 888,
2182
+ "611": 889,
2183
+ "612": 890,
2184
+ "613": 891,
2185
+ "614": 892,
2186
+ "615": 893,
2187
+ "616": 894,
2188
+ "618": 895,
2189
+ "619": 896,
2190
+ "620": 897,
2191
+ "621": 898,
2192
+ "622": 899,
2193
+ "623": 900,
2194
+ "624": 901,
2195
+ "625": 902,
2196
+ "626": 903,
2197
+ "627": 904,
2198
+ "628": 905,
2199
+ "629": 906,
2200
+ "630": 907,
2201
+ "631": 908,
2202
+ "632": 909,
2203
+ "633": 910,
2204
+ "634": 911,
2205
+ "635": 912,
2206
+ "636": 913,
2207
+ "637": 914,
2208
+ "638": 915,
2209
+ "64": 916,
2210
+ "640": 917,
2211
+ "641": 918,
2212
+ "643": 919,
2213
+ "645": 920,
2214
+ "646": 921,
2215
+ "647": 922,
2216
+ "648": 923,
2217
+ "649": 924,
2218
+ "65": 925,
2219
+ "650": 926,
2220
+ "651": 927,
2221
+ "652": 928,
2222
+ "653": 929,
2223
+ "654": 930,
2224
+ "655": 931,
2225
+ "656": 932,
2226
+ "657": 933,
2227
+ "658": 934,
2228
+ "659": 935,
2229
+ "660": 936,
2230
+ "661": 937,
2231
+ "662": 938,
2232
+ "663": 939,
2233
+ "664": 940,
2234
+ "665": 941,
2235
+ "666": 942,
2236
+ "667": 943,
2237
+ "668": 944,
2238
+ "669": 945,
2239
+ "67": 946,
2240
+ "670": 947,
2241
+ "671": 948,
2242
+ "672": 949,
2243
+ "673": 950,
2244
+ "675": 951,
2245
+ "676": 952,
2246
+ "677": 953,
2247
+ "679": 954,
2248
+ "680": 955,
2249
+ "681": 956,
2250
+ "682": 957,
2251
+ "683": 958,
2252
+ "684": 959,
2253
+ "685": 960,
2254
+ "686": 961,
2255
+ "687": 962,
2256
+ "688": 963,
2257
+ "689": 964,
2258
+ "69": 965,
2259
+ "690": 966,
2260
+ "691": 967,
2261
+ "692": 968,
2262
+ "694": 969,
2263
+ "695": 970,
2264
+ "696": 971,
2265
+ "697": 972,
2266
+ "698": 973,
2267
+ "699": 974,
2268
+ "7": 975,
2269
+ "70": 976,
2270
+ "700": 977,
2271
+ "701": 978,
2272
+ "702": 979,
2273
+ "703": 980,
2274
+ "704": 981,
2275
+ "705": 982,
2276
+ "706": 983,
2277
+ "707": 984,
2278
+ "708": 985,
2279
+ "709": 986,
2280
+ "71": 987,
2281
+ "710": 988,
2282
+ "711": 989,
2283
+ "712": 990,
2284
+ "713": 991,
2285
+ "714": 992,
2286
+ "72": 993,
2287
+ "721": 994,
2288
+ "722": 995,
2289
+ "723": 996,
2290
+ "724": 997,
2291
+ "725": 998,
2292
+ "726": 999,
2293
+ "727": 1000,
2294
+ "728": 1001,
2295
+ "729": 1002,
2296
+ "73": 1003,
2297
+ "730": 1004,
2298
+ "731": 1005,
2299
+ "732": 1006,
2300
+ "733": 1007,
2301
+ "734": 1008,
2302
+ "735": 1009,
2303
+ "736": 1010,
2304
+ "737": 1011,
2305
+ "738": 1012,
2306
+ "739": 1013,
2307
+ "740": 1014,
2308
+ "741": 1015,
2309
+ "742": 1016,
2310
+ "743": 1017,
2311
+ "744": 1018,
2312
+ "745": 1019,
2313
+ "746": 1020,
2314
+ "747": 1021,
2315
+ "748": 1022,
2316
+ "749": 1023,
2317
+ "75": 1024,
2318
+ "750": 1025,
2319
+ "752": 1026,
2320
+ "753": 1027,
2321
+ "754": 1028,
2322
+ "755": 1029,
2323
+ "756": 1030,
2324
+ "757": 1031,
2325
+ "758": 1032,
2326
+ "759": 1033,
2327
+ "76": 1034,
2328
+ "760": 1035,
2329
+ "761": 1036,
2330
+ "762": 1037,
2331
+ "763": 1038,
2332
+ "764": 1039,
2333
+ "765": 1040,
2334
+ "766": 1041,
2335
+ "767": 1042,
2336
+ "768": 1043,
2337
+ "769": 1044,
2338
+ "77": 1045,
2339
+ "770": 1046,
2340
+ "772": 1047,
2341
+ "773": 1048,
2342
+ "774": 1049,
2343
+ "775": 1050,
2344
+ "776": 1051,
2345
+ "777": 1052,
2346
+ "778": 1053,
2347
+ "779": 1054,
2348
+ "78": 1055,
2349
+ "780": 1056,
2350
+ "781": 1057,
2351
+ "782": 1058,
2352
+ "783": 1059,
2353
+ "784": 1060,
2354
+ "785": 1061,
2355
+ "786": 1062,
2356
+ "787": 1063,
2357
+ "788": 1064,
2358
+ "789": 1065,
2359
+ "79": 1066,
2360
+ "790": 1067,
2361
+ "791": 1068,
2362
+ "792": 1069,
2363
+ "793": 1070,
2364
+ "794": 1071,
2365
+ "795": 1072,
2366
+ "796": 1073,
2367
+ "797": 1074,
2368
+ "798": 1075,
2369
+ "8": 1076,
2370
+ "80": 1077,
2371
+ "800": 1078,
2372
+ "801": 1079,
2373
+ "802": 1080,
2374
+ "803": 1081,
2375
+ "804": 1082,
2376
+ "805": 1083,
2377
+ "806": 1084,
2378
+ "807": 1085,
2379
+ "808": 1086,
2380
+ "809": 1087,
2381
+ "81": 1088,
2382
+ "810": 1089,
2383
+ "811": 1090,
2384
+ "812": 1091,
2385
+ "813": 1092,
2386
+ "814": 1093,
2387
+ "815": 1094,
2388
+ "816": 1095,
2389
+ "817": 1096,
2390
+ "818": 1097,
2391
+ "819": 1098,
2392
+ "82": 1099,
2393
+ "820": 1100,
2394
+ "821": 1101,
2395
+ "822": 1102,
2396
+ "824": 1103,
2397
+ "825": 1104,
2398
+ "826": 1105,
2399
+ "827": 1106,
2400
+ "828": 1107,
2401
+ "829": 1108,
2402
+ "83": 1109,
2403
+ "830": 1110,
2404
+ "831": 1111,
2405
+ "832": 1112,
2406
+ "833": 1113,
2407
+ "834": 1114,
2408
+ "835": 1115,
2409
+ "836": 1116,
2410
+ "837": 1117,
2411
+ "838": 1118,
2412
+ "839": 1119,
2413
+ "84": 1120,
2414
+ "840": 1121,
2415
+ "841": 1122,
2416
+ "842": 1123,
2417
+ "843": 1124,
2418
+ "844": 1125,
2419
+ "845": 1126,
2420
+ "846": 1127,
2421
+ "847": 1128,
2422
+ "848": 1129,
2423
+ "849": 1130,
2424
+ "85": 1131,
2425
+ "850": 1132,
2426
+ "851": 1133,
2427
+ "852": 1134,
2428
+ "853": 1135,
2429
+ "854": 1136,
2430
+ "855": 1137,
2431
+ "856": 1138,
2432
+ "857": 1139,
2433
+ "858": 1140,
2434
+ "859": 1141,
2435
+ "86": 1142,
2436
+ "863": 1143,
2437
+ "864": 1144,
2438
+ "865": 1145,
2439
+ "866": 1146,
2440
+ "868": 1147,
2441
+ "87": 1148,
2442
+ "870": 1149,
2443
+ "871": 1150,
2444
+ "872": 1151,
2445
+ "873": 1152,
2446
+ "874": 1153,
2447
+ "875": 1154,
2448
+ "876": 1155,
2449
+ "877": 1156,
2450
+ "878": 1157,
2451
+ "879": 1158,
2452
+ "88": 1159,
2453
+ "880": 1160,
2454
+ "881": 1161,
2455
+ "882": 1162,
2456
+ "883": 1163,
2457
+ "884": 1164,
2458
+ "885": 1165,
2459
+ "886": 1166,
2460
+ "887": 1167,
2461
+ "888": 1168,
2462
+ "889": 1169,
2463
+ "89": 1170,
2464
+ "890": 1171,
2465
+ "891": 1172,
2466
+ "892": 1173,
2467
+ "893": 1174,
2468
+ "894": 1175,
2469
+ "895": 1176,
2470
+ "896": 1177,
2471
+ "897": 1178,
2472
+ "898": 1179,
2473
+ "899": 1180,
2474
+ "9": 1181,
2475
+ "90": 1182,
2476
+ "900": 1183,
2477
+ "901": 1184,
2478
+ "903": 1185,
2479
+ "906": 1186,
2480
+ "909": 1187,
2481
+ "910": 1188,
2482
+ "911": 1189,
2483
+ "912": 1190,
2484
+ "913": 1191,
2485
+ "914": 1192,
2486
+ "915": 1193,
2487
+ "916": 1194,
2488
+ "917": 1195,
2489
+ "918": 1196,
2490
+ "92": 1197,
2491
+ "921": 1198,
2492
+ "922": 1199,
2493
+ "923": 1200,
2494
+ "924": 1201,
2495
+ "925": 1202,
2496
+ "926": 1203,
2497
+ "927": 1204,
2498
+ "928": 1205,
2499
+ "929": 1206,
2500
+ "930": 1207,
2501
+ "931": 1208,
2502
+ "932": 1209,
2503
+ "933": 1210,
2504
+ "934": 1211,
2505
+ "935": 1212,
2506
+ "936": 1213,
2507
+ "937": 1214,
2508
+ "938": 1215,
2509
+ "939": 1216,
2510
+ "940": 1217,
2511
+ "941": 1218,
2512
+ "942": 1219,
2513
+ "943": 1220,
2514
+ "944": 1221,
2515
+ "945": 1222,
2516
+ "946": 1223,
2517
+ "947": 1224,
2518
+ "948": 1225,
2519
+ "949": 1226,
2520
+ "950": 1227,
2521
+ "951": 1228,
2522
+ "952": 1229,
2523
+ "953": 1230,
2524
+ "954": 1231,
2525
+ "955": 1232,
2526
+ "956": 1233,
2527
+ "957": 1234,
2528
+ "958": 1235,
2529
+ "959": 1236,
2530
+ "960": 1237,
2531
+ "961": 1238,
2532
+ "962": 1239,
2533
+ "963": 1240,
2534
+ "964": 1241,
2535
+ "965": 1242,
2536
+ "966": 1243,
2537
+ "967": 1244,
2538
+ "968": 1245,
2539
+ "969": 1246,
2540
+ "97": 1247,
2541
+ "970": 1248,
2542
+ "971": 1249,
2543
+ "972": 1250,
2544
+ "973": 1251,
2545
+ "974": 1252,
2546
+ "975": 1253,
2547
+ "976": 1254,
2548
+ "977": 1255,
2549
+ "978": 1256,
2550
+ "979": 1257,
2551
+ "980": 1258,
2552
+ "981": 1259,
2553
+ "982": 1260,
2554
+ "983": 1261,
2555
+ "984": 1262,
2556
+ "985": 1263,
2557
+ "986": 1264,
2558
+ "989": 1265,
2559
+ "99": 1266,
2560
+ "990": 1267,
2561
+ "991": 1268,
2562
+ "992": 1269,
2563
+ "993": 1270,
2564
+ "994": 1271,
2565
+ "995": 1272,
2566
+ "996": 1273,
2567
+ "997": 1274,
2568
+ "998": 1275,
2569
+ "999": 1276
2570
+ },
2571
+ "layer_norm_eps": 1e-12,
2572
+ "max_position_embeddings": 512,
2573
+ "model_type": "bert",
2574
+ "num_attention_heads": 12,
2575
+ "num_hidden_layers": 12,
2576
+ "pad_token_id": 0,
2577
+ "position_embedding_type": "absolute",
2578
+ "problem_type": "multi_label_classification",
2579
+ "torch_dtype": "float32",
2580
+ "transformers_version": "4.55.0",
2581
+ "type_vocab_size": 2,
2582
+ "use_cache": true,
2583
+ "vocab_size": 30522
2584
+ }
checkpoint-1125/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9ec7f48c6da35482d1900397f2b9cecb65f6907f442cede7654f96395777cff
3
+ size 441880548
checkpoint-1125/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a848484cb55f0818d5b346e65390bc173e2ceba0fe9778cfd82acb103770dd1d
3
+ size 883885323
checkpoint-1125/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a9ee7d02a2a848e3fc92670f9616c6c21e0e17b01852c5f8f866ae03f5ec5ed
3
+ size 14645
checkpoint-1125/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f482cf1339871055a48b1c746f58190de724fcc80f5557dcaca13894789285b3
3
+ size 1465
checkpoint-1125/special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
checkpoint-1125/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-1125/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "BertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
checkpoint-1125/trainer_state.json ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 1125,
3
+ "best_metric": 0.0007731728834392315,
4
+ "best_model_checkpoint": "trained/bert_multilabel_text_classifier/checkpoint-1125",
5
+ "epoch": 1.0,
6
+ "eval_steps": 500,
7
+ "global_step": 1125,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.044444444444444446,
14
+ "grad_norm": 0.25056546926498413,
15
+ "learning_rate": 1.9709629629629633e-05,
16
+ "loss": 0.5964,
17
+ "step": 50
18
+ },
19
+ {
20
+ "epoch": 0.08888888888888889,
21
+ "grad_norm": 0.17194914817810059,
22
+ "learning_rate": 1.9413333333333336e-05,
23
+ "loss": 0.3456,
24
+ "step": 100
25
+ },
26
+ {
27
+ "epoch": 0.13333333333333333,
28
+ "grad_norm": 0.11451203376054764,
29
+ "learning_rate": 1.911703703703704e-05,
30
+ "loss": 0.2025,
31
+ "step": 150
32
+ },
33
+ {
34
+ "epoch": 0.17777777777777778,
35
+ "grad_norm": 0.08061835914850235,
36
+ "learning_rate": 1.882074074074074e-05,
37
+ "loss": 0.1318,
38
+ "step": 200
39
+ },
40
+ {
41
+ "epoch": 0.2222222222222222,
42
+ "grad_norm": 0.05962532013654709,
43
+ "learning_rate": 1.8524444444444444e-05,
44
+ "loss": 0.0945,
45
+ "step": 250
46
+ },
47
+ {
48
+ "epoch": 0.26666666666666666,
49
+ "grad_norm": 0.047490622848272324,
50
+ "learning_rate": 1.822814814814815e-05,
51
+ "loss": 0.0726,
52
+ "step": 300
53
+ },
54
+ {
55
+ "epoch": 0.3111111111111111,
56
+ "grad_norm": 0.038484182208776474,
57
+ "learning_rate": 1.7931851851851853e-05,
58
+ "loss": 0.0585,
59
+ "step": 350
60
+ },
61
+ {
62
+ "epoch": 0.35555555555555557,
63
+ "grad_norm": 0.03241903707385063,
64
+ "learning_rate": 1.7635555555555555e-05,
65
+ "loss": 0.049,
66
+ "step": 400
67
+ },
68
+ {
69
+ "epoch": 0.4,
70
+ "grad_norm": 0.02833125926554203,
71
+ "learning_rate": 1.733925925925926e-05,
72
+ "loss": 0.0427,
73
+ "step": 450
74
+ },
75
+ {
76
+ "epoch": 0.4444444444444444,
77
+ "grad_norm": 0.024066274985671043,
78
+ "learning_rate": 1.7042962962962964e-05,
79
+ "loss": 0.037,
80
+ "step": 500
81
+ },
82
+ {
83
+ "epoch": 0.4888888888888889,
84
+ "grad_norm": 0.023793209344148636,
85
+ "learning_rate": 1.674666666666667e-05,
86
+ "loss": 0.0334,
87
+ "step": 550
88
+ },
89
+ {
90
+ "epoch": 0.5333333333333333,
91
+ "grad_norm": 0.025505442172288895,
92
+ "learning_rate": 1.6450370370370373e-05,
93
+ "loss": 0.0307,
94
+ "step": 600
95
+ },
96
+ {
97
+ "epoch": 0.5777777777777777,
98
+ "grad_norm": 0.023647351190447807,
99
+ "learning_rate": 1.6154074074074075e-05,
100
+ "loss": 0.0283,
101
+ "step": 650
102
+ },
103
+ {
104
+ "epoch": 0.6222222222222222,
105
+ "grad_norm": 0.018704526126384735,
106
+ "learning_rate": 1.5857777777777778e-05,
107
+ "loss": 0.0264,
108
+ "step": 700
109
+ },
110
+ {
111
+ "epoch": 0.6666666666666666,
112
+ "grad_norm": 0.020357510074973106,
113
+ "learning_rate": 1.556148148148148e-05,
114
+ "loss": 0.0252,
115
+ "step": 750
116
+ },
117
+ {
118
+ "epoch": 0.7111111111111111,
119
+ "grad_norm": 0.015282705426216125,
120
+ "learning_rate": 1.5265185185185187e-05,
121
+ "loss": 0.0232,
122
+ "step": 800
123
+ },
124
+ {
125
+ "epoch": 0.7555555555555555,
126
+ "grad_norm": 0.019114945083856583,
127
+ "learning_rate": 1.4968888888888891e-05,
128
+ "loss": 0.0223,
129
+ "step": 850
130
+ },
131
+ {
132
+ "epoch": 0.8,
133
+ "grad_norm": 0.016722247004508972,
134
+ "learning_rate": 1.4672592592592594e-05,
135
+ "loss": 0.0208,
136
+ "step": 900
137
+ },
138
+ {
139
+ "epoch": 0.8444444444444444,
140
+ "grad_norm": 0.016854777932167053,
141
+ "learning_rate": 1.4376296296296296e-05,
142
+ "loss": 0.02,
143
+ "step": 950
144
+ },
145
+ {
146
+ "epoch": 0.8888888888888888,
147
+ "grad_norm": 0.01701257936656475,
148
+ "learning_rate": 1.408e-05,
149
+ "loss": 0.0194,
150
+ "step": 1000
151
+ },
152
+ {
153
+ "epoch": 0.9333333333333333,
154
+ "grad_norm": 0.016065537929534912,
155
+ "learning_rate": 1.3783703703703705e-05,
156
+ "loss": 0.0187,
157
+ "step": 1050
158
+ },
159
+ {
160
+ "epoch": 0.9777777777777777,
161
+ "grad_norm": 0.01564837247133255,
162
+ "learning_rate": 1.348740740740741e-05,
163
+ "loss": 0.0187,
164
+ "step": 1100
165
+ },
166
+ {
167
+ "epoch": 1.0,
168
+ "eval_loss": 0.0170283243060112,
169
+ "eval_macro_f1": 0.0007731728834392315,
170
+ "eval_micro_f1": 0.38728897715988087,
171
+ "eval_runtime": 1.3725,
172
+ "eval_samples_per_second": 728.62,
173
+ "eval_steps_per_second": 91.077,
174
+ "eval_subset_accuracy": 0.001,
175
+ "step": 1125
176
+ }
177
+ ],
178
+ "logging_steps": 50,
179
+ "max_steps": 3375,
180
+ "num_input_tokens_seen": 0,
181
+ "num_train_epochs": 3,
182
+ "save_steps": 500,
183
+ "stateful_callbacks": {
184
+ "TrainerControl": {
185
+ "args": {
186
+ "should_epoch_stop": false,
187
+ "should_evaluate": false,
188
+ "should_log": false,
189
+ "should_save": true,
190
+ "should_training_stop": false
191
+ },
192
+ "attributes": {}
193
+ }
194
+ },
195
+ "total_flos": 2395107671040000.0,
196
+ "train_batch_size": 8,
197
+ "trial_name": null,
198
+ "trial_params": null
199
+ }
checkpoint-1125/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee46aba967c8873c2f61f80b1ad656e6b063317ea662c3d4695c8442bcd9f6da
3
+ size 5841
checkpoint-1125/vocab.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-2250/config.json ADDED
@@ -0,0 +1,2584 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertForSequenceClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "id2label": {
12
+ "0": "1",
13
+ "1": "10",
14
+ "2": "100",
15
+ "3": "1003",
16
+ "4": "1004",
17
+ "5": "1005",
18
+ "6": "1006",
19
+ "7": "1007",
20
+ "8": "1008",
21
+ "9": "1009",
22
+ "10": "101",
23
+ "11": "1010",
24
+ "12": "1011",
25
+ "13": "1012",
26
+ "14": "1013",
27
+ "15": "1014",
28
+ "16": "1017",
29
+ "17": "1018",
30
+ "18": "1019",
31
+ "19": "102",
32
+ "20": "1020",
33
+ "21": "1021",
34
+ "22": "1022",
35
+ "23": "1023",
36
+ "24": "103",
37
+ "25": "1034",
38
+ "26": "1035",
39
+ "27": "104",
40
+ "28": "1040",
41
+ "29": "1043",
42
+ "30": "1046",
43
+ "31": "1047",
44
+ "32": "1048",
45
+ "33": "105",
46
+ "34": "1050",
47
+ "35": "1051",
48
+ "36": "1052",
49
+ "37": "1053",
50
+ "38": "1054",
51
+ "39": "1055",
52
+ "40": "1056",
53
+ "41": "1058",
54
+ "42": "1059",
55
+ "43": "1060",
56
+ "44": "1062",
57
+ "45": "107",
58
+ "46": "1071",
59
+ "47": "1073",
60
+ "48": "108",
61
+ "49": "1084",
62
+ "50": "1086",
63
+ "51": "1097",
64
+ "52": "1099",
65
+ "53": "11",
66
+ "54": "110",
67
+ "55": "1100",
68
+ "56": "1106",
69
+ "57": "1147",
70
+ "58": "1148",
71
+ "59": "1149",
72
+ "60": "1150",
73
+ "61": "1151",
74
+ "62": "1152",
75
+ "63": "1154",
76
+ "64": "1156",
77
+ "65": "1157",
78
+ "66": "1158",
79
+ "67": "1160",
80
+ "68": "1161",
81
+ "69": "1162",
82
+ "70": "1166",
83
+ "71": "1167",
84
+ "72": "1169",
85
+ "73": "1170",
86
+ "74": "1171",
87
+ "75": "1172",
88
+ "76": "1173",
89
+ "77": "1174",
90
+ "78": "1175",
91
+ "79": "1177",
92
+ "80": "1178",
93
+ "81": "1179",
94
+ "82": "118",
95
+ "83": "1180",
96
+ "84": "1181",
97
+ "85": "1184",
98
+ "86": "1185",
99
+ "87": "1186",
100
+ "88": "1187",
101
+ "89": "1188",
102
+ "90": "1189",
103
+ "91": "119",
104
+ "92": "1190",
105
+ "93": "1191",
106
+ "94": "1192",
107
+ "95": "1193",
108
+ "96": "1195",
109
+ "97": "1196",
110
+ "98": "1198",
111
+ "99": "1199",
112
+ "100": "12",
113
+ "101": "120",
114
+ "102": "1201",
115
+ "103": "1202",
116
+ "104": "1203",
117
+ "105": "1204",
118
+ "106": "1205",
119
+ "107": "1206",
120
+ "108": "1207",
121
+ "109": "1208",
122
+ "110": "121",
123
+ "111": "1210",
124
+ "112": "1211",
125
+ "113": "1212",
126
+ "114": "1213",
127
+ "115": "1217",
128
+ "116": "1218",
129
+ "117": "122",
130
+ "118": "1222",
131
+ "119": "1223",
132
+ "120": "1224",
133
+ "121": "1225",
134
+ "122": "1226",
135
+ "123": "1229",
136
+ "124": "123",
137
+ "125": "1230",
138
+ "126": "1231",
139
+ "127": "1232",
140
+ "128": "1233",
141
+ "129": "1234",
142
+ "130": "1235",
143
+ "131": "1236",
144
+ "132": "1238",
145
+ "133": "1239",
146
+ "134": "124",
147
+ "135": "1240",
148
+ "136": "1241",
149
+ "137": "1242",
150
+ "138": "1243",
151
+ "139": "1244",
152
+ "140": "1245",
153
+ "141": "1246",
154
+ "142": "1247",
155
+ "143": "1248",
156
+ "144": "1249",
157
+ "145": "125",
158
+ "146": "1250",
159
+ "147": "1251",
160
+ "148": "1252",
161
+ "149": "1253",
162
+ "150": "1256",
163
+ "151": "1257",
164
+ "152": "1258",
165
+ "153": "1259",
166
+ "154": "126",
167
+ "155": "1260",
168
+ "156": "1261",
169
+ "157": "1262",
170
+ "158": "1263",
171
+ "159": "1264",
172
+ "160": "1266",
173
+ "161": "1267",
174
+ "162": "1268",
175
+ "163": "1269",
176
+ "164": "127",
177
+ "165": "1270",
178
+ "166": "1271",
179
+ "167": "1272",
180
+ "168": "1273",
181
+ "169": "1274",
182
+ "170": "1275",
183
+ "171": "1276",
184
+ "172": "1277",
185
+ "173": "1278",
186
+ "174": "1279",
187
+ "175": "128",
188
+ "176": "1280",
189
+ "177": "1281",
190
+ "178": "1282",
191
+ "179": "1283",
192
+ "180": "1284",
193
+ "181": "1285",
194
+ "182": "1287",
195
+ "183": "1288",
196
+ "184": "1289",
197
+ "185": "1290",
198
+ "186": "1291",
199
+ "187": "1292",
200
+ "188": "1293",
201
+ "189": "1294",
202
+ "190": "1295",
203
+ "191": "1296",
204
+ "192": "1297",
205
+ "193": "1298",
206
+ "194": "1299",
207
+ "195": "13",
208
+ "196": "1300",
209
+ "197": "1301",
210
+ "198": "1302",
211
+ "199": "1303",
212
+ "200": "1304",
213
+ "201": "1305",
214
+ "202": "1306",
215
+ "203": "1307",
216
+ "204": "1308",
217
+ "205": "1309",
218
+ "206": "1310",
219
+ "207": "1311",
220
+ "208": "1312",
221
+ "209": "1313",
222
+ "210": "1314",
223
+ "211": "1315",
224
+ "212": "1316",
225
+ "213": "1317",
226
+ "214": "1318",
227
+ "215": "1319",
228
+ "216": "1320",
229
+ "217": "1321",
230
+ "218": "1322",
231
+ "219": "1323",
232
+ "220": "1324",
233
+ "221": "1325",
234
+ "222": "1326",
235
+ "223": "1327",
236
+ "224": "1328",
237
+ "225": "1329",
238
+ "226": "133",
239
+ "227": "1330",
240
+ "228": "1331",
241
+ "229": "1333",
242
+ "230": "1334",
243
+ "231": "1336",
244
+ "232": "1340",
245
+ "233": "1341",
246
+ "234": "1342",
247
+ "235": "1343",
248
+ "236": "1346",
249
+ "237": "135",
250
+ "238": "1350",
251
+ "239": "1351",
252
+ "240": "1357",
253
+ "241": "1359",
254
+ "242": "136",
255
+ "243": "1361",
256
+ "244": "1362",
257
+ "245": "1363",
258
+ "246": "1364",
259
+ "247": "1365",
260
+ "248": "1367",
261
+ "249": "1368",
262
+ "250": "1369",
263
+ "251": "137",
264
+ "252": "1370",
265
+ "253": "1371",
266
+ "254": "1372",
267
+ "255": "1373",
268
+ "256": "1374",
269
+ "257": "1376",
270
+ "258": "1377",
271
+ "259": "1378",
272
+ "260": "1379",
273
+ "261": "138",
274
+ "262": "1380",
275
+ "263": "1382",
276
+ "264": "1383",
277
+ "265": "1384",
278
+ "266": "1385",
279
+ "267": "1386",
280
+ "268": "1387",
281
+ "269": "1388",
282
+ "270": "1389",
283
+ "271": "139",
284
+ "272": "1391",
285
+ "273": "1396",
286
+ "274": "1397",
287
+ "275": "1398",
288
+ "276": "1399",
289
+ "277": "14",
290
+ "278": "140",
291
+ "279": "1400",
292
+ "280": "1401",
293
+ "281": "1402",
294
+ "282": "1403",
295
+ "283": "141",
296
+ "284": "1413",
297
+ "285": "1415",
298
+ "286": "1416",
299
+ "287": "1417",
300
+ "288": "1419",
301
+ "289": "142",
302
+ "290": "1420",
303
+ "291": "1421",
304
+ "292": "1422",
305
+ "293": "1423",
306
+ "294": "1425",
307
+ "295": "1426",
308
+ "296": "1427",
309
+ "297": "1428",
310
+ "298": "1429",
311
+ "299": "143",
312
+ "300": "1430",
313
+ "301": "1431",
314
+ "302": "1432",
315
+ "303": "1433",
316
+ "304": "1438",
317
+ "305": "1439",
318
+ "306": "144",
319
+ "307": "1441",
320
+ "308": "1443",
321
+ "309": "1444",
322
+ "310": "1445",
323
+ "311": "1446",
324
+ "312": "1447",
325
+ "313": "1448",
326
+ "314": "1449",
327
+ "315": "145",
328
+ "316": "1450",
329
+ "317": "1451",
330
+ "318": "1452",
331
+ "319": "1453",
332
+ "320": "1454",
333
+ "321": "1455",
334
+ "322": "1456",
335
+ "323": "1457",
336
+ "324": "1458",
337
+ "325": "1459",
338
+ "326": "146",
339
+ "327": "1460",
340
+ "328": "1461",
341
+ "329": "1462",
342
+ "330": "1463",
343
+ "331": "1464",
344
+ "332": "1465",
345
+ "333": "1466",
346
+ "334": "1467",
347
+ "335": "1468",
348
+ "336": "1469",
349
+ "337": "147",
350
+ "338": "1470",
351
+ "339": "1471",
352
+ "340": "1473",
353
+ "341": "1474",
354
+ "342": "1475",
355
+ "343": "1476",
356
+ "344": "1477",
357
+ "345": "1478",
358
+ "346": "1479",
359
+ "347": "1480",
360
+ "348": "1481",
361
+ "349": "1482",
362
+ "350": "1483",
363
+ "351": "1484",
364
+ "352": "1485",
365
+ "353": "1486",
366
+ "354": "1487",
367
+ "355": "1488",
368
+ "356": "1489",
369
+ "357": "1490",
370
+ "358": "1491",
371
+ "359": "1492",
372
+ "360": "1493",
373
+ "361": "1494",
374
+ "362": "1495",
375
+ "363": "1496",
376
+ "364": "1497",
377
+ "365": "1498",
378
+ "366": "1499",
379
+ "367": "15",
380
+ "368": "1500",
381
+ "369": "1501",
382
+ "370": "1502",
383
+ "371": "1507",
384
+ "372": "1509",
385
+ "373": "1510",
386
+ "374": "1511",
387
+ "375": "1512",
388
+ "376": "1513",
389
+ "377": "1514",
390
+ "378": "1515",
391
+ "379": "1516",
392
+ "380": "1517",
393
+ "381": "1518",
394
+ "382": "1519",
395
+ "383": "152",
396
+ "384": "1520",
397
+ "385": "1521",
398
+ "386": "1522",
399
+ "387": "1523",
400
+ "388": "1524",
401
+ "389": "1525",
402
+ "390": "1526",
403
+ "391": "1527",
404
+ "392": "1528",
405
+ "393": "1529",
406
+ "394": "153",
407
+ "395": "1530",
408
+ "396": "1531",
409
+ "397": "1532",
410
+ "398": "1533",
411
+ "399": "1534",
412
+ "400": "1535",
413
+ "401": "1536",
414
+ "402": "1537",
415
+ "403": "1538",
416
+ "404": "1539",
417
+ "405": "154",
418
+ "406": "1540",
419
+ "407": "1541",
420
+ "408": "1542",
421
+ "409": "1543",
422
+ "410": "1544",
423
+ "411": "1545",
424
+ "412": "1546",
425
+ "413": "1547",
426
+ "414": "1548",
427
+ "415": "1549",
428
+ "416": "155",
429
+ "417": "1550",
430
+ "418": "1551",
431
+ "419": "1552",
432
+ "420": "1553",
433
+ "421": "1554",
434
+ "422": "1555",
435
+ "423": "1556",
436
+ "424": "1557",
437
+ "425": "1558",
438
+ "426": "1559",
439
+ "427": "1560",
440
+ "428": "1561",
441
+ "429": "1562",
442
+ "430": "1563",
443
+ "431": "1564",
444
+ "432": "1565",
445
+ "433": "1566",
446
+ "434": "1567",
447
+ "435": "1568",
448
+ "436": "1569",
449
+ "437": "157",
450
+ "438": "1570",
451
+ "439": "1571",
452
+ "440": "1572",
453
+ "441": "1573",
454
+ "442": "1574",
455
+ "443": "1575",
456
+ "444": "1576",
457
+ "445": "1577",
458
+ "446": "1578",
459
+ "447": "1579",
460
+ "448": "158",
461
+ "449": "1580",
462
+ "450": "1581",
463
+ "451": "1582",
464
+ "452": "1583",
465
+ "453": "1584",
466
+ "454": "1585",
467
+ "455": "1586",
468
+ "456": "159",
469
+ "457": "160",
470
+ "458": "162",
471
+ "459": "163",
472
+ "460": "164",
473
+ "461": "165",
474
+ "462": "166",
475
+ "463": "167",
476
+ "464": "168",
477
+ "465": "169",
478
+ "466": "17",
479
+ "467": "170",
480
+ "468": "171",
481
+ "469": "172",
482
+ "470": "173",
483
+ "471": "174",
484
+ "472": "175",
485
+ "473": "177",
486
+ "474": "178",
487
+ "475": "179",
488
+ "476": "18",
489
+ "477": "180",
490
+ "478": "181",
491
+ "479": "182",
492
+ "480": "19",
493
+ "481": "192",
494
+ "482": "193",
495
+ "483": "194",
496
+ "484": "195",
497
+ "485": "197",
498
+ "486": "199",
499
+ "487": "20",
500
+ "488": "200",
501
+ "489": "202",
502
+ "490": "203",
503
+ "491": "204",
504
+ "492": "205",
505
+ "493": "206",
506
+ "494": "207",
507
+ "495": "208",
508
+ "496": "209",
509
+ "497": "210",
510
+ "498": "211",
511
+ "499": "212",
512
+ "500": "213",
513
+ "501": "214",
514
+ "502": "215",
515
+ "503": "216",
516
+ "504": "217",
517
+ "505": "218",
518
+ "506": "219",
519
+ "507": "22",
520
+ "508": "220",
521
+ "509": "221",
522
+ "510": "222",
523
+ "511": "223",
524
+ "512": "224",
525
+ "513": "225",
526
+ "514": "226",
527
+ "515": "227",
528
+ "516": "229",
529
+ "517": "23",
530
+ "518": "230",
531
+ "519": "231",
532
+ "520": "232",
533
+ "521": "233",
534
+ "522": "234",
535
+ "523": "236",
536
+ "524": "237",
537
+ "525": "238",
538
+ "526": "239",
539
+ "527": "24",
540
+ "528": "240",
541
+ "529": "241",
542
+ "530": "242",
543
+ "531": "243",
544
+ "532": "244",
545
+ "533": "245",
546
+ "534": "246",
547
+ "535": "247",
548
+ "536": "248",
549
+ "537": "249",
550
+ "538": "25",
551
+ "539": "250",
552
+ "540": "251",
553
+ "541": "252",
554
+ "542": "253",
555
+ "543": "254",
556
+ "544": "255",
557
+ "545": "256",
558
+ "546": "257",
559
+ "547": "259",
560
+ "548": "26",
561
+ "549": "260",
562
+ "550": "261",
563
+ "551": "262",
564
+ "552": "27",
565
+ "553": "28",
566
+ "554": "288",
567
+ "555": "289",
568
+ "556": "29",
569
+ "557": "290",
570
+ "558": "291",
571
+ "559": "292",
572
+ "560": "293",
573
+ "561": "294",
574
+ "562": "295",
575
+ "563": "296",
576
+ "564": "297",
577
+ "565": "298",
578
+ "566": "30",
579
+ "567": "300",
580
+ "568": "301",
581
+ "569": "302",
582
+ "570": "303",
583
+ "571": "304",
584
+ "572": "306",
585
+ "573": "307",
586
+ "574": "308",
587
+ "575": "309",
588
+ "576": "31",
589
+ "577": "310",
590
+ "578": "311",
591
+ "579": "312",
592
+ "580": "313",
593
+ "581": "315",
594
+ "582": "317",
595
+ "583": "318",
596
+ "584": "319",
597
+ "585": "32",
598
+ "586": "320",
599
+ "587": "321",
600
+ "588": "322",
601
+ "589": "323",
602
+ "590": "324",
603
+ "591": "325",
604
+ "592": "326",
605
+ "593": "327",
606
+ "594": "328",
607
+ "595": "329",
608
+ "596": "33",
609
+ "597": "330",
610
+ "598": "331",
611
+ "599": "332",
612
+ "600": "333",
613
+ "601": "334",
614
+ "602": "335",
615
+ "603": "336",
616
+ "604": "337",
617
+ "605": "338",
618
+ "606": "339",
619
+ "607": "34",
620
+ "608": "340",
621
+ "609": "341",
622
+ "610": "342",
623
+ "611": "343",
624
+ "612": "344",
625
+ "613": "345",
626
+ "614": "349",
627
+ "615": "35",
628
+ "616": "350",
629
+ "617": "351",
630
+ "618": "352",
631
+ "619": "353",
632
+ "620": "354",
633
+ "621": "355",
634
+ "622": "356",
635
+ "623": "358",
636
+ "624": "359",
637
+ "625": "36",
638
+ "626": "361",
639
+ "627": "362",
640
+ "628": "363",
641
+ "629": "364",
642
+ "630": "365",
643
+ "631": "366",
644
+ "632": "367",
645
+ "633": "368",
646
+ "634": "369",
647
+ "635": "37",
648
+ "636": "370",
649
+ "637": "371",
650
+ "638": "372",
651
+ "639": "373",
652
+ "640": "374",
653
+ "641": "375",
654
+ "642": "376",
655
+ "643": "377",
656
+ "644": "378",
657
+ "645": "379",
658
+ "646": "38",
659
+ "647": "380",
660
+ "648": "381",
661
+ "649": "382",
662
+ "650": "383",
663
+ "651": "384",
664
+ "652": "385",
665
+ "653": "386",
666
+ "654": "387",
667
+ "655": "388",
668
+ "656": "389",
669
+ "657": "39",
670
+ "658": "390",
671
+ "659": "391",
672
+ "660": "392",
673
+ "661": "393",
674
+ "662": "394",
675
+ "663": "395",
676
+ "664": "396",
677
+ "665": "397",
678
+ "666": "398",
679
+ "667": "399",
680
+ "668": "4",
681
+ "669": "40",
682
+ "670": "400",
683
+ "671": "401",
684
+ "672": "402",
685
+ "673": "403",
686
+ "674": "404",
687
+ "675": "405",
688
+ "676": "406",
689
+ "677": "407",
690
+ "678": "409",
691
+ "679": "41",
692
+ "680": "411",
693
+ "681": "412",
694
+ "682": "414",
695
+ "683": "415",
696
+ "684": "416",
697
+ "685": "418",
698
+ "686": "419",
699
+ "687": "42",
700
+ "688": "420",
701
+ "689": "421",
702
+ "690": "422",
703
+ "691": "423",
704
+ "692": "424",
705
+ "693": "425",
706
+ "694": "426",
707
+ "695": "427",
708
+ "696": "429",
709
+ "697": "43",
710
+ "698": "430",
711
+ "699": "431",
712
+ "700": "432",
713
+ "701": "433",
714
+ "702": "434",
715
+ "703": "435",
716
+ "704": "436",
717
+ "705": "437",
718
+ "706": "438",
719
+ "707": "439",
720
+ "708": "44",
721
+ "709": "440",
722
+ "710": "441",
723
+ "711": "442",
724
+ "712": "443",
725
+ "713": "444",
726
+ "714": "445",
727
+ "715": "446",
728
+ "716": "447",
729
+ "717": "448",
730
+ "718": "449",
731
+ "719": "45",
732
+ "720": "450",
733
+ "721": "451",
734
+ "722": "452",
735
+ "723": "453",
736
+ "724": "454",
737
+ "725": "455",
738
+ "726": "456",
739
+ "727": "457",
740
+ "728": "458",
741
+ "729": "459",
742
+ "730": "46",
743
+ "731": "460",
744
+ "732": "461",
745
+ "733": "462",
746
+ "734": "463",
747
+ "735": "464",
748
+ "736": "465",
749
+ "737": "466",
750
+ "738": "467",
751
+ "739": "468",
752
+ "740": "469",
753
+ "741": "47",
754
+ "742": "470",
755
+ "743": "471",
756
+ "744": "472",
757
+ "745": "473",
758
+ "746": "474",
759
+ "747": "475",
760
+ "748": "476",
761
+ "749": "477",
762
+ "750": "478",
763
+ "751": "479",
764
+ "752": "480",
765
+ "753": "481",
766
+ "754": "482",
767
+ "755": "483",
768
+ "756": "484",
769
+ "757": "485",
770
+ "758": "486",
771
+ "759": "487",
772
+ "760": "488",
773
+ "761": "489",
774
+ "762": "49",
775
+ "763": "490",
776
+ "764": "491",
777
+ "765": "492",
778
+ "766": "493",
779
+ "767": "494",
780
+ "768": "495",
781
+ "769": "496",
782
+ "770": "497",
783
+ "771": "499",
784
+ "772": "5",
785
+ "773": "50",
786
+ "774": "500",
787
+ "775": "501",
788
+ "776": "502",
789
+ "777": "503",
790
+ "778": "504",
791
+ "779": "505",
792
+ "780": "506",
793
+ "781": "507",
794
+ "782": "508",
795
+ "783": "509",
796
+ "784": "51",
797
+ "785": "510",
798
+ "786": "511",
799
+ "787": "512",
800
+ "788": "513",
801
+ "789": "514",
802
+ "790": "515",
803
+ "791": "516",
804
+ "792": "517",
805
+ "793": "518",
806
+ "794": "519",
807
+ "795": "52",
808
+ "796": "520",
809
+ "797": "521",
810
+ "798": "522",
811
+ "799": "523",
812
+ "800": "524",
813
+ "801": "525",
814
+ "802": "526",
815
+ "803": "527",
816
+ "804": "528",
817
+ "805": "529",
818
+ "806": "53",
819
+ "807": "530",
820
+ "808": "531",
821
+ "809": "532",
822
+ "810": "533",
823
+ "811": "534",
824
+ "812": "535",
825
+ "813": "536",
826
+ "814": "537",
827
+ "815": "538",
828
+ "816": "539",
829
+ "817": "54",
830
+ "818": "540",
831
+ "819": "541",
832
+ "820": "542",
833
+ "821": "543",
834
+ "822": "544",
835
+ "823": "546",
836
+ "824": "547",
837
+ "825": "548",
838
+ "826": "549",
839
+ "827": "55",
840
+ "828": "550",
841
+ "829": "551",
842
+ "830": "552",
843
+ "831": "553",
844
+ "832": "554",
845
+ "833": "555",
846
+ "834": "556",
847
+ "835": "557",
848
+ "836": "558",
849
+ "837": "559",
850
+ "838": "56",
851
+ "839": "560",
852
+ "840": "561",
853
+ "841": "562",
854
+ "842": "563",
855
+ "843": "564",
856
+ "844": "565",
857
+ "845": "566",
858
+ "846": "567",
859
+ "847": "568",
860
+ "848": "569",
861
+ "849": "57",
862
+ "850": "570",
863
+ "851": "571",
864
+ "852": "572",
865
+ "853": "573",
866
+ "854": "574",
867
+ "855": "575",
868
+ "856": "576",
869
+ "857": "577",
870
+ "858": "578",
871
+ "859": "579",
872
+ "860": "580",
873
+ "861": "581",
874
+ "862": "582",
875
+ "863": "583",
876
+ "864": "584",
877
+ "865": "585",
878
+ "866": "586",
879
+ "867": "587",
880
+ "868": "588",
881
+ "869": "589",
882
+ "870": "591",
883
+ "871": "593",
884
+ "872": "594",
885
+ "873": "595",
886
+ "874": "597",
887
+ "875": "598",
888
+ "876": "599",
889
+ "877": "6",
890
+ "878": "600",
891
+ "879": "601",
892
+ "880": "602",
893
+ "881": "603",
894
+ "882": "604",
895
+ "883": "605",
896
+ "884": "606",
897
+ "885": "607",
898
+ "886": "608",
899
+ "887": "609",
900
+ "888": "610",
901
+ "889": "611",
902
+ "890": "612",
903
+ "891": "613",
904
+ "892": "614",
905
+ "893": "615",
906
+ "894": "616",
907
+ "895": "618",
908
+ "896": "619",
909
+ "897": "620",
910
+ "898": "621",
911
+ "899": "622",
912
+ "900": "623",
913
+ "901": "624",
914
+ "902": "625",
915
+ "903": "626",
916
+ "904": "627",
917
+ "905": "628",
918
+ "906": "629",
919
+ "907": "630",
920
+ "908": "631",
921
+ "909": "632",
922
+ "910": "633",
923
+ "911": "634",
924
+ "912": "635",
925
+ "913": "636",
926
+ "914": "637",
927
+ "915": "638",
928
+ "916": "64",
929
+ "917": "640",
930
+ "918": "641",
931
+ "919": "643",
932
+ "920": "645",
933
+ "921": "646",
934
+ "922": "647",
935
+ "923": "648",
936
+ "924": "649",
937
+ "925": "65",
938
+ "926": "650",
939
+ "927": "651",
940
+ "928": "652",
941
+ "929": "653",
942
+ "930": "654",
943
+ "931": "655",
944
+ "932": "656",
945
+ "933": "657",
946
+ "934": "658",
947
+ "935": "659",
948
+ "936": "660",
949
+ "937": "661",
950
+ "938": "662",
951
+ "939": "663",
952
+ "940": "664",
953
+ "941": "665",
954
+ "942": "666",
955
+ "943": "667",
956
+ "944": "668",
957
+ "945": "669",
958
+ "946": "67",
959
+ "947": "670",
960
+ "948": "671",
961
+ "949": "672",
962
+ "950": "673",
963
+ "951": "675",
964
+ "952": "676",
965
+ "953": "677",
966
+ "954": "679",
967
+ "955": "680",
968
+ "956": "681",
969
+ "957": "682",
970
+ "958": "683",
971
+ "959": "684",
972
+ "960": "685",
973
+ "961": "686",
974
+ "962": "687",
975
+ "963": "688",
976
+ "964": "689",
977
+ "965": "69",
978
+ "966": "690",
979
+ "967": "691",
980
+ "968": "692",
981
+ "969": "694",
982
+ "970": "695",
983
+ "971": "696",
984
+ "972": "697",
985
+ "973": "698",
986
+ "974": "699",
987
+ "975": "7",
988
+ "976": "70",
989
+ "977": "700",
990
+ "978": "701",
991
+ "979": "702",
992
+ "980": "703",
993
+ "981": "704",
994
+ "982": "705",
995
+ "983": "706",
996
+ "984": "707",
997
+ "985": "708",
998
+ "986": "709",
999
+ "987": "71",
1000
+ "988": "710",
1001
+ "989": "711",
1002
+ "990": "712",
1003
+ "991": "713",
1004
+ "992": "714",
1005
+ "993": "72",
1006
+ "994": "721",
1007
+ "995": "722",
1008
+ "996": "723",
1009
+ "997": "724",
1010
+ "998": "725",
1011
+ "999": "726",
1012
+ "1000": "727",
1013
+ "1001": "728",
1014
+ "1002": "729",
1015
+ "1003": "73",
1016
+ "1004": "730",
1017
+ "1005": "731",
1018
+ "1006": "732",
1019
+ "1007": "733",
1020
+ "1008": "734",
1021
+ "1009": "735",
1022
+ "1010": "736",
1023
+ "1011": "737",
1024
+ "1012": "738",
1025
+ "1013": "739",
1026
+ "1014": "740",
1027
+ "1015": "741",
1028
+ "1016": "742",
1029
+ "1017": "743",
1030
+ "1018": "744",
1031
+ "1019": "745",
1032
+ "1020": "746",
1033
+ "1021": "747",
1034
+ "1022": "748",
1035
+ "1023": "749",
1036
+ "1024": "75",
1037
+ "1025": "750",
1038
+ "1026": "752",
1039
+ "1027": "753",
1040
+ "1028": "754",
1041
+ "1029": "755",
1042
+ "1030": "756",
1043
+ "1031": "757",
1044
+ "1032": "758",
1045
+ "1033": "759",
1046
+ "1034": "76",
1047
+ "1035": "760",
1048
+ "1036": "761",
1049
+ "1037": "762",
1050
+ "1038": "763",
1051
+ "1039": "764",
1052
+ "1040": "765",
1053
+ "1041": "766",
1054
+ "1042": "767",
1055
+ "1043": "768",
1056
+ "1044": "769",
1057
+ "1045": "77",
1058
+ "1046": "770",
1059
+ "1047": "772",
1060
+ "1048": "773",
1061
+ "1049": "774",
1062
+ "1050": "775",
1063
+ "1051": "776",
1064
+ "1052": "777",
1065
+ "1053": "778",
1066
+ "1054": "779",
1067
+ "1055": "78",
1068
+ "1056": "780",
1069
+ "1057": "781",
1070
+ "1058": "782",
1071
+ "1059": "783",
1072
+ "1060": "784",
1073
+ "1061": "785",
1074
+ "1062": "786",
1075
+ "1063": "787",
1076
+ "1064": "788",
1077
+ "1065": "789",
1078
+ "1066": "79",
1079
+ "1067": "790",
1080
+ "1068": "791",
1081
+ "1069": "792",
1082
+ "1070": "793",
1083
+ "1071": "794",
1084
+ "1072": "795",
1085
+ "1073": "796",
1086
+ "1074": "797",
1087
+ "1075": "798",
1088
+ "1076": "8",
1089
+ "1077": "80",
1090
+ "1078": "800",
1091
+ "1079": "801",
1092
+ "1080": "802",
1093
+ "1081": "803",
1094
+ "1082": "804",
1095
+ "1083": "805",
1096
+ "1084": "806",
1097
+ "1085": "807",
1098
+ "1086": "808",
1099
+ "1087": "809",
1100
+ "1088": "81",
1101
+ "1089": "810",
1102
+ "1090": "811",
1103
+ "1091": "812",
1104
+ "1092": "813",
1105
+ "1093": "814",
1106
+ "1094": "815",
1107
+ "1095": "816",
1108
+ "1096": "817",
1109
+ "1097": "818",
1110
+ "1098": "819",
1111
+ "1099": "82",
1112
+ "1100": "820",
1113
+ "1101": "821",
1114
+ "1102": "822",
1115
+ "1103": "824",
1116
+ "1104": "825",
1117
+ "1105": "826",
1118
+ "1106": "827",
1119
+ "1107": "828",
1120
+ "1108": "829",
1121
+ "1109": "83",
1122
+ "1110": "830",
1123
+ "1111": "831",
1124
+ "1112": "832",
1125
+ "1113": "833",
1126
+ "1114": "834",
1127
+ "1115": "835",
1128
+ "1116": "836",
1129
+ "1117": "837",
1130
+ "1118": "838",
1131
+ "1119": "839",
1132
+ "1120": "84",
1133
+ "1121": "840",
1134
+ "1122": "841",
1135
+ "1123": "842",
1136
+ "1124": "843",
1137
+ "1125": "844",
1138
+ "1126": "845",
1139
+ "1127": "846",
1140
+ "1128": "847",
1141
+ "1129": "848",
1142
+ "1130": "849",
1143
+ "1131": "85",
1144
+ "1132": "850",
1145
+ "1133": "851",
1146
+ "1134": "852",
1147
+ "1135": "853",
1148
+ "1136": "854",
1149
+ "1137": "855",
1150
+ "1138": "856",
1151
+ "1139": "857",
1152
+ "1140": "858",
1153
+ "1141": "859",
1154
+ "1142": "86",
1155
+ "1143": "863",
1156
+ "1144": "864",
1157
+ "1145": "865",
1158
+ "1146": "866",
1159
+ "1147": "868",
1160
+ "1148": "87",
1161
+ "1149": "870",
1162
+ "1150": "871",
1163
+ "1151": "872",
1164
+ "1152": "873",
1165
+ "1153": "874",
1166
+ "1154": "875",
1167
+ "1155": "876",
1168
+ "1156": "877",
1169
+ "1157": "878",
1170
+ "1158": "879",
1171
+ "1159": "88",
1172
+ "1160": "880",
1173
+ "1161": "881",
1174
+ "1162": "882",
1175
+ "1163": "883",
1176
+ "1164": "884",
1177
+ "1165": "885",
1178
+ "1166": "886",
1179
+ "1167": "887",
1180
+ "1168": "888",
1181
+ "1169": "889",
1182
+ "1170": "89",
1183
+ "1171": "890",
1184
+ "1172": "891",
1185
+ "1173": "892",
1186
+ "1174": "893",
1187
+ "1175": "894",
1188
+ "1176": "895",
1189
+ "1177": "896",
1190
+ "1178": "897",
1191
+ "1179": "898",
1192
+ "1180": "899",
1193
+ "1181": "9",
1194
+ "1182": "90",
1195
+ "1183": "900",
1196
+ "1184": "901",
1197
+ "1185": "903",
1198
+ "1186": "906",
1199
+ "1187": "909",
1200
+ "1188": "910",
1201
+ "1189": "911",
1202
+ "1190": "912",
1203
+ "1191": "913",
1204
+ "1192": "914",
1205
+ "1193": "915",
1206
+ "1194": "916",
1207
+ "1195": "917",
1208
+ "1196": "918",
1209
+ "1197": "92",
1210
+ "1198": "921",
1211
+ "1199": "922",
1212
+ "1200": "923",
1213
+ "1201": "924",
1214
+ "1202": "925",
1215
+ "1203": "926",
1216
+ "1204": "927",
1217
+ "1205": "928",
1218
+ "1206": "929",
1219
+ "1207": "930",
1220
+ "1208": "931",
1221
+ "1209": "932",
1222
+ "1210": "933",
1223
+ "1211": "934",
1224
+ "1212": "935",
1225
+ "1213": "936",
1226
+ "1214": "937",
1227
+ "1215": "938",
1228
+ "1216": "939",
1229
+ "1217": "940",
1230
+ "1218": "941",
1231
+ "1219": "942",
1232
+ "1220": "943",
1233
+ "1221": "944",
1234
+ "1222": "945",
1235
+ "1223": "946",
1236
+ "1224": "947",
1237
+ "1225": "948",
1238
+ "1226": "949",
1239
+ "1227": "950",
1240
+ "1228": "951",
1241
+ "1229": "952",
1242
+ "1230": "953",
1243
+ "1231": "954",
1244
+ "1232": "955",
1245
+ "1233": "956",
1246
+ "1234": "957",
1247
+ "1235": "958",
1248
+ "1236": "959",
1249
+ "1237": "960",
1250
+ "1238": "961",
1251
+ "1239": "962",
1252
+ "1240": "963",
1253
+ "1241": "964",
1254
+ "1242": "965",
1255
+ "1243": "966",
1256
+ "1244": "967",
1257
+ "1245": "968",
1258
+ "1246": "969",
1259
+ "1247": "97",
1260
+ "1248": "970",
1261
+ "1249": "971",
1262
+ "1250": "972",
1263
+ "1251": "973",
1264
+ "1252": "974",
1265
+ "1253": "975",
1266
+ "1254": "976",
1267
+ "1255": "977",
1268
+ "1256": "978",
1269
+ "1257": "979",
1270
+ "1258": "980",
1271
+ "1259": "981",
1272
+ "1260": "982",
1273
+ "1261": "983",
1274
+ "1262": "984",
1275
+ "1263": "985",
1276
+ "1264": "986",
1277
+ "1265": "989",
1278
+ "1266": "99",
1279
+ "1267": "990",
1280
+ "1268": "991",
1281
+ "1269": "992",
1282
+ "1270": "993",
1283
+ "1271": "994",
1284
+ "1272": "995",
1285
+ "1273": "996",
1286
+ "1274": "997",
1287
+ "1275": "998",
1288
+ "1276": "999"
1289
+ },
1290
+ "initializer_range": 0.02,
1291
+ "intermediate_size": 3072,
1292
+ "label2id": {
1293
+ "1": 0,
1294
+ "10": 1,
1295
+ "100": 2,
1296
+ "1003": 3,
1297
+ "1004": 4,
1298
+ "1005": 5,
1299
+ "1006": 6,
1300
+ "1007": 7,
1301
+ "1008": 8,
1302
+ "1009": 9,
1303
+ "101": 10,
1304
+ "1010": 11,
1305
+ "1011": 12,
1306
+ "1012": 13,
1307
+ "1013": 14,
1308
+ "1014": 15,
1309
+ "1017": 16,
1310
+ "1018": 17,
1311
+ "1019": 18,
1312
+ "102": 19,
1313
+ "1020": 20,
1314
+ "1021": 21,
1315
+ "1022": 22,
1316
+ "1023": 23,
1317
+ "103": 24,
1318
+ "1034": 25,
1319
+ "1035": 26,
1320
+ "104": 27,
1321
+ "1040": 28,
1322
+ "1043": 29,
1323
+ "1046": 30,
1324
+ "1047": 31,
1325
+ "1048": 32,
1326
+ "105": 33,
1327
+ "1050": 34,
1328
+ "1051": 35,
1329
+ "1052": 36,
1330
+ "1053": 37,
1331
+ "1054": 38,
1332
+ "1055": 39,
1333
+ "1056": 40,
1334
+ "1058": 41,
1335
+ "1059": 42,
1336
+ "1060": 43,
1337
+ "1062": 44,
1338
+ "107": 45,
1339
+ "1071": 46,
1340
+ "1073": 47,
1341
+ "108": 48,
1342
+ "1084": 49,
1343
+ "1086": 50,
1344
+ "1097": 51,
1345
+ "1099": 52,
1346
+ "11": 53,
1347
+ "110": 54,
1348
+ "1100": 55,
1349
+ "1106": 56,
1350
+ "1147": 57,
1351
+ "1148": 58,
1352
+ "1149": 59,
1353
+ "1150": 60,
1354
+ "1151": 61,
1355
+ "1152": 62,
1356
+ "1154": 63,
1357
+ "1156": 64,
1358
+ "1157": 65,
1359
+ "1158": 66,
1360
+ "1160": 67,
1361
+ "1161": 68,
1362
+ "1162": 69,
1363
+ "1166": 70,
1364
+ "1167": 71,
1365
+ "1169": 72,
1366
+ "1170": 73,
1367
+ "1171": 74,
1368
+ "1172": 75,
1369
+ "1173": 76,
1370
+ "1174": 77,
1371
+ "1175": 78,
1372
+ "1177": 79,
1373
+ "1178": 80,
1374
+ "1179": 81,
1375
+ "118": 82,
1376
+ "1180": 83,
1377
+ "1181": 84,
1378
+ "1184": 85,
1379
+ "1185": 86,
1380
+ "1186": 87,
1381
+ "1187": 88,
1382
+ "1188": 89,
1383
+ "1189": 90,
1384
+ "119": 91,
1385
+ "1190": 92,
1386
+ "1191": 93,
1387
+ "1192": 94,
1388
+ "1193": 95,
1389
+ "1195": 96,
1390
+ "1196": 97,
1391
+ "1198": 98,
1392
+ "1199": 99,
1393
+ "12": 100,
1394
+ "120": 101,
1395
+ "1201": 102,
1396
+ "1202": 103,
1397
+ "1203": 104,
1398
+ "1204": 105,
1399
+ "1205": 106,
1400
+ "1206": 107,
1401
+ "1207": 108,
1402
+ "1208": 109,
1403
+ "121": 110,
1404
+ "1210": 111,
1405
+ "1211": 112,
1406
+ "1212": 113,
1407
+ "1213": 114,
1408
+ "1217": 115,
1409
+ "1218": 116,
1410
+ "122": 117,
1411
+ "1222": 118,
1412
+ "1223": 119,
1413
+ "1224": 120,
1414
+ "1225": 121,
1415
+ "1226": 122,
1416
+ "1229": 123,
1417
+ "123": 124,
1418
+ "1230": 125,
1419
+ "1231": 126,
1420
+ "1232": 127,
1421
+ "1233": 128,
1422
+ "1234": 129,
1423
+ "1235": 130,
1424
+ "1236": 131,
1425
+ "1238": 132,
1426
+ "1239": 133,
1427
+ "124": 134,
1428
+ "1240": 135,
1429
+ "1241": 136,
1430
+ "1242": 137,
1431
+ "1243": 138,
1432
+ "1244": 139,
1433
+ "1245": 140,
1434
+ "1246": 141,
1435
+ "1247": 142,
1436
+ "1248": 143,
1437
+ "1249": 144,
1438
+ "125": 145,
1439
+ "1250": 146,
1440
+ "1251": 147,
1441
+ "1252": 148,
1442
+ "1253": 149,
1443
+ "1256": 150,
1444
+ "1257": 151,
1445
+ "1258": 152,
1446
+ "1259": 153,
1447
+ "126": 154,
1448
+ "1260": 155,
1449
+ "1261": 156,
1450
+ "1262": 157,
1451
+ "1263": 158,
1452
+ "1264": 159,
1453
+ "1266": 160,
1454
+ "1267": 161,
1455
+ "1268": 162,
1456
+ "1269": 163,
1457
+ "127": 164,
1458
+ "1270": 165,
1459
+ "1271": 166,
1460
+ "1272": 167,
1461
+ "1273": 168,
1462
+ "1274": 169,
1463
+ "1275": 170,
1464
+ "1276": 171,
1465
+ "1277": 172,
1466
+ "1278": 173,
1467
+ "1279": 174,
1468
+ "128": 175,
1469
+ "1280": 176,
1470
+ "1281": 177,
1471
+ "1282": 178,
1472
+ "1283": 179,
1473
+ "1284": 180,
1474
+ "1285": 181,
1475
+ "1287": 182,
1476
+ "1288": 183,
1477
+ "1289": 184,
1478
+ "1290": 185,
1479
+ "1291": 186,
1480
+ "1292": 187,
1481
+ "1293": 188,
1482
+ "1294": 189,
1483
+ "1295": 190,
1484
+ "1296": 191,
1485
+ "1297": 192,
1486
+ "1298": 193,
1487
+ "1299": 194,
1488
+ "13": 195,
1489
+ "1300": 196,
1490
+ "1301": 197,
1491
+ "1302": 198,
1492
+ "1303": 199,
1493
+ "1304": 200,
1494
+ "1305": 201,
1495
+ "1306": 202,
1496
+ "1307": 203,
1497
+ "1308": 204,
1498
+ "1309": 205,
1499
+ "1310": 206,
1500
+ "1311": 207,
1501
+ "1312": 208,
1502
+ "1313": 209,
1503
+ "1314": 210,
1504
+ "1315": 211,
1505
+ "1316": 212,
1506
+ "1317": 213,
1507
+ "1318": 214,
1508
+ "1319": 215,
1509
+ "1320": 216,
1510
+ "1321": 217,
1511
+ "1322": 218,
1512
+ "1323": 219,
1513
+ "1324": 220,
1514
+ "1325": 221,
1515
+ "1326": 222,
1516
+ "1327": 223,
1517
+ "1328": 224,
1518
+ "1329": 225,
1519
+ "133": 226,
1520
+ "1330": 227,
1521
+ "1331": 228,
1522
+ "1333": 229,
1523
+ "1334": 230,
1524
+ "1336": 231,
1525
+ "1340": 232,
1526
+ "1341": 233,
1527
+ "1342": 234,
1528
+ "1343": 235,
1529
+ "1346": 236,
1530
+ "135": 237,
1531
+ "1350": 238,
1532
+ "1351": 239,
1533
+ "1357": 240,
1534
+ "1359": 241,
1535
+ "136": 242,
1536
+ "1361": 243,
1537
+ "1362": 244,
1538
+ "1363": 245,
1539
+ "1364": 246,
1540
+ "1365": 247,
1541
+ "1367": 248,
1542
+ "1368": 249,
1543
+ "1369": 250,
1544
+ "137": 251,
1545
+ "1370": 252,
1546
+ "1371": 253,
1547
+ "1372": 254,
1548
+ "1373": 255,
1549
+ "1374": 256,
1550
+ "1376": 257,
1551
+ "1377": 258,
1552
+ "1378": 259,
1553
+ "1379": 260,
1554
+ "138": 261,
1555
+ "1380": 262,
1556
+ "1382": 263,
1557
+ "1383": 264,
1558
+ "1384": 265,
1559
+ "1385": 266,
1560
+ "1386": 267,
1561
+ "1387": 268,
1562
+ "1388": 269,
1563
+ "1389": 270,
1564
+ "139": 271,
1565
+ "1391": 272,
1566
+ "1396": 273,
1567
+ "1397": 274,
1568
+ "1398": 275,
1569
+ "1399": 276,
1570
+ "14": 277,
1571
+ "140": 278,
1572
+ "1400": 279,
1573
+ "1401": 280,
1574
+ "1402": 281,
1575
+ "1403": 282,
1576
+ "141": 283,
1577
+ "1413": 284,
1578
+ "1415": 285,
1579
+ "1416": 286,
1580
+ "1417": 287,
1581
+ "1419": 288,
1582
+ "142": 289,
1583
+ "1420": 290,
1584
+ "1421": 291,
1585
+ "1422": 292,
1586
+ "1423": 293,
1587
+ "1425": 294,
1588
+ "1426": 295,
1589
+ "1427": 296,
1590
+ "1428": 297,
1591
+ "1429": 298,
1592
+ "143": 299,
1593
+ "1430": 300,
1594
+ "1431": 301,
1595
+ "1432": 302,
1596
+ "1433": 303,
1597
+ "1438": 304,
1598
+ "1439": 305,
1599
+ "144": 306,
1600
+ "1441": 307,
1601
+ "1443": 308,
1602
+ "1444": 309,
1603
+ "1445": 310,
1604
+ "1446": 311,
1605
+ "1447": 312,
1606
+ "1448": 313,
1607
+ "1449": 314,
1608
+ "145": 315,
1609
+ "1450": 316,
1610
+ "1451": 317,
1611
+ "1452": 318,
1612
+ "1453": 319,
1613
+ "1454": 320,
1614
+ "1455": 321,
1615
+ "1456": 322,
1616
+ "1457": 323,
1617
+ "1458": 324,
1618
+ "1459": 325,
1619
+ "146": 326,
1620
+ "1460": 327,
1621
+ "1461": 328,
1622
+ "1462": 329,
1623
+ "1463": 330,
1624
+ "1464": 331,
1625
+ "1465": 332,
1626
+ "1466": 333,
1627
+ "1467": 334,
1628
+ "1468": 335,
1629
+ "1469": 336,
1630
+ "147": 337,
1631
+ "1470": 338,
1632
+ "1471": 339,
1633
+ "1473": 340,
1634
+ "1474": 341,
1635
+ "1475": 342,
1636
+ "1476": 343,
1637
+ "1477": 344,
1638
+ "1478": 345,
1639
+ "1479": 346,
1640
+ "1480": 347,
1641
+ "1481": 348,
1642
+ "1482": 349,
1643
+ "1483": 350,
1644
+ "1484": 351,
1645
+ "1485": 352,
1646
+ "1486": 353,
1647
+ "1487": 354,
1648
+ "1488": 355,
1649
+ "1489": 356,
1650
+ "1490": 357,
1651
+ "1491": 358,
1652
+ "1492": 359,
1653
+ "1493": 360,
1654
+ "1494": 361,
1655
+ "1495": 362,
1656
+ "1496": 363,
1657
+ "1497": 364,
1658
+ "1498": 365,
1659
+ "1499": 366,
1660
+ "15": 367,
1661
+ "1500": 368,
1662
+ "1501": 369,
1663
+ "1502": 370,
1664
+ "1507": 371,
1665
+ "1509": 372,
1666
+ "1510": 373,
1667
+ "1511": 374,
1668
+ "1512": 375,
1669
+ "1513": 376,
1670
+ "1514": 377,
1671
+ "1515": 378,
1672
+ "1516": 379,
1673
+ "1517": 380,
1674
+ "1518": 381,
1675
+ "1519": 382,
1676
+ "152": 383,
1677
+ "1520": 384,
1678
+ "1521": 385,
1679
+ "1522": 386,
1680
+ "1523": 387,
1681
+ "1524": 388,
1682
+ "1525": 389,
1683
+ "1526": 390,
1684
+ "1527": 391,
1685
+ "1528": 392,
1686
+ "1529": 393,
1687
+ "153": 394,
1688
+ "1530": 395,
1689
+ "1531": 396,
1690
+ "1532": 397,
1691
+ "1533": 398,
1692
+ "1534": 399,
1693
+ "1535": 400,
1694
+ "1536": 401,
1695
+ "1537": 402,
1696
+ "1538": 403,
1697
+ "1539": 404,
1698
+ "154": 405,
1699
+ "1540": 406,
1700
+ "1541": 407,
1701
+ "1542": 408,
1702
+ "1543": 409,
1703
+ "1544": 410,
1704
+ "1545": 411,
1705
+ "1546": 412,
1706
+ "1547": 413,
1707
+ "1548": 414,
1708
+ "1549": 415,
1709
+ "155": 416,
1710
+ "1550": 417,
1711
+ "1551": 418,
1712
+ "1552": 419,
1713
+ "1553": 420,
1714
+ "1554": 421,
1715
+ "1555": 422,
1716
+ "1556": 423,
1717
+ "1557": 424,
1718
+ "1558": 425,
1719
+ "1559": 426,
1720
+ "1560": 427,
1721
+ "1561": 428,
1722
+ "1562": 429,
1723
+ "1563": 430,
1724
+ "1564": 431,
1725
+ "1565": 432,
1726
+ "1566": 433,
1727
+ "1567": 434,
1728
+ "1568": 435,
1729
+ "1569": 436,
1730
+ "157": 437,
1731
+ "1570": 438,
1732
+ "1571": 439,
1733
+ "1572": 440,
1734
+ "1573": 441,
1735
+ "1574": 442,
1736
+ "1575": 443,
1737
+ "1576": 444,
1738
+ "1577": 445,
1739
+ "1578": 446,
1740
+ "1579": 447,
1741
+ "158": 448,
1742
+ "1580": 449,
1743
+ "1581": 450,
1744
+ "1582": 451,
1745
+ "1583": 452,
1746
+ "1584": 453,
1747
+ "1585": 454,
1748
+ "1586": 455,
1749
+ "159": 456,
1750
+ "160": 457,
1751
+ "162": 458,
1752
+ "163": 459,
1753
+ "164": 460,
1754
+ "165": 461,
1755
+ "166": 462,
1756
+ "167": 463,
1757
+ "168": 464,
1758
+ "169": 465,
1759
+ "17": 466,
1760
+ "170": 467,
1761
+ "171": 468,
1762
+ "172": 469,
1763
+ "173": 470,
1764
+ "174": 471,
1765
+ "175": 472,
1766
+ "177": 473,
1767
+ "178": 474,
1768
+ "179": 475,
1769
+ "18": 476,
1770
+ "180": 477,
1771
+ "181": 478,
1772
+ "182": 479,
1773
+ "19": 480,
1774
+ "192": 481,
1775
+ "193": 482,
1776
+ "194": 483,
1777
+ "195": 484,
1778
+ "197": 485,
1779
+ "199": 486,
1780
+ "20": 487,
1781
+ "200": 488,
1782
+ "202": 489,
1783
+ "203": 490,
1784
+ "204": 491,
1785
+ "205": 492,
1786
+ "206": 493,
1787
+ "207": 494,
1788
+ "208": 495,
1789
+ "209": 496,
1790
+ "210": 497,
1791
+ "211": 498,
1792
+ "212": 499,
1793
+ "213": 500,
1794
+ "214": 501,
1795
+ "215": 502,
1796
+ "216": 503,
1797
+ "217": 504,
1798
+ "218": 505,
1799
+ "219": 506,
1800
+ "22": 507,
1801
+ "220": 508,
1802
+ "221": 509,
1803
+ "222": 510,
1804
+ "223": 511,
1805
+ "224": 512,
1806
+ "225": 513,
1807
+ "226": 514,
1808
+ "227": 515,
1809
+ "229": 516,
1810
+ "23": 517,
1811
+ "230": 518,
1812
+ "231": 519,
1813
+ "232": 520,
1814
+ "233": 521,
1815
+ "234": 522,
1816
+ "236": 523,
1817
+ "237": 524,
1818
+ "238": 525,
1819
+ "239": 526,
1820
+ "24": 527,
1821
+ "240": 528,
1822
+ "241": 529,
1823
+ "242": 530,
1824
+ "243": 531,
1825
+ "244": 532,
1826
+ "245": 533,
1827
+ "246": 534,
1828
+ "247": 535,
1829
+ "248": 536,
1830
+ "249": 537,
1831
+ "25": 538,
1832
+ "250": 539,
1833
+ "251": 540,
1834
+ "252": 541,
1835
+ "253": 542,
1836
+ "254": 543,
1837
+ "255": 544,
1838
+ "256": 545,
1839
+ "257": 546,
1840
+ "259": 547,
1841
+ "26": 548,
1842
+ "260": 549,
1843
+ "261": 550,
1844
+ "262": 551,
1845
+ "27": 552,
1846
+ "28": 553,
1847
+ "288": 554,
1848
+ "289": 555,
1849
+ "29": 556,
1850
+ "290": 557,
1851
+ "291": 558,
1852
+ "292": 559,
1853
+ "293": 560,
1854
+ "294": 561,
1855
+ "295": 562,
1856
+ "296": 563,
1857
+ "297": 564,
1858
+ "298": 565,
1859
+ "30": 566,
1860
+ "300": 567,
1861
+ "301": 568,
1862
+ "302": 569,
1863
+ "303": 570,
1864
+ "304": 571,
1865
+ "306": 572,
1866
+ "307": 573,
1867
+ "308": 574,
1868
+ "309": 575,
1869
+ "31": 576,
1870
+ "310": 577,
1871
+ "311": 578,
1872
+ "312": 579,
1873
+ "313": 580,
1874
+ "315": 581,
1875
+ "317": 582,
1876
+ "318": 583,
1877
+ "319": 584,
1878
+ "32": 585,
1879
+ "320": 586,
1880
+ "321": 587,
1881
+ "322": 588,
1882
+ "323": 589,
1883
+ "324": 590,
1884
+ "325": 591,
1885
+ "326": 592,
1886
+ "327": 593,
1887
+ "328": 594,
1888
+ "329": 595,
1889
+ "33": 596,
1890
+ "330": 597,
1891
+ "331": 598,
1892
+ "332": 599,
1893
+ "333": 600,
1894
+ "334": 601,
1895
+ "335": 602,
1896
+ "336": 603,
1897
+ "337": 604,
1898
+ "338": 605,
1899
+ "339": 606,
1900
+ "34": 607,
1901
+ "340": 608,
1902
+ "341": 609,
1903
+ "342": 610,
1904
+ "343": 611,
1905
+ "344": 612,
1906
+ "345": 613,
1907
+ "349": 614,
1908
+ "35": 615,
1909
+ "350": 616,
1910
+ "351": 617,
1911
+ "352": 618,
1912
+ "353": 619,
1913
+ "354": 620,
1914
+ "355": 621,
1915
+ "356": 622,
1916
+ "358": 623,
1917
+ "359": 624,
1918
+ "36": 625,
1919
+ "361": 626,
1920
+ "362": 627,
1921
+ "363": 628,
1922
+ "364": 629,
1923
+ "365": 630,
1924
+ "366": 631,
1925
+ "367": 632,
1926
+ "368": 633,
1927
+ "369": 634,
1928
+ "37": 635,
1929
+ "370": 636,
1930
+ "371": 637,
1931
+ "372": 638,
1932
+ "373": 639,
1933
+ "374": 640,
1934
+ "375": 641,
1935
+ "376": 642,
1936
+ "377": 643,
1937
+ "378": 644,
1938
+ "379": 645,
1939
+ "38": 646,
1940
+ "380": 647,
1941
+ "381": 648,
1942
+ "382": 649,
1943
+ "383": 650,
1944
+ "384": 651,
1945
+ "385": 652,
1946
+ "386": 653,
1947
+ "387": 654,
1948
+ "388": 655,
1949
+ "389": 656,
1950
+ "39": 657,
1951
+ "390": 658,
1952
+ "391": 659,
1953
+ "392": 660,
1954
+ "393": 661,
1955
+ "394": 662,
1956
+ "395": 663,
1957
+ "396": 664,
1958
+ "397": 665,
1959
+ "398": 666,
1960
+ "399": 667,
1961
+ "4": 668,
1962
+ "40": 669,
1963
+ "400": 670,
1964
+ "401": 671,
1965
+ "402": 672,
1966
+ "403": 673,
1967
+ "404": 674,
1968
+ "405": 675,
1969
+ "406": 676,
1970
+ "407": 677,
1971
+ "409": 678,
1972
+ "41": 679,
1973
+ "411": 680,
1974
+ "412": 681,
1975
+ "414": 682,
1976
+ "415": 683,
1977
+ "416": 684,
1978
+ "418": 685,
1979
+ "419": 686,
1980
+ "42": 687,
1981
+ "420": 688,
1982
+ "421": 689,
1983
+ "422": 690,
1984
+ "423": 691,
1985
+ "424": 692,
1986
+ "425": 693,
1987
+ "426": 694,
1988
+ "427": 695,
1989
+ "429": 696,
1990
+ "43": 697,
1991
+ "430": 698,
1992
+ "431": 699,
1993
+ "432": 700,
1994
+ "433": 701,
1995
+ "434": 702,
1996
+ "435": 703,
1997
+ "436": 704,
1998
+ "437": 705,
1999
+ "438": 706,
2000
+ "439": 707,
2001
+ "44": 708,
2002
+ "440": 709,
2003
+ "441": 710,
2004
+ "442": 711,
2005
+ "443": 712,
2006
+ "444": 713,
2007
+ "445": 714,
2008
+ "446": 715,
2009
+ "447": 716,
2010
+ "448": 717,
2011
+ "449": 718,
2012
+ "45": 719,
2013
+ "450": 720,
2014
+ "451": 721,
2015
+ "452": 722,
2016
+ "453": 723,
2017
+ "454": 724,
2018
+ "455": 725,
2019
+ "456": 726,
2020
+ "457": 727,
2021
+ "458": 728,
2022
+ "459": 729,
2023
+ "46": 730,
2024
+ "460": 731,
2025
+ "461": 732,
2026
+ "462": 733,
2027
+ "463": 734,
2028
+ "464": 735,
2029
+ "465": 736,
2030
+ "466": 737,
2031
+ "467": 738,
2032
+ "468": 739,
2033
+ "469": 740,
2034
+ "47": 741,
2035
+ "470": 742,
2036
+ "471": 743,
2037
+ "472": 744,
2038
+ "473": 745,
2039
+ "474": 746,
2040
+ "475": 747,
2041
+ "476": 748,
2042
+ "477": 749,
2043
+ "478": 750,
2044
+ "479": 751,
2045
+ "480": 752,
2046
+ "481": 753,
2047
+ "482": 754,
2048
+ "483": 755,
2049
+ "484": 756,
2050
+ "485": 757,
2051
+ "486": 758,
2052
+ "487": 759,
2053
+ "488": 760,
2054
+ "489": 761,
2055
+ "49": 762,
2056
+ "490": 763,
2057
+ "491": 764,
2058
+ "492": 765,
2059
+ "493": 766,
2060
+ "494": 767,
2061
+ "495": 768,
2062
+ "496": 769,
2063
+ "497": 770,
2064
+ "499": 771,
2065
+ "5": 772,
2066
+ "50": 773,
2067
+ "500": 774,
2068
+ "501": 775,
2069
+ "502": 776,
2070
+ "503": 777,
2071
+ "504": 778,
2072
+ "505": 779,
2073
+ "506": 780,
2074
+ "507": 781,
2075
+ "508": 782,
2076
+ "509": 783,
2077
+ "51": 784,
2078
+ "510": 785,
2079
+ "511": 786,
2080
+ "512": 787,
2081
+ "513": 788,
2082
+ "514": 789,
2083
+ "515": 790,
2084
+ "516": 791,
2085
+ "517": 792,
2086
+ "518": 793,
2087
+ "519": 794,
2088
+ "52": 795,
2089
+ "520": 796,
2090
+ "521": 797,
2091
+ "522": 798,
2092
+ "523": 799,
2093
+ "524": 800,
2094
+ "525": 801,
2095
+ "526": 802,
2096
+ "527": 803,
2097
+ "528": 804,
2098
+ "529": 805,
2099
+ "53": 806,
2100
+ "530": 807,
2101
+ "531": 808,
2102
+ "532": 809,
2103
+ "533": 810,
2104
+ "534": 811,
2105
+ "535": 812,
2106
+ "536": 813,
2107
+ "537": 814,
2108
+ "538": 815,
2109
+ "539": 816,
2110
+ "54": 817,
2111
+ "540": 818,
2112
+ "541": 819,
2113
+ "542": 820,
2114
+ "543": 821,
2115
+ "544": 822,
2116
+ "546": 823,
2117
+ "547": 824,
2118
+ "548": 825,
2119
+ "549": 826,
2120
+ "55": 827,
2121
+ "550": 828,
2122
+ "551": 829,
2123
+ "552": 830,
2124
+ "553": 831,
2125
+ "554": 832,
2126
+ "555": 833,
2127
+ "556": 834,
2128
+ "557": 835,
2129
+ "558": 836,
2130
+ "559": 837,
2131
+ "56": 838,
2132
+ "560": 839,
2133
+ "561": 840,
2134
+ "562": 841,
2135
+ "563": 842,
2136
+ "564": 843,
2137
+ "565": 844,
2138
+ "566": 845,
2139
+ "567": 846,
2140
+ "568": 847,
2141
+ "569": 848,
2142
+ "57": 849,
2143
+ "570": 850,
2144
+ "571": 851,
2145
+ "572": 852,
2146
+ "573": 853,
2147
+ "574": 854,
2148
+ "575": 855,
2149
+ "576": 856,
2150
+ "577": 857,
2151
+ "578": 858,
2152
+ "579": 859,
2153
+ "580": 860,
2154
+ "581": 861,
2155
+ "582": 862,
2156
+ "583": 863,
2157
+ "584": 864,
2158
+ "585": 865,
2159
+ "586": 866,
2160
+ "587": 867,
2161
+ "588": 868,
2162
+ "589": 869,
2163
+ "591": 870,
2164
+ "593": 871,
2165
+ "594": 872,
2166
+ "595": 873,
2167
+ "597": 874,
2168
+ "598": 875,
2169
+ "599": 876,
2170
+ "6": 877,
2171
+ "600": 878,
2172
+ "601": 879,
2173
+ "602": 880,
2174
+ "603": 881,
2175
+ "604": 882,
2176
+ "605": 883,
2177
+ "606": 884,
2178
+ "607": 885,
2179
+ "608": 886,
2180
+ "609": 887,
2181
+ "610": 888,
2182
+ "611": 889,
2183
+ "612": 890,
2184
+ "613": 891,
2185
+ "614": 892,
2186
+ "615": 893,
2187
+ "616": 894,
2188
+ "618": 895,
2189
+ "619": 896,
2190
+ "620": 897,
2191
+ "621": 898,
2192
+ "622": 899,
2193
+ "623": 900,
2194
+ "624": 901,
2195
+ "625": 902,
2196
+ "626": 903,
2197
+ "627": 904,
2198
+ "628": 905,
2199
+ "629": 906,
2200
+ "630": 907,
2201
+ "631": 908,
2202
+ "632": 909,
2203
+ "633": 910,
2204
+ "634": 911,
2205
+ "635": 912,
2206
+ "636": 913,
2207
+ "637": 914,
2208
+ "638": 915,
2209
+ "64": 916,
2210
+ "640": 917,
2211
+ "641": 918,
2212
+ "643": 919,
2213
+ "645": 920,
2214
+ "646": 921,
2215
+ "647": 922,
2216
+ "648": 923,
2217
+ "649": 924,
2218
+ "65": 925,
2219
+ "650": 926,
2220
+ "651": 927,
2221
+ "652": 928,
2222
+ "653": 929,
2223
+ "654": 930,
2224
+ "655": 931,
2225
+ "656": 932,
2226
+ "657": 933,
2227
+ "658": 934,
2228
+ "659": 935,
2229
+ "660": 936,
2230
+ "661": 937,
2231
+ "662": 938,
2232
+ "663": 939,
2233
+ "664": 940,
2234
+ "665": 941,
2235
+ "666": 942,
2236
+ "667": 943,
2237
+ "668": 944,
2238
+ "669": 945,
2239
+ "67": 946,
2240
+ "670": 947,
2241
+ "671": 948,
2242
+ "672": 949,
2243
+ "673": 950,
2244
+ "675": 951,
2245
+ "676": 952,
2246
+ "677": 953,
2247
+ "679": 954,
2248
+ "680": 955,
2249
+ "681": 956,
2250
+ "682": 957,
2251
+ "683": 958,
2252
+ "684": 959,
2253
+ "685": 960,
2254
+ "686": 961,
2255
+ "687": 962,
2256
+ "688": 963,
2257
+ "689": 964,
2258
+ "69": 965,
2259
+ "690": 966,
2260
+ "691": 967,
2261
+ "692": 968,
2262
+ "694": 969,
2263
+ "695": 970,
2264
+ "696": 971,
2265
+ "697": 972,
2266
+ "698": 973,
2267
+ "699": 974,
2268
+ "7": 975,
2269
+ "70": 976,
2270
+ "700": 977,
2271
+ "701": 978,
2272
+ "702": 979,
2273
+ "703": 980,
2274
+ "704": 981,
2275
+ "705": 982,
2276
+ "706": 983,
2277
+ "707": 984,
2278
+ "708": 985,
2279
+ "709": 986,
2280
+ "71": 987,
2281
+ "710": 988,
2282
+ "711": 989,
2283
+ "712": 990,
2284
+ "713": 991,
2285
+ "714": 992,
2286
+ "72": 993,
2287
+ "721": 994,
2288
+ "722": 995,
2289
+ "723": 996,
2290
+ "724": 997,
2291
+ "725": 998,
2292
+ "726": 999,
2293
+ "727": 1000,
2294
+ "728": 1001,
2295
+ "729": 1002,
2296
+ "73": 1003,
2297
+ "730": 1004,
2298
+ "731": 1005,
2299
+ "732": 1006,
2300
+ "733": 1007,
2301
+ "734": 1008,
2302
+ "735": 1009,
2303
+ "736": 1010,
2304
+ "737": 1011,
2305
+ "738": 1012,
2306
+ "739": 1013,
2307
+ "740": 1014,
2308
+ "741": 1015,
2309
+ "742": 1016,
2310
+ "743": 1017,
2311
+ "744": 1018,
2312
+ "745": 1019,
2313
+ "746": 1020,
2314
+ "747": 1021,
2315
+ "748": 1022,
2316
+ "749": 1023,
2317
+ "75": 1024,
2318
+ "750": 1025,
2319
+ "752": 1026,
2320
+ "753": 1027,
2321
+ "754": 1028,
2322
+ "755": 1029,
2323
+ "756": 1030,
2324
+ "757": 1031,
2325
+ "758": 1032,
2326
+ "759": 1033,
2327
+ "76": 1034,
2328
+ "760": 1035,
2329
+ "761": 1036,
2330
+ "762": 1037,
2331
+ "763": 1038,
2332
+ "764": 1039,
2333
+ "765": 1040,
2334
+ "766": 1041,
2335
+ "767": 1042,
2336
+ "768": 1043,
2337
+ "769": 1044,
2338
+ "77": 1045,
2339
+ "770": 1046,
2340
+ "772": 1047,
2341
+ "773": 1048,
2342
+ "774": 1049,
2343
+ "775": 1050,
2344
+ "776": 1051,
2345
+ "777": 1052,
2346
+ "778": 1053,
2347
+ "779": 1054,
2348
+ "78": 1055,
2349
+ "780": 1056,
2350
+ "781": 1057,
2351
+ "782": 1058,
2352
+ "783": 1059,
2353
+ "784": 1060,
2354
+ "785": 1061,
2355
+ "786": 1062,
2356
+ "787": 1063,
2357
+ "788": 1064,
2358
+ "789": 1065,
2359
+ "79": 1066,
2360
+ "790": 1067,
2361
+ "791": 1068,
2362
+ "792": 1069,
2363
+ "793": 1070,
2364
+ "794": 1071,
2365
+ "795": 1072,
2366
+ "796": 1073,
2367
+ "797": 1074,
2368
+ "798": 1075,
2369
+ "8": 1076,
2370
+ "80": 1077,
2371
+ "800": 1078,
2372
+ "801": 1079,
2373
+ "802": 1080,
2374
+ "803": 1081,
2375
+ "804": 1082,
2376
+ "805": 1083,
2377
+ "806": 1084,
2378
+ "807": 1085,
2379
+ "808": 1086,
2380
+ "809": 1087,
2381
+ "81": 1088,
2382
+ "810": 1089,
2383
+ "811": 1090,
2384
+ "812": 1091,
2385
+ "813": 1092,
2386
+ "814": 1093,
2387
+ "815": 1094,
2388
+ "816": 1095,
2389
+ "817": 1096,
2390
+ "818": 1097,
2391
+ "819": 1098,
2392
+ "82": 1099,
2393
+ "820": 1100,
2394
+ "821": 1101,
2395
+ "822": 1102,
2396
+ "824": 1103,
2397
+ "825": 1104,
2398
+ "826": 1105,
2399
+ "827": 1106,
2400
+ "828": 1107,
2401
+ "829": 1108,
2402
+ "83": 1109,
2403
+ "830": 1110,
2404
+ "831": 1111,
2405
+ "832": 1112,
2406
+ "833": 1113,
2407
+ "834": 1114,
2408
+ "835": 1115,
2409
+ "836": 1116,
2410
+ "837": 1117,
2411
+ "838": 1118,
2412
+ "839": 1119,
2413
+ "84": 1120,
2414
+ "840": 1121,
2415
+ "841": 1122,
2416
+ "842": 1123,
2417
+ "843": 1124,
2418
+ "844": 1125,
2419
+ "845": 1126,
2420
+ "846": 1127,
2421
+ "847": 1128,
2422
+ "848": 1129,
2423
+ "849": 1130,
2424
+ "85": 1131,
2425
+ "850": 1132,
2426
+ "851": 1133,
2427
+ "852": 1134,
2428
+ "853": 1135,
2429
+ "854": 1136,
2430
+ "855": 1137,
2431
+ "856": 1138,
2432
+ "857": 1139,
2433
+ "858": 1140,
2434
+ "859": 1141,
2435
+ "86": 1142,
2436
+ "863": 1143,
2437
+ "864": 1144,
2438
+ "865": 1145,
2439
+ "866": 1146,
2440
+ "868": 1147,
2441
+ "87": 1148,
2442
+ "870": 1149,
2443
+ "871": 1150,
2444
+ "872": 1151,
2445
+ "873": 1152,
2446
+ "874": 1153,
2447
+ "875": 1154,
2448
+ "876": 1155,
2449
+ "877": 1156,
2450
+ "878": 1157,
2451
+ "879": 1158,
2452
+ "88": 1159,
2453
+ "880": 1160,
2454
+ "881": 1161,
2455
+ "882": 1162,
2456
+ "883": 1163,
2457
+ "884": 1164,
2458
+ "885": 1165,
2459
+ "886": 1166,
2460
+ "887": 1167,
2461
+ "888": 1168,
2462
+ "889": 1169,
2463
+ "89": 1170,
2464
+ "890": 1171,
2465
+ "891": 1172,
2466
+ "892": 1173,
2467
+ "893": 1174,
2468
+ "894": 1175,
2469
+ "895": 1176,
2470
+ "896": 1177,
2471
+ "897": 1178,
2472
+ "898": 1179,
2473
+ "899": 1180,
2474
+ "9": 1181,
2475
+ "90": 1182,
2476
+ "900": 1183,
2477
+ "901": 1184,
2478
+ "903": 1185,
2479
+ "906": 1186,
2480
+ "909": 1187,
2481
+ "910": 1188,
2482
+ "911": 1189,
2483
+ "912": 1190,
2484
+ "913": 1191,
2485
+ "914": 1192,
2486
+ "915": 1193,
2487
+ "916": 1194,
2488
+ "917": 1195,
2489
+ "918": 1196,
2490
+ "92": 1197,
2491
+ "921": 1198,
2492
+ "922": 1199,
2493
+ "923": 1200,
2494
+ "924": 1201,
2495
+ "925": 1202,
2496
+ "926": 1203,
2497
+ "927": 1204,
2498
+ "928": 1205,
2499
+ "929": 1206,
2500
+ "930": 1207,
2501
+ "931": 1208,
2502
+ "932": 1209,
2503
+ "933": 1210,
2504
+ "934": 1211,
2505
+ "935": 1212,
2506
+ "936": 1213,
2507
+ "937": 1214,
2508
+ "938": 1215,
2509
+ "939": 1216,
2510
+ "940": 1217,
2511
+ "941": 1218,
2512
+ "942": 1219,
2513
+ "943": 1220,
2514
+ "944": 1221,
2515
+ "945": 1222,
2516
+ "946": 1223,
2517
+ "947": 1224,
2518
+ "948": 1225,
2519
+ "949": 1226,
2520
+ "950": 1227,
2521
+ "951": 1228,
2522
+ "952": 1229,
2523
+ "953": 1230,
2524
+ "954": 1231,
2525
+ "955": 1232,
2526
+ "956": 1233,
2527
+ "957": 1234,
2528
+ "958": 1235,
2529
+ "959": 1236,
2530
+ "960": 1237,
2531
+ "961": 1238,
2532
+ "962": 1239,
2533
+ "963": 1240,
2534
+ "964": 1241,
2535
+ "965": 1242,
2536
+ "966": 1243,
2537
+ "967": 1244,
2538
+ "968": 1245,
2539
+ "969": 1246,
2540
+ "97": 1247,
2541
+ "970": 1248,
2542
+ "971": 1249,
2543
+ "972": 1250,
2544
+ "973": 1251,
2545
+ "974": 1252,
2546
+ "975": 1253,
2547
+ "976": 1254,
2548
+ "977": 1255,
2549
+ "978": 1256,
2550
+ "979": 1257,
2551
+ "980": 1258,
2552
+ "981": 1259,
2553
+ "982": 1260,
2554
+ "983": 1261,
2555
+ "984": 1262,
2556
+ "985": 1263,
2557
+ "986": 1264,
2558
+ "989": 1265,
2559
+ "99": 1266,
2560
+ "990": 1267,
2561
+ "991": 1268,
2562
+ "992": 1269,
2563
+ "993": 1270,
2564
+ "994": 1271,
2565
+ "995": 1272,
2566
+ "996": 1273,
2567
+ "997": 1274,
2568
+ "998": 1275,
2569
+ "999": 1276
2570
+ },
2571
+ "layer_norm_eps": 1e-12,
2572
+ "max_position_embeddings": 512,
2573
+ "model_type": "bert",
2574
+ "num_attention_heads": 12,
2575
+ "num_hidden_layers": 12,
2576
+ "pad_token_id": 0,
2577
+ "position_embedding_type": "absolute",
2578
+ "problem_type": "multi_label_classification",
2579
+ "torch_dtype": "float32",
2580
+ "transformers_version": "4.55.0",
2581
+ "type_vocab_size": 2,
2582
+ "use_cache": true,
2583
+ "vocab_size": 30522
2584
+ }
checkpoint-2250/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3ffcc3794ef558c668bc0493b25e8a4c8a9edcd5a19e249a8f6a9c9ebd48ec1
3
+ size 441880548
checkpoint-2250/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f04fbc73e930d1fedffa1b0a67187f7f84841fd162462489b1ff03b2d9acfb23
3
+ size 883885323
checkpoint-2250/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0c41baf5ca7e679cbaa6ad3917bf076aef57b124fa4f182f5db0e78de1ceb0f
3
+ size 14645
checkpoint-2250/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ffd6fcba2a25b9e58288b7903427ef4a4e7320f3979387aab6c4fbbb545f407
3
+ size 1465
checkpoint-2250/special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
checkpoint-2250/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-2250/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "BertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
checkpoint-2250/trainer_state.json ADDED
@@ -0,0 +1,371 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 1125,
3
+ "best_metric": 0.0007731728834392315,
4
+ "best_model_checkpoint": "trained/bert_multilabel_text_classifier/checkpoint-1125",
5
+ "epoch": 2.0,
6
+ "eval_steps": 500,
7
+ "global_step": 2250,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.044444444444444446,
14
+ "grad_norm": 0.25056546926498413,
15
+ "learning_rate": 1.9709629629629633e-05,
16
+ "loss": 0.5964,
17
+ "step": 50
18
+ },
19
+ {
20
+ "epoch": 0.08888888888888889,
21
+ "grad_norm": 0.17194914817810059,
22
+ "learning_rate": 1.9413333333333336e-05,
23
+ "loss": 0.3456,
24
+ "step": 100
25
+ },
26
+ {
27
+ "epoch": 0.13333333333333333,
28
+ "grad_norm": 0.11451203376054764,
29
+ "learning_rate": 1.911703703703704e-05,
30
+ "loss": 0.2025,
31
+ "step": 150
32
+ },
33
+ {
34
+ "epoch": 0.17777777777777778,
35
+ "grad_norm": 0.08061835914850235,
36
+ "learning_rate": 1.882074074074074e-05,
37
+ "loss": 0.1318,
38
+ "step": 200
39
+ },
40
+ {
41
+ "epoch": 0.2222222222222222,
42
+ "grad_norm": 0.05962532013654709,
43
+ "learning_rate": 1.8524444444444444e-05,
44
+ "loss": 0.0945,
45
+ "step": 250
46
+ },
47
+ {
48
+ "epoch": 0.26666666666666666,
49
+ "grad_norm": 0.047490622848272324,
50
+ "learning_rate": 1.822814814814815e-05,
51
+ "loss": 0.0726,
52
+ "step": 300
53
+ },
54
+ {
55
+ "epoch": 0.3111111111111111,
56
+ "grad_norm": 0.038484182208776474,
57
+ "learning_rate": 1.7931851851851853e-05,
58
+ "loss": 0.0585,
59
+ "step": 350
60
+ },
61
+ {
62
+ "epoch": 0.35555555555555557,
63
+ "grad_norm": 0.03241903707385063,
64
+ "learning_rate": 1.7635555555555555e-05,
65
+ "loss": 0.049,
66
+ "step": 400
67
+ },
68
+ {
69
+ "epoch": 0.4,
70
+ "grad_norm": 0.02833125926554203,
71
+ "learning_rate": 1.733925925925926e-05,
72
+ "loss": 0.0427,
73
+ "step": 450
74
+ },
75
+ {
76
+ "epoch": 0.4444444444444444,
77
+ "grad_norm": 0.024066274985671043,
78
+ "learning_rate": 1.7042962962962964e-05,
79
+ "loss": 0.037,
80
+ "step": 500
81
+ },
82
+ {
83
+ "epoch": 0.4888888888888889,
84
+ "grad_norm": 0.023793209344148636,
85
+ "learning_rate": 1.674666666666667e-05,
86
+ "loss": 0.0334,
87
+ "step": 550
88
+ },
89
+ {
90
+ "epoch": 0.5333333333333333,
91
+ "grad_norm": 0.025505442172288895,
92
+ "learning_rate": 1.6450370370370373e-05,
93
+ "loss": 0.0307,
94
+ "step": 600
95
+ },
96
+ {
97
+ "epoch": 0.5777777777777777,
98
+ "grad_norm": 0.023647351190447807,
99
+ "learning_rate": 1.6154074074074075e-05,
100
+ "loss": 0.0283,
101
+ "step": 650
102
+ },
103
+ {
104
+ "epoch": 0.6222222222222222,
105
+ "grad_norm": 0.018704526126384735,
106
+ "learning_rate": 1.5857777777777778e-05,
107
+ "loss": 0.0264,
108
+ "step": 700
109
+ },
110
+ {
111
+ "epoch": 0.6666666666666666,
112
+ "grad_norm": 0.020357510074973106,
113
+ "learning_rate": 1.556148148148148e-05,
114
+ "loss": 0.0252,
115
+ "step": 750
116
+ },
117
+ {
118
+ "epoch": 0.7111111111111111,
119
+ "grad_norm": 0.015282705426216125,
120
+ "learning_rate": 1.5265185185185187e-05,
121
+ "loss": 0.0232,
122
+ "step": 800
123
+ },
124
+ {
125
+ "epoch": 0.7555555555555555,
126
+ "grad_norm": 0.019114945083856583,
127
+ "learning_rate": 1.4968888888888891e-05,
128
+ "loss": 0.0223,
129
+ "step": 850
130
+ },
131
+ {
132
+ "epoch": 0.8,
133
+ "grad_norm": 0.016722247004508972,
134
+ "learning_rate": 1.4672592592592594e-05,
135
+ "loss": 0.0208,
136
+ "step": 900
137
+ },
138
+ {
139
+ "epoch": 0.8444444444444444,
140
+ "grad_norm": 0.016854777932167053,
141
+ "learning_rate": 1.4376296296296296e-05,
142
+ "loss": 0.02,
143
+ "step": 950
144
+ },
145
+ {
146
+ "epoch": 0.8888888888888888,
147
+ "grad_norm": 0.01701257936656475,
148
+ "learning_rate": 1.408e-05,
149
+ "loss": 0.0194,
150
+ "step": 1000
151
+ },
152
+ {
153
+ "epoch": 0.9333333333333333,
154
+ "grad_norm": 0.016065537929534912,
155
+ "learning_rate": 1.3783703703703705e-05,
156
+ "loss": 0.0187,
157
+ "step": 1050
158
+ },
159
+ {
160
+ "epoch": 0.9777777777777777,
161
+ "grad_norm": 0.01564837247133255,
162
+ "learning_rate": 1.348740740740741e-05,
163
+ "loss": 0.0187,
164
+ "step": 1100
165
+ },
166
+ {
167
+ "epoch": 1.0,
168
+ "eval_loss": 0.0170283243060112,
169
+ "eval_macro_f1": 0.0007731728834392315,
170
+ "eval_micro_f1": 0.38728897715988087,
171
+ "eval_runtime": 1.3725,
172
+ "eval_samples_per_second": 728.62,
173
+ "eval_steps_per_second": 91.077,
174
+ "eval_subset_accuracy": 0.001,
175
+ "step": 1125
176
+ },
177
+ {
178
+ "epoch": 1.0222222222222221,
179
+ "grad_norm": 0.014304032549262047,
180
+ "learning_rate": 1.3191111111111112e-05,
181
+ "loss": 0.0184,
182
+ "step": 1150
183
+ },
184
+ {
185
+ "epoch": 1.0666666666666667,
186
+ "grad_norm": 0.013109758496284485,
187
+ "learning_rate": 1.2894814814814816e-05,
188
+ "loss": 0.0173,
189
+ "step": 1200
190
+ },
191
+ {
192
+ "epoch": 1.1111111111111112,
193
+ "grad_norm": 0.01453586295247078,
194
+ "learning_rate": 1.2598518518518519e-05,
195
+ "loss": 0.0161,
196
+ "step": 1250
197
+ },
198
+ {
199
+ "epoch": 1.1555555555555554,
200
+ "grad_norm": 0.015925494953989983,
201
+ "learning_rate": 1.2302222222222225e-05,
202
+ "loss": 0.0161,
203
+ "step": 1300
204
+ },
205
+ {
206
+ "epoch": 1.2,
207
+ "grad_norm": 0.015366824343800545,
208
+ "learning_rate": 1.2005925925925928e-05,
209
+ "loss": 0.0166,
210
+ "step": 1350
211
+ },
212
+ {
213
+ "epoch": 1.2444444444444445,
214
+ "grad_norm": 0.011549337767064571,
215
+ "learning_rate": 1.170962962962963e-05,
216
+ "loss": 0.0154,
217
+ "step": 1400
218
+ },
219
+ {
220
+ "epoch": 1.2888888888888888,
221
+ "grad_norm": 0.012960967607796192,
222
+ "learning_rate": 1.1413333333333335e-05,
223
+ "loss": 0.0157,
224
+ "step": 1450
225
+ },
226
+ {
227
+ "epoch": 1.3333333333333333,
228
+ "grad_norm": 0.013876300305128098,
229
+ "learning_rate": 1.1117037037037037e-05,
230
+ "loss": 0.0154,
231
+ "step": 1500
232
+ },
233
+ {
234
+ "epoch": 1.3777777777777778,
235
+ "grad_norm": 0.013066369108855724,
236
+ "learning_rate": 1.082074074074074e-05,
237
+ "loss": 0.0148,
238
+ "step": 1550
239
+ },
240
+ {
241
+ "epoch": 1.4222222222222223,
242
+ "grad_norm": 0.012255179695785046,
243
+ "learning_rate": 1.0524444444444446e-05,
244
+ "loss": 0.0151,
245
+ "step": 1600
246
+ },
247
+ {
248
+ "epoch": 1.4666666666666668,
249
+ "grad_norm": 0.011660152114927769,
250
+ "learning_rate": 1.0228148148148149e-05,
251
+ "loss": 0.0142,
252
+ "step": 1650
253
+ },
254
+ {
255
+ "epoch": 1.511111111111111,
256
+ "grad_norm": 0.018514148890972137,
257
+ "learning_rate": 9.931851851851853e-06,
258
+ "loss": 0.0145,
259
+ "step": 1700
260
+ },
261
+ {
262
+ "epoch": 1.5555555555555556,
263
+ "grad_norm": 0.013358614407479763,
264
+ "learning_rate": 9.635555555555557e-06,
265
+ "loss": 0.0136,
266
+ "step": 1750
267
+ },
268
+ {
269
+ "epoch": 1.6,
270
+ "grad_norm": 0.011820090934634209,
271
+ "learning_rate": 9.33925925925926e-06,
272
+ "loss": 0.0144,
273
+ "step": 1800
274
+ },
275
+ {
276
+ "epoch": 1.6444444444444444,
277
+ "grad_norm": 0.017100291326642036,
278
+ "learning_rate": 9.042962962962963e-06,
279
+ "loss": 0.0146,
280
+ "step": 1850
281
+ },
282
+ {
283
+ "epoch": 1.6888888888888889,
284
+ "grad_norm": 0.014295758679509163,
285
+ "learning_rate": 8.746666666666667e-06,
286
+ "loss": 0.0135,
287
+ "step": 1900
288
+ },
289
+ {
290
+ "epoch": 1.7333333333333334,
291
+ "grad_norm": 0.011741062626242638,
292
+ "learning_rate": 8.450370370370371e-06,
293
+ "loss": 0.0141,
294
+ "step": 1950
295
+ },
296
+ {
297
+ "epoch": 1.7777777777777777,
298
+ "grad_norm": 0.016170430928468704,
299
+ "learning_rate": 8.154074074074074e-06,
300
+ "loss": 0.0147,
301
+ "step": 2000
302
+ },
303
+ {
304
+ "epoch": 1.8222222222222222,
305
+ "grad_norm": 0.015337902121245861,
306
+ "learning_rate": 7.857777777777778e-06,
307
+ "loss": 0.0135,
308
+ "step": 2050
309
+ },
310
+ {
311
+ "epoch": 1.8666666666666667,
312
+ "grad_norm": 0.014960219152271748,
313
+ "learning_rate": 7.561481481481482e-06,
314
+ "loss": 0.013,
315
+ "step": 2100
316
+ },
317
+ {
318
+ "epoch": 1.911111111111111,
319
+ "grad_norm": 0.016356410458683968,
320
+ "learning_rate": 7.265185185185186e-06,
321
+ "loss": 0.0126,
322
+ "step": 2150
323
+ },
324
+ {
325
+ "epoch": 1.9555555555555557,
326
+ "grad_norm": 0.016427526250481606,
327
+ "learning_rate": 6.96888888888889e-06,
328
+ "loss": 0.0132,
329
+ "step": 2200
330
+ },
331
+ {
332
+ "epoch": 2.0,
333
+ "grad_norm": 0.009968223981559277,
334
+ "learning_rate": 6.672592592592592e-06,
335
+ "loss": 0.0126,
336
+ "step": 2250
337
+ },
338
+ {
339
+ "epoch": 2.0,
340
+ "eval_loss": 0.012450361624360085,
341
+ "eval_macro_f1": 0.0007731728834392315,
342
+ "eval_micro_f1": 0.38728897715988087,
343
+ "eval_runtime": 1.4199,
344
+ "eval_samples_per_second": 704.295,
345
+ "eval_steps_per_second": 88.037,
346
+ "eval_subset_accuracy": 0.001,
347
+ "step": 2250
348
+ }
349
+ ],
350
+ "logging_steps": 50,
351
+ "max_steps": 3375,
352
+ "num_input_tokens_seen": 0,
353
+ "num_train_epochs": 3,
354
+ "save_steps": 500,
355
+ "stateful_callbacks": {
356
+ "TrainerControl": {
357
+ "args": {
358
+ "should_epoch_stop": false,
359
+ "should_evaluate": false,
360
+ "should_log": false,
361
+ "should_save": true,
362
+ "should_training_stop": false
363
+ },
364
+ "attributes": {}
365
+ }
366
+ },
367
+ "total_flos": 4790215342080000.0,
368
+ "train_batch_size": 8,
369
+ "trial_name": null,
370
+ "trial_params": null
371
+ }
checkpoint-2250/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee46aba967c8873c2f61f80b1ad656e6b063317ea662c3d4695c8442bcd9f6da
3
+ size 5841
checkpoint-2250/vocab.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-30915/config.json ADDED
@@ -0,0 +1,2584 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertForSequenceClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "id2label": {
12
+ "0": "1",
13
+ "1": "10",
14
+ "2": "100",
15
+ "3": "1003",
16
+ "4": "1004",
17
+ "5": "1005",
18
+ "6": "1006",
19
+ "7": "1007",
20
+ "8": "1008",
21
+ "9": "1009",
22
+ "10": "101",
23
+ "11": "1010",
24
+ "12": "1011",
25
+ "13": "1012",
26
+ "14": "1013",
27
+ "15": "1014",
28
+ "16": "1017",
29
+ "17": "1018",
30
+ "18": "1019",
31
+ "19": "102",
32
+ "20": "1020",
33
+ "21": "1021",
34
+ "22": "1022",
35
+ "23": "1023",
36
+ "24": "103",
37
+ "25": "1034",
38
+ "26": "1035",
39
+ "27": "104",
40
+ "28": "1040",
41
+ "29": "1043",
42
+ "30": "1046",
43
+ "31": "1047",
44
+ "32": "1048",
45
+ "33": "105",
46
+ "34": "1050",
47
+ "35": "1051",
48
+ "36": "1052",
49
+ "37": "1053",
50
+ "38": "1054",
51
+ "39": "1055",
52
+ "40": "1056",
53
+ "41": "1058",
54
+ "42": "1059",
55
+ "43": "1060",
56
+ "44": "1062",
57
+ "45": "107",
58
+ "46": "1071",
59
+ "47": "1073",
60
+ "48": "108",
61
+ "49": "1084",
62
+ "50": "1086",
63
+ "51": "1097",
64
+ "52": "1099",
65
+ "53": "11",
66
+ "54": "110",
67
+ "55": "1100",
68
+ "56": "1106",
69
+ "57": "1147",
70
+ "58": "1148",
71
+ "59": "1149",
72
+ "60": "1150",
73
+ "61": "1151",
74
+ "62": "1152",
75
+ "63": "1154",
76
+ "64": "1156",
77
+ "65": "1157",
78
+ "66": "1158",
79
+ "67": "1160",
80
+ "68": "1161",
81
+ "69": "1162",
82
+ "70": "1166",
83
+ "71": "1167",
84
+ "72": "1169",
85
+ "73": "1170",
86
+ "74": "1171",
87
+ "75": "1172",
88
+ "76": "1173",
89
+ "77": "1174",
90
+ "78": "1175",
91
+ "79": "1177",
92
+ "80": "1178",
93
+ "81": "1179",
94
+ "82": "118",
95
+ "83": "1180",
96
+ "84": "1181",
97
+ "85": "1184",
98
+ "86": "1185",
99
+ "87": "1186",
100
+ "88": "1187",
101
+ "89": "1188",
102
+ "90": "1189",
103
+ "91": "119",
104
+ "92": "1190",
105
+ "93": "1191",
106
+ "94": "1192",
107
+ "95": "1193",
108
+ "96": "1195",
109
+ "97": "1196",
110
+ "98": "1198",
111
+ "99": "1199",
112
+ "100": "12",
113
+ "101": "120",
114
+ "102": "1201",
115
+ "103": "1202",
116
+ "104": "1203",
117
+ "105": "1204",
118
+ "106": "1205",
119
+ "107": "1206",
120
+ "108": "1207",
121
+ "109": "1208",
122
+ "110": "121",
123
+ "111": "1210",
124
+ "112": "1211",
125
+ "113": "1212",
126
+ "114": "1213",
127
+ "115": "1217",
128
+ "116": "1218",
129
+ "117": "122",
130
+ "118": "1222",
131
+ "119": "1223",
132
+ "120": "1224",
133
+ "121": "1225",
134
+ "122": "1226",
135
+ "123": "1229",
136
+ "124": "123",
137
+ "125": "1230",
138
+ "126": "1231",
139
+ "127": "1232",
140
+ "128": "1233",
141
+ "129": "1234",
142
+ "130": "1235",
143
+ "131": "1236",
144
+ "132": "1238",
145
+ "133": "1239",
146
+ "134": "124",
147
+ "135": "1240",
148
+ "136": "1241",
149
+ "137": "1242",
150
+ "138": "1243",
151
+ "139": "1244",
152
+ "140": "1245",
153
+ "141": "1246",
154
+ "142": "1247",
155
+ "143": "1248",
156
+ "144": "1249",
157
+ "145": "125",
158
+ "146": "1250",
159
+ "147": "1251",
160
+ "148": "1252",
161
+ "149": "1253",
162
+ "150": "1256",
163
+ "151": "1257",
164
+ "152": "1258",
165
+ "153": "1259",
166
+ "154": "126",
167
+ "155": "1260",
168
+ "156": "1261",
169
+ "157": "1262",
170
+ "158": "1263",
171
+ "159": "1264",
172
+ "160": "1266",
173
+ "161": "1267",
174
+ "162": "1268",
175
+ "163": "1269",
176
+ "164": "127",
177
+ "165": "1270",
178
+ "166": "1271",
179
+ "167": "1272",
180
+ "168": "1273",
181
+ "169": "1274",
182
+ "170": "1275",
183
+ "171": "1276",
184
+ "172": "1277",
185
+ "173": "1278",
186
+ "174": "1279",
187
+ "175": "128",
188
+ "176": "1280",
189
+ "177": "1281",
190
+ "178": "1282",
191
+ "179": "1283",
192
+ "180": "1284",
193
+ "181": "1285",
194
+ "182": "1287",
195
+ "183": "1288",
196
+ "184": "1289",
197
+ "185": "1290",
198
+ "186": "1291",
199
+ "187": "1292",
200
+ "188": "1293",
201
+ "189": "1294",
202
+ "190": "1295",
203
+ "191": "1296",
204
+ "192": "1297",
205
+ "193": "1298",
206
+ "194": "1299",
207
+ "195": "13",
208
+ "196": "1300",
209
+ "197": "1301",
210
+ "198": "1302",
211
+ "199": "1303",
212
+ "200": "1304",
213
+ "201": "1305",
214
+ "202": "1306",
215
+ "203": "1307",
216
+ "204": "1308",
217
+ "205": "1309",
218
+ "206": "1310",
219
+ "207": "1311",
220
+ "208": "1312",
221
+ "209": "1313",
222
+ "210": "1314",
223
+ "211": "1315",
224
+ "212": "1316",
225
+ "213": "1317",
226
+ "214": "1318",
227
+ "215": "1319",
228
+ "216": "1320",
229
+ "217": "1321",
230
+ "218": "1322",
231
+ "219": "1323",
232
+ "220": "1324",
233
+ "221": "1325",
234
+ "222": "1326",
235
+ "223": "1327",
236
+ "224": "1328",
237
+ "225": "1329",
238
+ "226": "133",
239
+ "227": "1330",
240
+ "228": "1331",
241
+ "229": "1333",
242
+ "230": "1334",
243
+ "231": "1336",
244
+ "232": "1340",
245
+ "233": "1341",
246
+ "234": "1342",
247
+ "235": "1343",
248
+ "236": "1346",
249
+ "237": "135",
250
+ "238": "1350",
251
+ "239": "1351",
252
+ "240": "1357",
253
+ "241": "1359",
254
+ "242": "136",
255
+ "243": "1361",
256
+ "244": "1362",
257
+ "245": "1363",
258
+ "246": "1364",
259
+ "247": "1365",
260
+ "248": "1367",
261
+ "249": "1368",
262
+ "250": "1369",
263
+ "251": "137",
264
+ "252": "1370",
265
+ "253": "1371",
266
+ "254": "1372",
267
+ "255": "1373",
268
+ "256": "1374",
269
+ "257": "1376",
270
+ "258": "1377",
271
+ "259": "1378",
272
+ "260": "1379",
273
+ "261": "138",
274
+ "262": "1380",
275
+ "263": "1382",
276
+ "264": "1383",
277
+ "265": "1384",
278
+ "266": "1385",
279
+ "267": "1386",
280
+ "268": "1387",
281
+ "269": "1388",
282
+ "270": "1389",
283
+ "271": "139",
284
+ "272": "1391",
285
+ "273": "1396",
286
+ "274": "1397",
287
+ "275": "1398",
288
+ "276": "1399",
289
+ "277": "14",
290
+ "278": "140",
291
+ "279": "1400",
292
+ "280": "1401",
293
+ "281": "1402",
294
+ "282": "1403",
295
+ "283": "141",
296
+ "284": "1413",
297
+ "285": "1415",
298
+ "286": "1416",
299
+ "287": "1417",
300
+ "288": "1419",
301
+ "289": "142",
302
+ "290": "1420",
303
+ "291": "1421",
304
+ "292": "1422",
305
+ "293": "1423",
306
+ "294": "1425",
307
+ "295": "1426",
308
+ "296": "1427",
309
+ "297": "1428",
310
+ "298": "1429",
311
+ "299": "143",
312
+ "300": "1430",
313
+ "301": "1431",
314
+ "302": "1432",
315
+ "303": "1433",
316
+ "304": "1438",
317
+ "305": "1439",
318
+ "306": "144",
319
+ "307": "1441",
320
+ "308": "1443",
321
+ "309": "1444",
322
+ "310": "1445",
323
+ "311": "1446",
324
+ "312": "1447",
325
+ "313": "1448",
326
+ "314": "1449",
327
+ "315": "145",
328
+ "316": "1450",
329
+ "317": "1451",
330
+ "318": "1452",
331
+ "319": "1453",
332
+ "320": "1454",
333
+ "321": "1455",
334
+ "322": "1456",
335
+ "323": "1457",
336
+ "324": "1458",
337
+ "325": "1459",
338
+ "326": "146",
339
+ "327": "1460",
340
+ "328": "1461",
341
+ "329": "1462",
342
+ "330": "1463",
343
+ "331": "1464",
344
+ "332": "1465",
345
+ "333": "1466",
346
+ "334": "1467",
347
+ "335": "1468",
348
+ "336": "1469",
349
+ "337": "147",
350
+ "338": "1470",
351
+ "339": "1471",
352
+ "340": "1473",
353
+ "341": "1474",
354
+ "342": "1475",
355
+ "343": "1476",
356
+ "344": "1477",
357
+ "345": "1478",
358
+ "346": "1479",
359
+ "347": "1480",
360
+ "348": "1481",
361
+ "349": "1482",
362
+ "350": "1483",
363
+ "351": "1484",
364
+ "352": "1485",
365
+ "353": "1486",
366
+ "354": "1487",
367
+ "355": "1488",
368
+ "356": "1489",
369
+ "357": "1490",
370
+ "358": "1491",
371
+ "359": "1492",
372
+ "360": "1493",
373
+ "361": "1494",
374
+ "362": "1495",
375
+ "363": "1496",
376
+ "364": "1497",
377
+ "365": "1498",
378
+ "366": "1499",
379
+ "367": "15",
380
+ "368": "1500",
381
+ "369": "1501",
382
+ "370": "1502",
383
+ "371": "1507",
384
+ "372": "1509",
385
+ "373": "1510",
386
+ "374": "1511",
387
+ "375": "1512",
388
+ "376": "1513",
389
+ "377": "1514",
390
+ "378": "1515",
391
+ "379": "1516",
392
+ "380": "1517",
393
+ "381": "1518",
394
+ "382": "1519",
395
+ "383": "152",
396
+ "384": "1520",
397
+ "385": "1521",
398
+ "386": "1522",
399
+ "387": "1523",
400
+ "388": "1524",
401
+ "389": "1525",
402
+ "390": "1526",
403
+ "391": "1527",
404
+ "392": "1528",
405
+ "393": "1529",
406
+ "394": "153",
407
+ "395": "1530",
408
+ "396": "1531",
409
+ "397": "1532",
410
+ "398": "1533",
411
+ "399": "1534",
412
+ "400": "1535",
413
+ "401": "1536",
414
+ "402": "1537",
415
+ "403": "1538",
416
+ "404": "1539",
417
+ "405": "154",
418
+ "406": "1540",
419
+ "407": "1541",
420
+ "408": "1542",
421
+ "409": "1543",
422
+ "410": "1544",
423
+ "411": "1545",
424
+ "412": "1546",
425
+ "413": "1547",
426
+ "414": "1548",
427
+ "415": "1549",
428
+ "416": "155",
429
+ "417": "1550",
430
+ "418": "1551",
431
+ "419": "1552",
432
+ "420": "1553",
433
+ "421": "1554",
434
+ "422": "1555",
435
+ "423": "1556",
436
+ "424": "1557",
437
+ "425": "1558",
438
+ "426": "1559",
439
+ "427": "1560",
440
+ "428": "1561",
441
+ "429": "1562",
442
+ "430": "1563",
443
+ "431": "1564",
444
+ "432": "1565",
445
+ "433": "1566",
446
+ "434": "1567",
447
+ "435": "1568",
448
+ "436": "1569",
449
+ "437": "157",
450
+ "438": "1570",
451
+ "439": "1571",
452
+ "440": "1572",
453
+ "441": "1573",
454
+ "442": "1574",
455
+ "443": "1575",
456
+ "444": "1576",
457
+ "445": "1577",
458
+ "446": "1578",
459
+ "447": "1579",
460
+ "448": "158",
461
+ "449": "1580",
462
+ "450": "1581",
463
+ "451": "1582",
464
+ "452": "1583",
465
+ "453": "1584",
466
+ "454": "1585",
467
+ "455": "1586",
468
+ "456": "159",
469
+ "457": "160",
470
+ "458": "162",
471
+ "459": "163",
472
+ "460": "164",
473
+ "461": "165",
474
+ "462": "166",
475
+ "463": "167",
476
+ "464": "168",
477
+ "465": "169",
478
+ "466": "17",
479
+ "467": "170",
480
+ "468": "171",
481
+ "469": "172",
482
+ "470": "173",
483
+ "471": "174",
484
+ "472": "175",
485
+ "473": "177",
486
+ "474": "178",
487
+ "475": "179",
488
+ "476": "18",
489
+ "477": "180",
490
+ "478": "181",
491
+ "479": "182",
492
+ "480": "19",
493
+ "481": "192",
494
+ "482": "193",
495
+ "483": "194",
496
+ "484": "195",
497
+ "485": "197",
498
+ "486": "199",
499
+ "487": "20",
500
+ "488": "200",
501
+ "489": "202",
502
+ "490": "203",
503
+ "491": "204",
504
+ "492": "205",
505
+ "493": "206",
506
+ "494": "207",
507
+ "495": "208",
508
+ "496": "209",
509
+ "497": "210",
510
+ "498": "211",
511
+ "499": "212",
512
+ "500": "213",
513
+ "501": "214",
514
+ "502": "215",
515
+ "503": "216",
516
+ "504": "217",
517
+ "505": "218",
518
+ "506": "219",
519
+ "507": "22",
520
+ "508": "220",
521
+ "509": "221",
522
+ "510": "222",
523
+ "511": "223",
524
+ "512": "224",
525
+ "513": "225",
526
+ "514": "226",
527
+ "515": "227",
528
+ "516": "229",
529
+ "517": "23",
530
+ "518": "230",
531
+ "519": "231",
532
+ "520": "232",
533
+ "521": "233",
534
+ "522": "234",
535
+ "523": "236",
536
+ "524": "237",
537
+ "525": "238",
538
+ "526": "239",
539
+ "527": "24",
540
+ "528": "240",
541
+ "529": "241",
542
+ "530": "242",
543
+ "531": "243",
544
+ "532": "244",
545
+ "533": "245",
546
+ "534": "246",
547
+ "535": "247",
548
+ "536": "248",
549
+ "537": "249",
550
+ "538": "25",
551
+ "539": "250",
552
+ "540": "251",
553
+ "541": "252",
554
+ "542": "253",
555
+ "543": "254",
556
+ "544": "255",
557
+ "545": "256",
558
+ "546": "257",
559
+ "547": "259",
560
+ "548": "26",
561
+ "549": "260",
562
+ "550": "261",
563
+ "551": "262",
564
+ "552": "27",
565
+ "553": "28",
566
+ "554": "288",
567
+ "555": "289",
568
+ "556": "29",
569
+ "557": "290",
570
+ "558": "291",
571
+ "559": "292",
572
+ "560": "293",
573
+ "561": "294",
574
+ "562": "295",
575
+ "563": "296",
576
+ "564": "297",
577
+ "565": "298",
578
+ "566": "30",
579
+ "567": "300",
580
+ "568": "301",
581
+ "569": "302",
582
+ "570": "303",
583
+ "571": "304",
584
+ "572": "306",
585
+ "573": "307",
586
+ "574": "308",
587
+ "575": "309",
588
+ "576": "31",
589
+ "577": "310",
590
+ "578": "311",
591
+ "579": "312",
592
+ "580": "313",
593
+ "581": "315",
594
+ "582": "317",
595
+ "583": "318",
596
+ "584": "319",
597
+ "585": "32",
598
+ "586": "320",
599
+ "587": "321",
600
+ "588": "322",
601
+ "589": "323",
602
+ "590": "324",
603
+ "591": "325",
604
+ "592": "326",
605
+ "593": "327",
606
+ "594": "328",
607
+ "595": "329",
608
+ "596": "33",
609
+ "597": "330",
610
+ "598": "331",
611
+ "599": "332",
612
+ "600": "333",
613
+ "601": "334",
614
+ "602": "335",
615
+ "603": "336",
616
+ "604": "337",
617
+ "605": "338",
618
+ "606": "339",
619
+ "607": "34",
620
+ "608": "340",
621
+ "609": "341",
622
+ "610": "342",
623
+ "611": "343",
624
+ "612": "344",
625
+ "613": "345",
626
+ "614": "349",
627
+ "615": "35",
628
+ "616": "350",
629
+ "617": "351",
630
+ "618": "352",
631
+ "619": "353",
632
+ "620": "354",
633
+ "621": "355",
634
+ "622": "356",
635
+ "623": "358",
636
+ "624": "359",
637
+ "625": "36",
638
+ "626": "361",
639
+ "627": "362",
640
+ "628": "363",
641
+ "629": "364",
642
+ "630": "365",
643
+ "631": "366",
644
+ "632": "367",
645
+ "633": "368",
646
+ "634": "369",
647
+ "635": "37",
648
+ "636": "370",
649
+ "637": "371",
650
+ "638": "372",
651
+ "639": "373",
652
+ "640": "374",
653
+ "641": "375",
654
+ "642": "376",
655
+ "643": "377",
656
+ "644": "378",
657
+ "645": "379",
658
+ "646": "38",
659
+ "647": "380",
660
+ "648": "381",
661
+ "649": "382",
662
+ "650": "383",
663
+ "651": "384",
664
+ "652": "385",
665
+ "653": "386",
666
+ "654": "387",
667
+ "655": "388",
668
+ "656": "389",
669
+ "657": "39",
670
+ "658": "390",
671
+ "659": "391",
672
+ "660": "392",
673
+ "661": "393",
674
+ "662": "394",
675
+ "663": "395",
676
+ "664": "396",
677
+ "665": "397",
678
+ "666": "398",
679
+ "667": "399",
680
+ "668": "4",
681
+ "669": "40",
682
+ "670": "400",
683
+ "671": "401",
684
+ "672": "402",
685
+ "673": "403",
686
+ "674": "404",
687
+ "675": "405",
688
+ "676": "406",
689
+ "677": "407",
690
+ "678": "409",
691
+ "679": "41",
692
+ "680": "411",
693
+ "681": "412",
694
+ "682": "414",
695
+ "683": "415",
696
+ "684": "416",
697
+ "685": "418",
698
+ "686": "419",
699
+ "687": "42",
700
+ "688": "420",
701
+ "689": "421",
702
+ "690": "422",
703
+ "691": "423",
704
+ "692": "424",
705
+ "693": "425",
706
+ "694": "426",
707
+ "695": "427",
708
+ "696": "429",
709
+ "697": "43",
710
+ "698": "430",
711
+ "699": "431",
712
+ "700": "432",
713
+ "701": "433",
714
+ "702": "434",
715
+ "703": "435",
716
+ "704": "436",
717
+ "705": "437",
718
+ "706": "438",
719
+ "707": "439",
720
+ "708": "44",
721
+ "709": "440",
722
+ "710": "441",
723
+ "711": "442",
724
+ "712": "443",
725
+ "713": "444",
726
+ "714": "445",
727
+ "715": "446",
728
+ "716": "447",
729
+ "717": "448",
730
+ "718": "449",
731
+ "719": "45",
732
+ "720": "450",
733
+ "721": "451",
734
+ "722": "452",
735
+ "723": "453",
736
+ "724": "454",
737
+ "725": "455",
738
+ "726": "456",
739
+ "727": "457",
740
+ "728": "458",
741
+ "729": "459",
742
+ "730": "46",
743
+ "731": "460",
744
+ "732": "461",
745
+ "733": "462",
746
+ "734": "463",
747
+ "735": "464",
748
+ "736": "465",
749
+ "737": "466",
750
+ "738": "467",
751
+ "739": "468",
752
+ "740": "469",
753
+ "741": "47",
754
+ "742": "470",
755
+ "743": "471",
756
+ "744": "472",
757
+ "745": "473",
758
+ "746": "474",
759
+ "747": "475",
760
+ "748": "476",
761
+ "749": "477",
762
+ "750": "478",
763
+ "751": "479",
764
+ "752": "480",
765
+ "753": "481",
766
+ "754": "482",
767
+ "755": "483",
768
+ "756": "484",
769
+ "757": "485",
770
+ "758": "486",
771
+ "759": "487",
772
+ "760": "488",
773
+ "761": "489",
774
+ "762": "49",
775
+ "763": "490",
776
+ "764": "491",
777
+ "765": "492",
778
+ "766": "493",
779
+ "767": "494",
780
+ "768": "495",
781
+ "769": "496",
782
+ "770": "497",
783
+ "771": "499",
784
+ "772": "5",
785
+ "773": "50",
786
+ "774": "500",
787
+ "775": "501",
788
+ "776": "502",
789
+ "777": "503",
790
+ "778": "504",
791
+ "779": "505",
792
+ "780": "506",
793
+ "781": "507",
794
+ "782": "508",
795
+ "783": "509",
796
+ "784": "51",
797
+ "785": "510",
798
+ "786": "511",
799
+ "787": "512",
800
+ "788": "513",
801
+ "789": "514",
802
+ "790": "515",
803
+ "791": "516",
804
+ "792": "517",
805
+ "793": "518",
806
+ "794": "519",
807
+ "795": "52",
808
+ "796": "520",
809
+ "797": "521",
810
+ "798": "522",
811
+ "799": "523",
812
+ "800": "524",
813
+ "801": "525",
814
+ "802": "526",
815
+ "803": "527",
816
+ "804": "528",
817
+ "805": "529",
818
+ "806": "53",
819
+ "807": "530",
820
+ "808": "531",
821
+ "809": "532",
822
+ "810": "533",
823
+ "811": "534",
824
+ "812": "535",
825
+ "813": "536",
826
+ "814": "537",
827
+ "815": "538",
828
+ "816": "539",
829
+ "817": "54",
830
+ "818": "540",
831
+ "819": "541",
832
+ "820": "542",
833
+ "821": "543",
834
+ "822": "544",
835
+ "823": "546",
836
+ "824": "547",
837
+ "825": "548",
838
+ "826": "549",
839
+ "827": "55",
840
+ "828": "550",
841
+ "829": "551",
842
+ "830": "552",
843
+ "831": "553",
844
+ "832": "554",
845
+ "833": "555",
846
+ "834": "556",
847
+ "835": "557",
848
+ "836": "558",
849
+ "837": "559",
850
+ "838": "56",
851
+ "839": "560",
852
+ "840": "561",
853
+ "841": "562",
854
+ "842": "563",
855
+ "843": "564",
856
+ "844": "565",
857
+ "845": "566",
858
+ "846": "567",
859
+ "847": "568",
860
+ "848": "569",
861
+ "849": "57",
862
+ "850": "570",
863
+ "851": "571",
864
+ "852": "572",
865
+ "853": "573",
866
+ "854": "574",
867
+ "855": "575",
868
+ "856": "576",
869
+ "857": "577",
870
+ "858": "578",
871
+ "859": "579",
872
+ "860": "580",
873
+ "861": "581",
874
+ "862": "582",
875
+ "863": "583",
876
+ "864": "584",
877
+ "865": "585",
878
+ "866": "586",
879
+ "867": "587",
880
+ "868": "588",
881
+ "869": "589",
882
+ "870": "591",
883
+ "871": "593",
884
+ "872": "594",
885
+ "873": "595",
886
+ "874": "597",
887
+ "875": "598",
888
+ "876": "599",
889
+ "877": "6",
890
+ "878": "600",
891
+ "879": "601",
892
+ "880": "602",
893
+ "881": "603",
894
+ "882": "604",
895
+ "883": "605",
896
+ "884": "606",
897
+ "885": "607",
898
+ "886": "608",
899
+ "887": "609",
900
+ "888": "610",
901
+ "889": "611",
902
+ "890": "612",
903
+ "891": "613",
904
+ "892": "614",
905
+ "893": "615",
906
+ "894": "616",
907
+ "895": "618",
908
+ "896": "619",
909
+ "897": "620",
910
+ "898": "621",
911
+ "899": "622",
912
+ "900": "623",
913
+ "901": "624",
914
+ "902": "625",
915
+ "903": "626",
916
+ "904": "627",
917
+ "905": "628",
918
+ "906": "629",
919
+ "907": "630",
920
+ "908": "631",
921
+ "909": "632",
922
+ "910": "633",
923
+ "911": "634",
924
+ "912": "635",
925
+ "913": "636",
926
+ "914": "637",
927
+ "915": "638",
928
+ "916": "64",
929
+ "917": "640",
930
+ "918": "641",
931
+ "919": "643",
932
+ "920": "645",
933
+ "921": "646",
934
+ "922": "647",
935
+ "923": "648",
936
+ "924": "649",
937
+ "925": "65",
938
+ "926": "650",
939
+ "927": "651",
940
+ "928": "652",
941
+ "929": "653",
942
+ "930": "654",
943
+ "931": "655",
944
+ "932": "656",
945
+ "933": "657",
946
+ "934": "658",
947
+ "935": "659",
948
+ "936": "660",
949
+ "937": "661",
950
+ "938": "662",
951
+ "939": "663",
952
+ "940": "664",
953
+ "941": "665",
954
+ "942": "666",
955
+ "943": "667",
956
+ "944": "668",
957
+ "945": "669",
958
+ "946": "67",
959
+ "947": "670",
960
+ "948": "671",
961
+ "949": "672",
962
+ "950": "673",
963
+ "951": "675",
964
+ "952": "676",
965
+ "953": "677",
966
+ "954": "679",
967
+ "955": "680",
968
+ "956": "681",
969
+ "957": "682",
970
+ "958": "683",
971
+ "959": "684",
972
+ "960": "685",
973
+ "961": "686",
974
+ "962": "687",
975
+ "963": "688",
976
+ "964": "689",
977
+ "965": "69",
978
+ "966": "690",
979
+ "967": "691",
980
+ "968": "692",
981
+ "969": "694",
982
+ "970": "695",
983
+ "971": "696",
984
+ "972": "697",
985
+ "973": "698",
986
+ "974": "699",
987
+ "975": "7",
988
+ "976": "70",
989
+ "977": "700",
990
+ "978": "701",
991
+ "979": "702",
992
+ "980": "703",
993
+ "981": "704",
994
+ "982": "705",
995
+ "983": "706",
996
+ "984": "707",
997
+ "985": "708",
998
+ "986": "709",
999
+ "987": "71",
1000
+ "988": "710",
1001
+ "989": "711",
1002
+ "990": "712",
1003
+ "991": "713",
1004
+ "992": "714",
1005
+ "993": "72",
1006
+ "994": "721",
1007
+ "995": "722",
1008
+ "996": "723",
1009
+ "997": "724",
1010
+ "998": "725",
1011
+ "999": "726",
1012
+ "1000": "727",
1013
+ "1001": "728",
1014
+ "1002": "729",
1015
+ "1003": "73",
1016
+ "1004": "730",
1017
+ "1005": "731",
1018
+ "1006": "732",
1019
+ "1007": "733",
1020
+ "1008": "734",
1021
+ "1009": "735",
1022
+ "1010": "736",
1023
+ "1011": "737",
1024
+ "1012": "738",
1025
+ "1013": "739",
1026
+ "1014": "740",
1027
+ "1015": "741",
1028
+ "1016": "742",
1029
+ "1017": "743",
1030
+ "1018": "744",
1031
+ "1019": "745",
1032
+ "1020": "746",
1033
+ "1021": "747",
1034
+ "1022": "748",
1035
+ "1023": "749",
1036
+ "1024": "75",
1037
+ "1025": "750",
1038
+ "1026": "752",
1039
+ "1027": "753",
1040
+ "1028": "754",
1041
+ "1029": "755",
1042
+ "1030": "756",
1043
+ "1031": "757",
1044
+ "1032": "758",
1045
+ "1033": "759",
1046
+ "1034": "76",
1047
+ "1035": "760",
1048
+ "1036": "761",
1049
+ "1037": "762",
1050
+ "1038": "763",
1051
+ "1039": "764",
1052
+ "1040": "765",
1053
+ "1041": "766",
1054
+ "1042": "767",
1055
+ "1043": "768",
1056
+ "1044": "769",
1057
+ "1045": "77",
1058
+ "1046": "770",
1059
+ "1047": "772",
1060
+ "1048": "773",
1061
+ "1049": "774",
1062
+ "1050": "775",
1063
+ "1051": "776",
1064
+ "1052": "777",
1065
+ "1053": "778",
1066
+ "1054": "779",
1067
+ "1055": "78",
1068
+ "1056": "780",
1069
+ "1057": "781",
1070
+ "1058": "782",
1071
+ "1059": "783",
1072
+ "1060": "784",
1073
+ "1061": "785",
1074
+ "1062": "786",
1075
+ "1063": "787",
1076
+ "1064": "788",
1077
+ "1065": "789",
1078
+ "1066": "79",
1079
+ "1067": "790",
1080
+ "1068": "791",
1081
+ "1069": "792",
1082
+ "1070": "793",
1083
+ "1071": "794",
1084
+ "1072": "795",
1085
+ "1073": "796",
1086
+ "1074": "797",
1087
+ "1075": "798",
1088
+ "1076": "8",
1089
+ "1077": "80",
1090
+ "1078": "800",
1091
+ "1079": "801",
1092
+ "1080": "802",
1093
+ "1081": "803",
1094
+ "1082": "804",
1095
+ "1083": "805",
1096
+ "1084": "806",
1097
+ "1085": "807",
1098
+ "1086": "808",
1099
+ "1087": "809",
1100
+ "1088": "81",
1101
+ "1089": "810",
1102
+ "1090": "811",
1103
+ "1091": "812",
1104
+ "1092": "813",
1105
+ "1093": "814",
1106
+ "1094": "815",
1107
+ "1095": "816",
1108
+ "1096": "817",
1109
+ "1097": "818",
1110
+ "1098": "819",
1111
+ "1099": "82",
1112
+ "1100": "820",
1113
+ "1101": "821",
1114
+ "1102": "822",
1115
+ "1103": "824",
1116
+ "1104": "825",
1117
+ "1105": "826",
1118
+ "1106": "827",
1119
+ "1107": "828",
1120
+ "1108": "829",
1121
+ "1109": "83",
1122
+ "1110": "830",
1123
+ "1111": "831",
1124
+ "1112": "832",
1125
+ "1113": "833",
1126
+ "1114": "834",
1127
+ "1115": "835",
1128
+ "1116": "836",
1129
+ "1117": "837",
1130
+ "1118": "838",
1131
+ "1119": "839",
1132
+ "1120": "84",
1133
+ "1121": "840",
1134
+ "1122": "841",
1135
+ "1123": "842",
1136
+ "1124": "843",
1137
+ "1125": "844",
1138
+ "1126": "845",
1139
+ "1127": "846",
1140
+ "1128": "847",
1141
+ "1129": "848",
1142
+ "1130": "849",
1143
+ "1131": "85",
1144
+ "1132": "850",
1145
+ "1133": "851",
1146
+ "1134": "852",
1147
+ "1135": "853",
1148
+ "1136": "854",
1149
+ "1137": "855",
1150
+ "1138": "856",
1151
+ "1139": "857",
1152
+ "1140": "858",
1153
+ "1141": "859",
1154
+ "1142": "86",
1155
+ "1143": "863",
1156
+ "1144": "864",
1157
+ "1145": "865",
1158
+ "1146": "866",
1159
+ "1147": "868",
1160
+ "1148": "87",
1161
+ "1149": "870",
1162
+ "1150": "871",
1163
+ "1151": "872",
1164
+ "1152": "873",
1165
+ "1153": "874",
1166
+ "1154": "875",
1167
+ "1155": "876",
1168
+ "1156": "877",
1169
+ "1157": "878",
1170
+ "1158": "879",
1171
+ "1159": "88",
1172
+ "1160": "880",
1173
+ "1161": "881",
1174
+ "1162": "882",
1175
+ "1163": "883",
1176
+ "1164": "884",
1177
+ "1165": "885",
1178
+ "1166": "886",
1179
+ "1167": "887",
1180
+ "1168": "888",
1181
+ "1169": "889",
1182
+ "1170": "89",
1183
+ "1171": "890",
1184
+ "1172": "891",
1185
+ "1173": "892",
1186
+ "1174": "893",
1187
+ "1175": "894",
1188
+ "1176": "895",
1189
+ "1177": "896",
1190
+ "1178": "897",
1191
+ "1179": "898",
1192
+ "1180": "899",
1193
+ "1181": "9",
1194
+ "1182": "90",
1195
+ "1183": "900",
1196
+ "1184": "901",
1197
+ "1185": "903",
1198
+ "1186": "906",
1199
+ "1187": "909",
1200
+ "1188": "910",
1201
+ "1189": "911",
1202
+ "1190": "912",
1203
+ "1191": "913",
1204
+ "1192": "914",
1205
+ "1193": "915",
1206
+ "1194": "916",
1207
+ "1195": "917",
1208
+ "1196": "918",
1209
+ "1197": "92",
1210
+ "1198": "921",
1211
+ "1199": "922",
1212
+ "1200": "923",
1213
+ "1201": "924",
1214
+ "1202": "925",
1215
+ "1203": "926",
1216
+ "1204": "927",
1217
+ "1205": "928",
1218
+ "1206": "929",
1219
+ "1207": "930",
1220
+ "1208": "931",
1221
+ "1209": "932",
1222
+ "1210": "933",
1223
+ "1211": "934",
1224
+ "1212": "935",
1225
+ "1213": "936",
1226
+ "1214": "937",
1227
+ "1215": "938",
1228
+ "1216": "939",
1229
+ "1217": "940",
1230
+ "1218": "941",
1231
+ "1219": "942",
1232
+ "1220": "943",
1233
+ "1221": "944",
1234
+ "1222": "945",
1235
+ "1223": "946",
1236
+ "1224": "947",
1237
+ "1225": "948",
1238
+ "1226": "949",
1239
+ "1227": "950",
1240
+ "1228": "951",
1241
+ "1229": "952",
1242
+ "1230": "953",
1243
+ "1231": "954",
1244
+ "1232": "955",
1245
+ "1233": "956",
1246
+ "1234": "957",
1247
+ "1235": "958",
1248
+ "1236": "959",
1249
+ "1237": "960",
1250
+ "1238": "961",
1251
+ "1239": "962",
1252
+ "1240": "963",
1253
+ "1241": "964",
1254
+ "1242": "965",
1255
+ "1243": "966",
1256
+ "1244": "967",
1257
+ "1245": "968",
1258
+ "1246": "969",
1259
+ "1247": "97",
1260
+ "1248": "970",
1261
+ "1249": "971",
1262
+ "1250": "972",
1263
+ "1251": "973",
1264
+ "1252": "974",
1265
+ "1253": "975",
1266
+ "1254": "976",
1267
+ "1255": "977",
1268
+ "1256": "978",
1269
+ "1257": "979",
1270
+ "1258": "980",
1271
+ "1259": "981",
1272
+ "1260": "982",
1273
+ "1261": "983",
1274
+ "1262": "984",
1275
+ "1263": "985",
1276
+ "1264": "986",
1277
+ "1265": "989",
1278
+ "1266": "99",
1279
+ "1267": "990",
1280
+ "1268": "991",
1281
+ "1269": "992",
1282
+ "1270": "993",
1283
+ "1271": "994",
1284
+ "1272": "995",
1285
+ "1273": "996",
1286
+ "1274": "997",
1287
+ "1275": "998",
1288
+ "1276": "999"
1289
+ },
1290
+ "initializer_range": 0.02,
1291
+ "intermediate_size": 3072,
1292
+ "label2id": {
1293
+ "1": 0,
1294
+ "10": 1,
1295
+ "100": 2,
1296
+ "1003": 3,
1297
+ "1004": 4,
1298
+ "1005": 5,
1299
+ "1006": 6,
1300
+ "1007": 7,
1301
+ "1008": 8,
1302
+ "1009": 9,
1303
+ "101": 10,
1304
+ "1010": 11,
1305
+ "1011": 12,
1306
+ "1012": 13,
1307
+ "1013": 14,
1308
+ "1014": 15,
1309
+ "1017": 16,
1310
+ "1018": 17,
1311
+ "1019": 18,
1312
+ "102": 19,
1313
+ "1020": 20,
1314
+ "1021": 21,
1315
+ "1022": 22,
1316
+ "1023": 23,
1317
+ "103": 24,
1318
+ "1034": 25,
1319
+ "1035": 26,
1320
+ "104": 27,
1321
+ "1040": 28,
1322
+ "1043": 29,
1323
+ "1046": 30,
1324
+ "1047": 31,
1325
+ "1048": 32,
1326
+ "105": 33,
1327
+ "1050": 34,
1328
+ "1051": 35,
1329
+ "1052": 36,
1330
+ "1053": 37,
1331
+ "1054": 38,
1332
+ "1055": 39,
1333
+ "1056": 40,
1334
+ "1058": 41,
1335
+ "1059": 42,
1336
+ "1060": 43,
1337
+ "1062": 44,
1338
+ "107": 45,
1339
+ "1071": 46,
1340
+ "1073": 47,
1341
+ "108": 48,
1342
+ "1084": 49,
1343
+ "1086": 50,
1344
+ "1097": 51,
1345
+ "1099": 52,
1346
+ "11": 53,
1347
+ "110": 54,
1348
+ "1100": 55,
1349
+ "1106": 56,
1350
+ "1147": 57,
1351
+ "1148": 58,
1352
+ "1149": 59,
1353
+ "1150": 60,
1354
+ "1151": 61,
1355
+ "1152": 62,
1356
+ "1154": 63,
1357
+ "1156": 64,
1358
+ "1157": 65,
1359
+ "1158": 66,
1360
+ "1160": 67,
1361
+ "1161": 68,
1362
+ "1162": 69,
1363
+ "1166": 70,
1364
+ "1167": 71,
1365
+ "1169": 72,
1366
+ "1170": 73,
1367
+ "1171": 74,
1368
+ "1172": 75,
1369
+ "1173": 76,
1370
+ "1174": 77,
1371
+ "1175": 78,
1372
+ "1177": 79,
1373
+ "1178": 80,
1374
+ "1179": 81,
1375
+ "118": 82,
1376
+ "1180": 83,
1377
+ "1181": 84,
1378
+ "1184": 85,
1379
+ "1185": 86,
1380
+ "1186": 87,
1381
+ "1187": 88,
1382
+ "1188": 89,
1383
+ "1189": 90,
1384
+ "119": 91,
1385
+ "1190": 92,
1386
+ "1191": 93,
1387
+ "1192": 94,
1388
+ "1193": 95,
1389
+ "1195": 96,
1390
+ "1196": 97,
1391
+ "1198": 98,
1392
+ "1199": 99,
1393
+ "12": 100,
1394
+ "120": 101,
1395
+ "1201": 102,
1396
+ "1202": 103,
1397
+ "1203": 104,
1398
+ "1204": 105,
1399
+ "1205": 106,
1400
+ "1206": 107,
1401
+ "1207": 108,
1402
+ "1208": 109,
1403
+ "121": 110,
1404
+ "1210": 111,
1405
+ "1211": 112,
1406
+ "1212": 113,
1407
+ "1213": 114,
1408
+ "1217": 115,
1409
+ "1218": 116,
1410
+ "122": 117,
1411
+ "1222": 118,
1412
+ "1223": 119,
1413
+ "1224": 120,
1414
+ "1225": 121,
1415
+ "1226": 122,
1416
+ "1229": 123,
1417
+ "123": 124,
1418
+ "1230": 125,
1419
+ "1231": 126,
1420
+ "1232": 127,
1421
+ "1233": 128,
1422
+ "1234": 129,
1423
+ "1235": 130,
1424
+ "1236": 131,
1425
+ "1238": 132,
1426
+ "1239": 133,
1427
+ "124": 134,
1428
+ "1240": 135,
1429
+ "1241": 136,
1430
+ "1242": 137,
1431
+ "1243": 138,
1432
+ "1244": 139,
1433
+ "1245": 140,
1434
+ "1246": 141,
1435
+ "1247": 142,
1436
+ "1248": 143,
1437
+ "1249": 144,
1438
+ "125": 145,
1439
+ "1250": 146,
1440
+ "1251": 147,
1441
+ "1252": 148,
1442
+ "1253": 149,
1443
+ "1256": 150,
1444
+ "1257": 151,
1445
+ "1258": 152,
1446
+ "1259": 153,
1447
+ "126": 154,
1448
+ "1260": 155,
1449
+ "1261": 156,
1450
+ "1262": 157,
1451
+ "1263": 158,
1452
+ "1264": 159,
1453
+ "1266": 160,
1454
+ "1267": 161,
1455
+ "1268": 162,
1456
+ "1269": 163,
1457
+ "127": 164,
1458
+ "1270": 165,
1459
+ "1271": 166,
1460
+ "1272": 167,
1461
+ "1273": 168,
1462
+ "1274": 169,
1463
+ "1275": 170,
1464
+ "1276": 171,
1465
+ "1277": 172,
1466
+ "1278": 173,
1467
+ "1279": 174,
1468
+ "128": 175,
1469
+ "1280": 176,
1470
+ "1281": 177,
1471
+ "1282": 178,
1472
+ "1283": 179,
1473
+ "1284": 180,
1474
+ "1285": 181,
1475
+ "1287": 182,
1476
+ "1288": 183,
1477
+ "1289": 184,
1478
+ "1290": 185,
1479
+ "1291": 186,
1480
+ "1292": 187,
1481
+ "1293": 188,
1482
+ "1294": 189,
1483
+ "1295": 190,
1484
+ "1296": 191,
1485
+ "1297": 192,
1486
+ "1298": 193,
1487
+ "1299": 194,
1488
+ "13": 195,
1489
+ "1300": 196,
1490
+ "1301": 197,
1491
+ "1302": 198,
1492
+ "1303": 199,
1493
+ "1304": 200,
1494
+ "1305": 201,
1495
+ "1306": 202,
1496
+ "1307": 203,
1497
+ "1308": 204,
1498
+ "1309": 205,
1499
+ "1310": 206,
1500
+ "1311": 207,
1501
+ "1312": 208,
1502
+ "1313": 209,
1503
+ "1314": 210,
1504
+ "1315": 211,
1505
+ "1316": 212,
1506
+ "1317": 213,
1507
+ "1318": 214,
1508
+ "1319": 215,
1509
+ "1320": 216,
1510
+ "1321": 217,
1511
+ "1322": 218,
1512
+ "1323": 219,
1513
+ "1324": 220,
1514
+ "1325": 221,
1515
+ "1326": 222,
1516
+ "1327": 223,
1517
+ "1328": 224,
1518
+ "1329": 225,
1519
+ "133": 226,
1520
+ "1330": 227,
1521
+ "1331": 228,
1522
+ "1333": 229,
1523
+ "1334": 230,
1524
+ "1336": 231,
1525
+ "1340": 232,
1526
+ "1341": 233,
1527
+ "1342": 234,
1528
+ "1343": 235,
1529
+ "1346": 236,
1530
+ "135": 237,
1531
+ "1350": 238,
1532
+ "1351": 239,
1533
+ "1357": 240,
1534
+ "1359": 241,
1535
+ "136": 242,
1536
+ "1361": 243,
1537
+ "1362": 244,
1538
+ "1363": 245,
1539
+ "1364": 246,
1540
+ "1365": 247,
1541
+ "1367": 248,
1542
+ "1368": 249,
1543
+ "1369": 250,
1544
+ "137": 251,
1545
+ "1370": 252,
1546
+ "1371": 253,
1547
+ "1372": 254,
1548
+ "1373": 255,
1549
+ "1374": 256,
1550
+ "1376": 257,
1551
+ "1377": 258,
1552
+ "1378": 259,
1553
+ "1379": 260,
1554
+ "138": 261,
1555
+ "1380": 262,
1556
+ "1382": 263,
1557
+ "1383": 264,
1558
+ "1384": 265,
1559
+ "1385": 266,
1560
+ "1386": 267,
1561
+ "1387": 268,
1562
+ "1388": 269,
1563
+ "1389": 270,
1564
+ "139": 271,
1565
+ "1391": 272,
1566
+ "1396": 273,
1567
+ "1397": 274,
1568
+ "1398": 275,
1569
+ "1399": 276,
1570
+ "14": 277,
1571
+ "140": 278,
1572
+ "1400": 279,
1573
+ "1401": 280,
1574
+ "1402": 281,
1575
+ "1403": 282,
1576
+ "141": 283,
1577
+ "1413": 284,
1578
+ "1415": 285,
1579
+ "1416": 286,
1580
+ "1417": 287,
1581
+ "1419": 288,
1582
+ "142": 289,
1583
+ "1420": 290,
1584
+ "1421": 291,
1585
+ "1422": 292,
1586
+ "1423": 293,
1587
+ "1425": 294,
1588
+ "1426": 295,
1589
+ "1427": 296,
1590
+ "1428": 297,
1591
+ "1429": 298,
1592
+ "143": 299,
1593
+ "1430": 300,
1594
+ "1431": 301,
1595
+ "1432": 302,
1596
+ "1433": 303,
1597
+ "1438": 304,
1598
+ "1439": 305,
1599
+ "144": 306,
1600
+ "1441": 307,
1601
+ "1443": 308,
1602
+ "1444": 309,
1603
+ "1445": 310,
1604
+ "1446": 311,
1605
+ "1447": 312,
1606
+ "1448": 313,
1607
+ "1449": 314,
1608
+ "145": 315,
1609
+ "1450": 316,
1610
+ "1451": 317,
1611
+ "1452": 318,
1612
+ "1453": 319,
1613
+ "1454": 320,
1614
+ "1455": 321,
1615
+ "1456": 322,
1616
+ "1457": 323,
1617
+ "1458": 324,
1618
+ "1459": 325,
1619
+ "146": 326,
1620
+ "1460": 327,
1621
+ "1461": 328,
1622
+ "1462": 329,
1623
+ "1463": 330,
1624
+ "1464": 331,
1625
+ "1465": 332,
1626
+ "1466": 333,
1627
+ "1467": 334,
1628
+ "1468": 335,
1629
+ "1469": 336,
1630
+ "147": 337,
1631
+ "1470": 338,
1632
+ "1471": 339,
1633
+ "1473": 340,
1634
+ "1474": 341,
1635
+ "1475": 342,
1636
+ "1476": 343,
1637
+ "1477": 344,
1638
+ "1478": 345,
1639
+ "1479": 346,
1640
+ "1480": 347,
1641
+ "1481": 348,
1642
+ "1482": 349,
1643
+ "1483": 350,
1644
+ "1484": 351,
1645
+ "1485": 352,
1646
+ "1486": 353,
1647
+ "1487": 354,
1648
+ "1488": 355,
1649
+ "1489": 356,
1650
+ "1490": 357,
1651
+ "1491": 358,
1652
+ "1492": 359,
1653
+ "1493": 360,
1654
+ "1494": 361,
1655
+ "1495": 362,
1656
+ "1496": 363,
1657
+ "1497": 364,
1658
+ "1498": 365,
1659
+ "1499": 366,
1660
+ "15": 367,
1661
+ "1500": 368,
1662
+ "1501": 369,
1663
+ "1502": 370,
1664
+ "1507": 371,
1665
+ "1509": 372,
1666
+ "1510": 373,
1667
+ "1511": 374,
1668
+ "1512": 375,
1669
+ "1513": 376,
1670
+ "1514": 377,
1671
+ "1515": 378,
1672
+ "1516": 379,
1673
+ "1517": 380,
1674
+ "1518": 381,
1675
+ "1519": 382,
1676
+ "152": 383,
1677
+ "1520": 384,
1678
+ "1521": 385,
1679
+ "1522": 386,
1680
+ "1523": 387,
1681
+ "1524": 388,
1682
+ "1525": 389,
1683
+ "1526": 390,
1684
+ "1527": 391,
1685
+ "1528": 392,
1686
+ "1529": 393,
1687
+ "153": 394,
1688
+ "1530": 395,
1689
+ "1531": 396,
1690
+ "1532": 397,
1691
+ "1533": 398,
1692
+ "1534": 399,
1693
+ "1535": 400,
1694
+ "1536": 401,
1695
+ "1537": 402,
1696
+ "1538": 403,
1697
+ "1539": 404,
1698
+ "154": 405,
1699
+ "1540": 406,
1700
+ "1541": 407,
1701
+ "1542": 408,
1702
+ "1543": 409,
1703
+ "1544": 410,
1704
+ "1545": 411,
1705
+ "1546": 412,
1706
+ "1547": 413,
1707
+ "1548": 414,
1708
+ "1549": 415,
1709
+ "155": 416,
1710
+ "1550": 417,
1711
+ "1551": 418,
1712
+ "1552": 419,
1713
+ "1553": 420,
1714
+ "1554": 421,
1715
+ "1555": 422,
1716
+ "1556": 423,
1717
+ "1557": 424,
1718
+ "1558": 425,
1719
+ "1559": 426,
1720
+ "1560": 427,
1721
+ "1561": 428,
1722
+ "1562": 429,
1723
+ "1563": 430,
1724
+ "1564": 431,
1725
+ "1565": 432,
1726
+ "1566": 433,
1727
+ "1567": 434,
1728
+ "1568": 435,
1729
+ "1569": 436,
1730
+ "157": 437,
1731
+ "1570": 438,
1732
+ "1571": 439,
1733
+ "1572": 440,
1734
+ "1573": 441,
1735
+ "1574": 442,
1736
+ "1575": 443,
1737
+ "1576": 444,
1738
+ "1577": 445,
1739
+ "1578": 446,
1740
+ "1579": 447,
1741
+ "158": 448,
1742
+ "1580": 449,
1743
+ "1581": 450,
1744
+ "1582": 451,
1745
+ "1583": 452,
1746
+ "1584": 453,
1747
+ "1585": 454,
1748
+ "1586": 455,
1749
+ "159": 456,
1750
+ "160": 457,
1751
+ "162": 458,
1752
+ "163": 459,
1753
+ "164": 460,
1754
+ "165": 461,
1755
+ "166": 462,
1756
+ "167": 463,
1757
+ "168": 464,
1758
+ "169": 465,
1759
+ "17": 466,
1760
+ "170": 467,
1761
+ "171": 468,
1762
+ "172": 469,
1763
+ "173": 470,
1764
+ "174": 471,
1765
+ "175": 472,
1766
+ "177": 473,
1767
+ "178": 474,
1768
+ "179": 475,
1769
+ "18": 476,
1770
+ "180": 477,
1771
+ "181": 478,
1772
+ "182": 479,
1773
+ "19": 480,
1774
+ "192": 481,
1775
+ "193": 482,
1776
+ "194": 483,
1777
+ "195": 484,
1778
+ "197": 485,
1779
+ "199": 486,
1780
+ "20": 487,
1781
+ "200": 488,
1782
+ "202": 489,
1783
+ "203": 490,
1784
+ "204": 491,
1785
+ "205": 492,
1786
+ "206": 493,
1787
+ "207": 494,
1788
+ "208": 495,
1789
+ "209": 496,
1790
+ "210": 497,
1791
+ "211": 498,
1792
+ "212": 499,
1793
+ "213": 500,
1794
+ "214": 501,
1795
+ "215": 502,
1796
+ "216": 503,
1797
+ "217": 504,
1798
+ "218": 505,
1799
+ "219": 506,
1800
+ "22": 507,
1801
+ "220": 508,
1802
+ "221": 509,
1803
+ "222": 510,
1804
+ "223": 511,
1805
+ "224": 512,
1806
+ "225": 513,
1807
+ "226": 514,
1808
+ "227": 515,
1809
+ "229": 516,
1810
+ "23": 517,
1811
+ "230": 518,
1812
+ "231": 519,
1813
+ "232": 520,
1814
+ "233": 521,
1815
+ "234": 522,
1816
+ "236": 523,
1817
+ "237": 524,
1818
+ "238": 525,
1819
+ "239": 526,
1820
+ "24": 527,
1821
+ "240": 528,
1822
+ "241": 529,
1823
+ "242": 530,
1824
+ "243": 531,
1825
+ "244": 532,
1826
+ "245": 533,
1827
+ "246": 534,
1828
+ "247": 535,
1829
+ "248": 536,
1830
+ "249": 537,
1831
+ "25": 538,
1832
+ "250": 539,
1833
+ "251": 540,
1834
+ "252": 541,
1835
+ "253": 542,
1836
+ "254": 543,
1837
+ "255": 544,
1838
+ "256": 545,
1839
+ "257": 546,
1840
+ "259": 547,
1841
+ "26": 548,
1842
+ "260": 549,
1843
+ "261": 550,
1844
+ "262": 551,
1845
+ "27": 552,
1846
+ "28": 553,
1847
+ "288": 554,
1848
+ "289": 555,
1849
+ "29": 556,
1850
+ "290": 557,
1851
+ "291": 558,
1852
+ "292": 559,
1853
+ "293": 560,
1854
+ "294": 561,
1855
+ "295": 562,
1856
+ "296": 563,
1857
+ "297": 564,
1858
+ "298": 565,
1859
+ "30": 566,
1860
+ "300": 567,
1861
+ "301": 568,
1862
+ "302": 569,
1863
+ "303": 570,
1864
+ "304": 571,
1865
+ "306": 572,
1866
+ "307": 573,
1867
+ "308": 574,
1868
+ "309": 575,
1869
+ "31": 576,
1870
+ "310": 577,
1871
+ "311": 578,
1872
+ "312": 579,
1873
+ "313": 580,
1874
+ "315": 581,
1875
+ "317": 582,
1876
+ "318": 583,
1877
+ "319": 584,
1878
+ "32": 585,
1879
+ "320": 586,
1880
+ "321": 587,
1881
+ "322": 588,
1882
+ "323": 589,
1883
+ "324": 590,
1884
+ "325": 591,
1885
+ "326": 592,
1886
+ "327": 593,
1887
+ "328": 594,
1888
+ "329": 595,
1889
+ "33": 596,
1890
+ "330": 597,
1891
+ "331": 598,
1892
+ "332": 599,
1893
+ "333": 600,
1894
+ "334": 601,
1895
+ "335": 602,
1896
+ "336": 603,
1897
+ "337": 604,
1898
+ "338": 605,
1899
+ "339": 606,
1900
+ "34": 607,
1901
+ "340": 608,
1902
+ "341": 609,
1903
+ "342": 610,
1904
+ "343": 611,
1905
+ "344": 612,
1906
+ "345": 613,
1907
+ "349": 614,
1908
+ "35": 615,
1909
+ "350": 616,
1910
+ "351": 617,
1911
+ "352": 618,
1912
+ "353": 619,
1913
+ "354": 620,
1914
+ "355": 621,
1915
+ "356": 622,
1916
+ "358": 623,
1917
+ "359": 624,
1918
+ "36": 625,
1919
+ "361": 626,
1920
+ "362": 627,
1921
+ "363": 628,
1922
+ "364": 629,
1923
+ "365": 630,
1924
+ "366": 631,
1925
+ "367": 632,
1926
+ "368": 633,
1927
+ "369": 634,
1928
+ "37": 635,
1929
+ "370": 636,
1930
+ "371": 637,
1931
+ "372": 638,
1932
+ "373": 639,
1933
+ "374": 640,
1934
+ "375": 641,
1935
+ "376": 642,
1936
+ "377": 643,
1937
+ "378": 644,
1938
+ "379": 645,
1939
+ "38": 646,
1940
+ "380": 647,
1941
+ "381": 648,
1942
+ "382": 649,
1943
+ "383": 650,
1944
+ "384": 651,
1945
+ "385": 652,
1946
+ "386": 653,
1947
+ "387": 654,
1948
+ "388": 655,
1949
+ "389": 656,
1950
+ "39": 657,
1951
+ "390": 658,
1952
+ "391": 659,
1953
+ "392": 660,
1954
+ "393": 661,
1955
+ "394": 662,
1956
+ "395": 663,
1957
+ "396": 664,
1958
+ "397": 665,
1959
+ "398": 666,
1960
+ "399": 667,
1961
+ "4": 668,
1962
+ "40": 669,
1963
+ "400": 670,
1964
+ "401": 671,
1965
+ "402": 672,
1966
+ "403": 673,
1967
+ "404": 674,
1968
+ "405": 675,
1969
+ "406": 676,
1970
+ "407": 677,
1971
+ "409": 678,
1972
+ "41": 679,
1973
+ "411": 680,
1974
+ "412": 681,
1975
+ "414": 682,
1976
+ "415": 683,
1977
+ "416": 684,
1978
+ "418": 685,
1979
+ "419": 686,
1980
+ "42": 687,
1981
+ "420": 688,
1982
+ "421": 689,
1983
+ "422": 690,
1984
+ "423": 691,
1985
+ "424": 692,
1986
+ "425": 693,
1987
+ "426": 694,
1988
+ "427": 695,
1989
+ "429": 696,
1990
+ "43": 697,
1991
+ "430": 698,
1992
+ "431": 699,
1993
+ "432": 700,
1994
+ "433": 701,
1995
+ "434": 702,
1996
+ "435": 703,
1997
+ "436": 704,
1998
+ "437": 705,
1999
+ "438": 706,
2000
+ "439": 707,
2001
+ "44": 708,
2002
+ "440": 709,
2003
+ "441": 710,
2004
+ "442": 711,
2005
+ "443": 712,
2006
+ "444": 713,
2007
+ "445": 714,
2008
+ "446": 715,
2009
+ "447": 716,
2010
+ "448": 717,
2011
+ "449": 718,
2012
+ "45": 719,
2013
+ "450": 720,
2014
+ "451": 721,
2015
+ "452": 722,
2016
+ "453": 723,
2017
+ "454": 724,
2018
+ "455": 725,
2019
+ "456": 726,
2020
+ "457": 727,
2021
+ "458": 728,
2022
+ "459": 729,
2023
+ "46": 730,
2024
+ "460": 731,
2025
+ "461": 732,
2026
+ "462": 733,
2027
+ "463": 734,
2028
+ "464": 735,
2029
+ "465": 736,
2030
+ "466": 737,
2031
+ "467": 738,
2032
+ "468": 739,
2033
+ "469": 740,
2034
+ "47": 741,
2035
+ "470": 742,
2036
+ "471": 743,
2037
+ "472": 744,
2038
+ "473": 745,
2039
+ "474": 746,
2040
+ "475": 747,
2041
+ "476": 748,
2042
+ "477": 749,
2043
+ "478": 750,
2044
+ "479": 751,
2045
+ "480": 752,
2046
+ "481": 753,
2047
+ "482": 754,
2048
+ "483": 755,
2049
+ "484": 756,
2050
+ "485": 757,
2051
+ "486": 758,
2052
+ "487": 759,
2053
+ "488": 760,
2054
+ "489": 761,
2055
+ "49": 762,
2056
+ "490": 763,
2057
+ "491": 764,
2058
+ "492": 765,
2059
+ "493": 766,
2060
+ "494": 767,
2061
+ "495": 768,
2062
+ "496": 769,
2063
+ "497": 770,
2064
+ "499": 771,
2065
+ "5": 772,
2066
+ "50": 773,
2067
+ "500": 774,
2068
+ "501": 775,
2069
+ "502": 776,
2070
+ "503": 777,
2071
+ "504": 778,
2072
+ "505": 779,
2073
+ "506": 780,
2074
+ "507": 781,
2075
+ "508": 782,
2076
+ "509": 783,
2077
+ "51": 784,
2078
+ "510": 785,
2079
+ "511": 786,
2080
+ "512": 787,
2081
+ "513": 788,
2082
+ "514": 789,
2083
+ "515": 790,
2084
+ "516": 791,
2085
+ "517": 792,
2086
+ "518": 793,
2087
+ "519": 794,
2088
+ "52": 795,
2089
+ "520": 796,
2090
+ "521": 797,
2091
+ "522": 798,
2092
+ "523": 799,
2093
+ "524": 800,
2094
+ "525": 801,
2095
+ "526": 802,
2096
+ "527": 803,
2097
+ "528": 804,
2098
+ "529": 805,
2099
+ "53": 806,
2100
+ "530": 807,
2101
+ "531": 808,
2102
+ "532": 809,
2103
+ "533": 810,
2104
+ "534": 811,
2105
+ "535": 812,
2106
+ "536": 813,
2107
+ "537": 814,
2108
+ "538": 815,
2109
+ "539": 816,
2110
+ "54": 817,
2111
+ "540": 818,
2112
+ "541": 819,
2113
+ "542": 820,
2114
+ "543": 821,
2115
+ "544": 822,
2116
+ "546": 823,
2117
+ "547": 824,
2118
+ "548": 825,
2119
+ "549": 826,
2120
+ "55": 827,
2121
+ "550": 828,
2122
+ "551": 829,
2123
+ "552": 830,
2124
+ "553": 831,
2125
+ "554": 832,
2126
+ "555": 833,
2127
+ "556": 834,
2128
+ "557": 835,
2129
+ "558": 836,
2130
+ "559": 837,
2131
+ "56": 838,
2132
+ "560": 839,
2133
+ "561": 840,
2134
+ "562": 841,
2135
+ "563": 842,
2136
+ "564": 843,
2137
+ "565": 844,
2138
+ "566": 845,
2139
+ "567": 846,
2140
+ "568": 847,
2141
+ "569": 848,
2142
+ "57": 849,
2143
+ "570": 850,
2144
+ "571": 851,
2145
+ "572": 852,
2146
+ "573": 853,
2147
+ "574": 854,
2148
+ "575": 855,
2149
+ "576": 856,
2150
+ "577": 857,
2151
+ "578": 858,
2152
+ "579": 859,
2153
+ "580": 860,
2154
+ "581": 861,
2155
+ "582": 862,
2156
+ "583": 863,
2157
+ "584": 864,
2158
+ "585": 865,
2159
+ "586": 866,
2160
+ "587": 867,
2161
+ "588": 868,
2162
+ "589": 869,
2163
+ "591": 870,
2164
+ "593": 871,
2165
+ "594": 872,
2166
+ "595": 873,
2167
+ "597": 874,
2168
+ "598": 875,
2169
+ "599": 876,
2170
+ "6": 877,
2171
+ "600": 878,
2172
+ "601": 879,
2173
+ "602": 880,
2174
+ "603": 881,
2175
+ "604": 882,
2176
+ "605": 883,
2177
+ "606": 884,
2178
+ "607": 885,
2179
+ "608": 886,
2180
+ "609": 887,
2181
+ "610": 888,
2182
+ "611": 889,
2183
+ "612": 890,
2184
+ "613": 891,
2185
+ "614": 892,
2186
+ "615": 893,
2187
+ "616": 894,
2188
+ "618": 895,
2189
+ "619": 896,
2190
+ "620": 897,
2191
+ "621": 898,
2192
+ "622": 899,
2193
+ "623": 900,
2194
+ "624": 901,
2195
+ "625": 902,
2196
+ "626": 903,
2197
+ "627": 904,
2198
+ "628": 905,
2199
+ "629": 906,
2200
+ "630": 907,
2201
+ "631": 908,
2202
+ "632": 909,
2203
+ "633": 910,
2204
+ "634": 911,
2205
+ "635": 912,
2206
+ "636": 913,
2207
+ "637": 914,
2208
+ "638": 915,
2209
+ "64": 916,
2210
+ "640": 917,
2211
+ "641": 918,
2212
+ "643": 919,
2213
+ "645": 920,
2214
+ "646": 921,
2215
+ "647": 922,
2216
+ "648": 923,
2217
+ "649": 924,
2218
+ "65": 925,
2219
+ "650": 926,
2220
+ "651": 927,
2221
+ "652": 928,
2222
+ "653": 929,
2223
+ "654": 930,
2224
+ "655": 931,
2225
+ "656": 932,
2226
+ "657": 933,
2227
+ "658": 934,
2228
+ "659": 935,
2229
+ "660": 936,
2230
+ "661": 937,
2231
+ "662": 938,
2232
+ "663": 939,
2233
+ "664": 940,
2234
+ "665": 941,
2235
+ "666": 942,
2236
+ "667": 943,
2237
+ "668": 944,
2238
+ "669": 945,
2239
+ "67": 946,
2240
+ "670": 947,
2241
+ "671": 948,
2242
+ "672": 949,
2243
+ "673": 950,
2244
+ "675": 951,
2245
+ "676": 952,
2246
+ "677": 953,
2247
+ "679": 954,
2248
+ "680": 955,
2249
+ "681": 956,
2250
+ "682": 957,
2251
+ "683": 958,
2252
+ "684": 959,
2253
+ "685": 960,
2254
+ "686": 961,
2255
+ "687": 962,
2256
+ "688": 963,
2257
+ "689": 964,
2258
+ "69": 965,
2259
+ "690": 966,
2260
+ "691": 967,
2261
+ "692": 968,
2262
+ "694": 969,
2263
+ "695": 970,
2264
+ "696": 971,
2265
+ "697": 972,
2266
+ "698": 973,
2267
+ "699": 974,
2268
+ "7": 975,
2269
+ "70": 976,
2270
+ "700": 977,
2271
+ "701": 978,
2272
+ "702": 979,
2273
+ "703": 980,
2274
+ "704": 981,
2275
+ "705": 982,
2276
+ "706": 983,
2277
+ "707": 984,
2278
+ "708": 985,
2279
+ "709": 986,
2280
+ "71": 987,
2281
+ "710": 988,
2282
+ "711": 989,
2283
+ "712": 990,
2284
+ "713": 991,
2285
+ "714": 992,
2286
+ "72": 993,
2287
+ "721": 994,
2288
+ "722": 995,
2289
+ "723": 996,
2290
+ "724": 997,
2291
+ "725": 998,
2292
+ "726": 999,
2293
+ "727": 1000,
2294
+ "728": 1001,
2295
+ "729": 1002,
2296
+ "73": 1003,
2297
+ "730": 1004,
2298
+ "731": 1005,
2299
+ "732": 1006,
2300
+ "733": 1007,
2301
+ "734": 1008,
2302
+ "735": 1009,
2303
+ "736": 1010,
2304
+ "737": 1011,
2305
+ "738": 1012,
2306
+ "739": 1013,
2307
+ "740": 1014,
2308
+ "741": 1015,
2309
+ "742": 1016,
2310
+ "743": 1017,
2311
+ "744": 1018,
2312
+ "745": 1019,
2313
+ "746": 1020,
2314
+ "747": 1021,
2315
+ "748": 1022,
2316
+ "749": 1023,
2317
+ "75": 1024,
2318
+ "750": 1025,
2319
+ "752": 1026,
2320
+ "753": 1027,
2321
+ "754": 1028,
2322
+ "755": 1029,
2323
+ "756": 1030,
2324
+ "757": 1031,
2325
+ "758": 1032,
2326
+ "759": 1033,
2327
+ "76": 1034,
2328
+ "760": 1035,
2329
+ "761": 1036,
2330
+ "762": 1037,
2331
+ "763": 1038,
2332
+ "764": 1039,
2333
+ "765": 1040,
2334
+ "766": 1041,
2335
+ "767": 1042,
2336
+ "768": 1043,
2337
+ "769": 1044,
2338
+ "77": 1045,
2339
+ "770": 1046,
2340
+ "772": 1047,
2341
+ "773": 1048,
2342
+ "774": 1049,
2343
+ "775": 1050,
2344
+ "776": 1051,
2345
+ "777": 1052,
2346
+ "778": 1053,
2347
+ "779": 1054,
2348
+ "78": 1055,
2349
+ "780": 1056,
2350
+ "781": 1057,
2351
+ "782": 1058,
2352
+ "783": 1059,
2353
+ "784": 1060,
2354
+ "785": 1061,
2355
+ "786": 1062,
2356
+ "787": 1063,
2357
+ "788": 1064,
2358
+ "789": 1065,
2359
+ "79": 1066,
2360
+ "790": 1067,
2361
+ "791": 1068,
2362
+ "792": 1069,
2363
+ "793": 1070,
2364
+ "794": 1071,
2365
+ "795": 1072,
2366
+ "796": 1073,
2367
+ "797": 1074,
2368
+ "798": 1075,
2369
+ "8": 1076,
2370
+ "80": 1077,
2371
+ "800": 1078,
2372
+ "801": 1079,
2373
+ "802": 1080,
2374
+ "803": 1081,
2375
+ "804": 1082,
2376
+ "805": 1083,
2377
+ "806": 1084,
2378
+ "807": 1085,
2379
+ "808": 1086,
2380
+ "809": 1087,
2381
+ "81": 1088,
2382
+ "810": 1089,
2383
+ "811": 1090,
2384
+ "812": 1091,
2385
+ "813": 1092,
2386
+ "814": 1093,
2387
+ "815": 1094,
2388
+ "816": 1095,
2389
+ "817": 1096,
2390
+ "818": 1097,
2391
+ "819": 1098,
2392
+ "82": 1099,
2393
+ "820": 1100,
2394
+ "821": 1101,
2395
+ "822": 1102,
2396
+ "824": 1103,
2397
+ "825": 1104,
2398
+ "826": 1105,
2399
+ "827": 1106,
2400
+ "828": 1107,
2401
+ "829": 1108,
2402
+ "83": 1109,
2403
+ "830": 1110,
2404
+ "831": 1111,
2405
+ "832": 1112,
2406
+ "833": 1113,
2407
+ "834": 1114,
2408
+ "835": 1115,
2409
+ "836": 1116,
2410
+ "837": 1117,
2411
+ "838": 1118,
2412
+ "839": 1119,
2413
+ "84": 1120,
2414
+ "840": 1121,
2415
+ "841": 1122,
2416
+ "842": 1123,
2417
+ "843": 1124,
2418
+ "844": 1125,
2419
+ "845": 1126,
2420
+ "846": 1127,
2421
+ "847": 1128,
2422
+ "848": 1129,
2423
+ "849": 1130,
2424
+ "85": 1131,
2425
+ "850": 1132,
2426
+ "851": 1133,
2427
+ "852": 1134,
2428
+ "853": 1135,
2429
+ "854": 1136,
2430
+ "855": 1137,
2431
+ "856": 1138,
2432
+ "857": 1139,
2433
+ "858": 1140,
2434
+ "859": 1141,
2435
+ "86": 1142,
2436
+ "863": 1143,
2437
+ "864": 1144,
2438
+ "865": 1145,
2439
+ "866": 1146,
2440
+ "868": 1147,
2441
+ "87": 1148,
2442
+ "870": 1149,
2443
+ "871": 1150,
2444
+ "872": 1151,
2445
+ "873": 1152,
2446
+ "874": 1153,
2447
+ "875": 1154,
2448
+ "876": 1155,
2449
+ "877": 1156,
2450
+ "878": 1157,
2451
+ "879": 1158,
2452
+ "88": 1159,
2453
+ "880": 1160,
2454
+ "881": 1161,
2455
+ "882": 1162,
2456
+ "883": 1163,
2457
+ "884": 1164,
2458
+ "885": 1165,
2459
+ "886": 1166,
2460
+ "887": 1167,
2461
+ "888": 1168,
2462
+ "889": 1169,
2463
+ "89": 1170,
2464
+ "890": 1171,
2465
+ "891": 1172,
2466
+ "892": 1173,
2467
+ "893": 1174,
2468
+ "894": 1175,
2469
+ "895": 1176,
2470
+ "896": 1177,
2471
+ "897": 1178,
2472
+ "898": 1179,
2473
+ "899": 1180,
2474
+ "9": 1181,
2475
+ "90": 1182,
2476
+ "900": 1183,
2477
+ "901": 1184,
2478
+ "903": 1185,
2479
+ "906": 1186,
2480
+ "909": 1187,
2481
+ "910": 1188,
2482
+ "911": 1189,
2483
+ "912": 1190,
2484
+ "913": 1191,
2485
+ "914": 1192,
2486
+ "915": 1193,
2487
+ "916": 1194,
2488
+ "917": 1195,
2489
+ "918": 1196,
2490
+ "92": 1197,
2491
+ "921": 1198,
2492
+ "922": 1199,
2493
+ "923": 1200,
2494
+ "924": 1201,
2495
+ "925": 1202,
2496
+ "926": 1203,
2497
+ "927": 1204,
2498
+ "928": 1205,
2499
+ "929": 1206,
2500
+ "930": 1207,
2501
+ "931": 1208,
2502
+ "932": 1209,
2503
+ "933": 1210,
2504
+ "934": 1211,
2505
+ "935": 1212,
2506
+ "936": 1213,
2507
+ "937": 1214,
2508
+ "938": 1215,
2509
+ "939": 1216,
2510
+ "940": 1217,
2511
+ "941": 1218,
2512
+ "942": 1219,
2513
+ "943": 1220,
2514
+ "944": 1221,
2515
+ "945": 1222,
2516
+ "946": 1223,
2517
+ "947": 1224,
2518
+ "948": 1225,
2519
+ "949": 1226,
2520
+ "950": 1227,
2521
+ "951": 1228,
2522
+ "952": 1229,
2523
+ "953": 1230,
2524
+ "954": 1231,
2525
+ "955": 1232,
2526
+ "956": 1233,
2527
+ "957": 1234,
2528
+ "958": 1235,
2529
+ "959": 1236,
2530
+ "960": 1237,
2531
+ "961": 1238,
2532
+ "962": 1239,
2533
+ "963": 1240,
2534
+ "964": 1241,
2535
+ "965": 1242,
2536
+ "966": 1243,
2537
+ "967": 1244,
2538
+ "968": 1245,
2539
+ "969": 1246,
2540
+ "97": 1247,
2541
+ "970": 1248,
2542
+ "971": 1249,
2543
+ "972": 1250,
2544
+ "973": 1251,
2545
+ "974": 1252,
2546
+ "975": 1253,
2547
+ "976": 1254,
2548
+ "977": 1255,
2549
+ "978": 1256,
2550
+ "979": 1257,
2551
+ "980": 1258,
2552
+ "981": 1259,
2553
+ "982": 1260,
2554
+ "983": 1261,
2555
+ "984": 1262,
2556
+ "985": 1263,
2557
+ "986": 1264,
2558
+ "989": 1265,
2559
+ "99": 1266,
2560
+ "990": 1267,
2561
+ "991": 1268,
2562
+ "992": 1269,
2563
+ "993": 1270,
2564
+ "994": 1271,
2565
+ "995": 1272,
2566
+ "996": 1273,
2567
+ "997": 1274,
2568
+ "998": 1275,
2569
+ "999": 1276
2570
+ },
2571
+ "layer_norm_eps": 1e-12,
2572
+ "max_position_embeddings": 512,
2573
+ "model_type": "bert",
2574
+ "num_attention_heads": 12,
2575
+ "num_hidden_layers": 12,
2576
+ "pad_token_id": 0,
2577
+ "position_embedding_type": "absolute",
2578
+ "problem_type": "multi_label_classification",
2579
+ "torch_dtype": "float32",
2580
+ "transformers_version": "4.55.0",
2581
+ "type_vocab_size": 2,
2582
+ "use_cache": true,
2583
+ "vocab_size": 30522
2584
+ }
checkpoint-30915/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3287eb7cae3e02f71713a53833192c82ba2326cbd0df3e8eeb2d8a370ce5af55
3
+ size 441880548
checkpoint-30915/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1b195b385b275a75d95b194cf786c81cb8b7e2ec2ccae25d4f54e60165d46bc
3
+ size 883885323
checkpoint-30915/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0300deb64c2f8c2571a0c8fa6fdc2d3162b67cba227d5f7ae1c88f8662b9eccd
3
+ size 14645
checkpoint-30915/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e039843a7a14d64f9957d9b75f0580dab4993c0eef03d3ae2c9571eb60bdbff0
3
+ size 1465
checkpoint-30915/special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
checkpoint-30915/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-30915/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "BertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
checkpoint-30915/trainer_state.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-30915/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ffa358e1d86473a58bb22a356036685b801ee0d22015a1c503c8c7f17b40e61
3
+ size 5841
checkpoint-30915/vocab.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-3375/config.json ADDED
@@ -0,0 +1,2584 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertForSequenceClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "id2label": {
12
+ "0": "1",
13
+ "1": "10",
14
+ "2": "100",
15
+ "3": "1003",
16
+ "4": "1004",
17
+ "5": "1005",
18
+ "6": "1006",
19
+ "7": "1007",
20
+ "8": "1008",
21
+ "9": "1009",
22
+ "10": "101",
23
+ "11": "1010",
24
+ "12": "1011",
25
+ "13": "1012",
26
+ "14": "1013",
27
+ "15": "1014",
28
+ "16": "1017",
29
+ "17": "1018",
30
+ "18": "1019",
31
+ "19": "102",
32
+ "20": "1020",
33
+ "21": "1021",
34
+ "22": "1022",
35
+ "23": "1023",
36
+ "24": "103",
37
+ "25": "1034",
38
+ "26": "1035",
39
+ "27": "104",
40
+ "28": "1040",
41
+ "29": "1043",
42
+ "30": "1046",
43
+ "31": "1047",
44
+ "32": "1048",
45
+ "33": "105",
46
+ "34": "1050",
47
+ "35": "1051",
48
+ "36": "1052",
49
+ "37": "1053",
50
+ "38": "1054",
51
+ "39": "1055",
52
+ "40": "1056",
53
+ "41": "1058",
54
+ "42": "1059",
55
+ "43": "1060",
56
+ "44": "1062",
57
+ "45": "107",
58
+ "46": "1071",
59
+ "47": "1073",
60
+ "48": "108",
61
+ "49": "1084",
62
+ "50": "1086",
63
+ "51": "1097",
64
+ "52": "1099",
65
+ "53": "11",
66
+ "54": "110",
67
+ "55": "1100",
68
+ "56": "1106",
69
+ "57": "1147",
70
+ "58": "1148",
71
+ "59": "1149",
72
+ "60": "1150",
73
+ "61": "1151",
74
+ "62": "1152",
75
+ "63": "1154",
76
+ "64": "1156",
77
+ "65": "1157",
78
+ "66": "1158",
79
+ "67": "1160",
80
+ "68": "1161",
81
+ "69": "1162",
82
+ "70": "1166",
83
+ "71": "1167",
84
+ "72": "1169",
85
+ "73": "1170",
86
+ "74": "1171",
87
+ "75": "1172",
88
+ "76": "1173",
89
+ "77": "1174",
90
+ "78": "1175",
91
+ "79": "1177",
92
+ "80": "1178",
93
+ "81": "1179",
94
+ "82": "118",
95
+ "83": "1180",
96
+ "84": "1181",
97
+ "85": "1184",
98
+ "86": "1185",
99
+ "87": "1186",
100
+ "88": "1187",
101
+ "89": "1188",
102
+ "90": "1189",
103
+ "91": "119",
104
+ "92": "1190",
105
+ "93": "1191",
106
+ "94": "1192",
107
+ "95": "1193",
108
+ "96": "1195",
109
+ "97": "1196",
110
+ "98": "1198",
111
+ "99": "1199",
112
+ "100": "12",
113
+ "101": "120",
114
+ "102": "1201",
115
+ "103": "1202",
116
+ "104": "1203",
117
+ "105": "1204",
118
+ "106": "1205",
119
+ "107": "1206",
120
+ "108": "1207",
121
+ "109": "1208",
122
+ "110": "121",
123
+ "111": "1210",
124
+ "112": "1211",
125
+ "113": "1212",
126
+ "114": "1213",
127
+ "115": "1217",
128
+ "116": "1218",
129
+ "117": "122",
130
+ "118": "1222",
131
+ "119": "1223",
132
+ "120": "1224",
133
+ "121": "1225",
134
+ "122": "1226",
135
+ "123": "1229",
136
+ "124": "123",
137
+ "125": "1230",
138
+ "126": "1231",
139
+ "127": "1232",
140
+ "128": "1233",
141
+ "129": "1234",
142
+ "130": "1235",
143
+ "131": "1236",
144
+ "132": "1238",
145
+ "133": "1239",
146
+ "134": "124",
147
+ "135": "1240",
148
+ "136": "1241",
149
+ "137": "1242",
150
+ "138": "1243",
151
+ "139": "1244",
152
+ "140": "1245",
153
+ "141": "1246",
154
+ "142": "1247",
155
+ "143": "1248",
156
+ "144": "1249",
157
+ "145": "125",
158
+ "146": "1250",
159
+ "147": "1251",
160
+ "148": "1252",
161
+ "149": "1253",
162
+ "150": "1256",
163
+ "151": "1257",
164
+ "152": "1258",
165
+ "153": "1259",
166
+ "154": "126",
167
+ "155": "1260",
168
+ "156": "1261",
169
+ "157": "1262",
170
+ "158": "1263",
171
+ "159": "1264",
172
+ "160": "1266",
173
+ "161": "1267",
174
+ "162": "1268",
175
+ "163": "1269",
176
+ "164": "127",
177
+ "165": "1270",
178
+ "166": "1271",
179
+ "167": "1272",
180
+ "168": "1273",
181
+ "169": "1274",
182
+ "170": "1275",
183
+ "171": "1276",
184
+ "172": "1277",
185
+ "173": "1278",
186
+ "174": "1279",
187
+ "175": "128",
188
+ "176": "1280",
189
+ "177": "1281",
190
+ "178": "1282",
191
+ "179": "1283",
192
+ "180": "1284",
193
+ "181": "1285",
194
+ "182": "1287",
195
+ "183": "1288",
196
+ "184": "1289",
197
+ "185": "1290",
198
+ "186": "1291",
199
+ "187": "1292",
200
+ "188": "1293",
201
+ "189": "1294",
202
+ "190": "1295",
203
+ "191": "1296",
204
+ "192": "1297",
205
+ "193": "1298",
206
+ "194": "1299",
207
+ "195": "13",
208
+ "196": "1300",
209
+ "197": "1301",
210
+ "198": "1302",
211
+ "199": "1303",
212
+ "200": "1304",
213
+ "201": "1305",
214
+ "202": "1306",
215
+ "203": "1307",
216
+ "204": "1308",
217
+ "205": "1309",
218
+ "206": "1310",
219
+ "207": "1311",
220
+ "208": "1312",
221
+ "209": "1313",
222
+ "210": "1314",
223
+ "211": "1315",
224
+ "212": "1316",
225
+ "213": "1317",
226
+ "214": "1318",
227
+ "215": "1319",
228
+ "216": "1320",
229
+ "217": "1321",
230
+ "218": "1322",
231
+ "219": "1323",
232
+ "220": "1324",
233
+ "221": "1325",
234
+ "222": "1326",
235
+ "223": "1327",
236
+ "224": "1328",
237
+ "225": "1329",
238
+ "226": "133",
239
+ "227": "1330",
240
+ "228": "1331",
241
+ "229": "1333",
242
+ "230": "1334",
243
+ "231": "1336",
244
+ "232": "1340",
245
+ "233": "1341",
246
+ "234": "1342",
247
+ "235": "1343",
248
+ "236": "1346",
249
+ "237": "135",
250
+ "238": "1350",
251
+ "239": "1351",
252
+ "240": "1357",
253
+ "241": "1359",
254
+ "242": "136",
255
+ "243": "1361",
256
+ "244": "1362",
257
+ "245": "1363",
258
+ "246": "1364",
259
+ "247": "1365",
260
+ "248": "1367",
261
+ "249": "1368",
262
+ "250": "1369",
263
+ "251": "137",
264
+ "252": "1370",
265
+ "253": "1371",
266
+ "254": "1372",
267
+ "255": "1373",
268
+ "256": "1374",
269
+ "257": "1376",
270
+ "258": "1377",
271
+ "259": "1378",
272
+ "260": "1379",
273
+ "261": "138",
274
+ "262": "1380",
275
+ "263": "1382",
276
+ "264": "1383",
277
+ "265": "1384",
278
+ "266": "1385",
279
+ "267": "1386",
280
+ "268": "1387",
281
+ "269": "1388",
282
+ "270": "1389",
283
+ "271": "139",
284
+ "272": "1391",
285
+ "273": "1396",
286
+ "274": "1397",
287
+ "275": "1398",
288
+ "276": "1399",
289
+ "277": "14",
290
+ "278": "140",
291
+ "279": "1400",
292
+ "280": "1401",
293
+ "281": "1402",
294
+ "282": "1403",
295
+ "283": "141",
296
+ "284": "1413",
297
+ "285": "1415",
298
+ "286": "1416",
299
+ "287": "1417",
300
+ "288": "1419",
301
+ "289": "142",
302
+ "290": "1420",
303
+ "291": "1421",
304
+ "292": "1422",
305
+ "293": "1423",
306
+ "294": "1425",
307
+ "295": "1426",
308
+ "296": "1427",
309
+ "297": "1428",
310
+ "298": "1429",
311
+ "299": "143",
312
+ "300": "1430",
313
+ "301": "1431",
314
+ "302": "1432",
315
+ "303": "1433",
316
+ "304": "1438",
317
+ "305": "1439",
318
+ "306": "144",
319
+ "307": "1441",
320
+ "308": "1443",
321
+ "309": "1444",
322
+ "310": "1445",
323
+ "311": "1446",
324
+ "312": "1447",
325
+ "313": "1448",
326
+ "314": "1449",
327
+ "315": "145",
328
+ "316": "1450",
329
+ "317": "1451",
330
+ "318": "1452",
331
+ "319": "1453",
332
+ "320": "1454",
333
+ "321": "1455",
334
+ "322": "1456",
335
+ "323": "1457",
336
+ "324": "1458",
337
+ "325": "1459",
338
+ "326": "146",
339
+ "327": "1460",
340
+ "328": "1461",
341
+ "329": "1462",
342
+ "330": "1463",
343
+ "331": "1464",
344
+ "332": "1465",
345
+ "333": "1466",
346
+ "334": "1467",
347
+ "335": "1468",
348
+ "336": "1469",
349
+ "337": "147",
350
+ "338": "1470",
351
+ "339": "1471",
352
+ "340": "1473",
353
+ "341": "1474",
354
+ "342": "1475",
355
+ "343": "1476",
356
+ "344": "1477",
357
+ "345": "1478",
358
+ "346": "1479",
359
+ "347": "1480",
360
+ "348": "1481",
361
+ "349": "1482",
362
+ "350": "1483",
363
+ "351": "1484",
364
+ "352": "1485",
365
+ "353": "1486",
366
+ "354": "1487",
367
+ "355": "1488",
368
+ "356": "1489",
369
+ "357": "1490",
370
+ "358": "1491",
371
+ "359": "1492",
372
+ "360": "1493",
373
+ "361": "1494",
374
+ "362": "1495",
375
+ "363": "1496",
376
+ "364": "1497",
377
+ "365": "1498",
378
+ "366": "1499",
379
+ "367": "15",
380
+ "368": "1500",
381
+ "369": "1501",
382
+ "370": "1502",
383
+ "371": "1507",
384
+ "372": "1509",
385
+ "373": "1510",
386
+ "374": "1511",
387
+ "375": "1512",
388
+ "376": "1513",
389
+ "377": "1514",
390
+ "378": "1515",
391
+ "379": "1516",
392
+ "380": "1517",
393
+ "381": "1518",
394
+ "382": "1519",
395
+ "383": "152",
396
+ "384": "1520",
397
+ "385": "1521",
398
+ "386": "1522",
399
+ "387": "1523",
400
+ "388": "1524",
401
+ "389": "1525",
402
+ "390": "1526",
403
+ "391": "1527",
404
+ "392": "1528",
405
+ "393": "1529",
406
+ "394": "153",
407
+ "395": "1530",
408
+ "396": "1531",
409
+ "397": "1532",
410
+ "398": "1533",
411
+ "399": "1534",
412
+ "400": "1535",
413
+ "401": "1536",
414
+ "402": "1537",
415
+ "403": "1538",
416
+ "404": "1539",
417
+ "405": "154",
418
+ "406": "1540",
419
+ "407": "1541",
420
+ "408": "1542",
421
+ "409": "1543",
422
+ "410": "1544",
423
+ "411": "1545",
424
+ "412": "1546",
425
+ "413": "1547",
426
+ "414": "1548",
427
+ "415": "1549",
428
+ "416": "155",
429
+ "417": "1550",
430
+ "418": "1551",
431
+ "419": "1552",
432
+ "420": "1553",
433
+ "421": "1554",
434
+ "422": "1555",
435
+ "423": "1556",
436
+ "424": "1557",
437
+ "425": "1558",
438
+ "426": "1559",
439
+ "427": "1560",
440
+ "428": "1561",
441
+ "429": "1562",
442
+ "430": "1563",
443
+ "431": "1564",
444
+ "432": "1565",
445
+ "433": "1566",
446
+ "434": "1567",
447
+ "435": "1568",
448
+ "436": "1569",
449
+ "437": "157",
450
+ "438": "1570",
451
+ "439": "1571",
452
+ "440": "1572",
453
+ "441": "1573",
454
+ "442": "1574",
455
+ "443": "1575",
456
+ "444": "1576",
457
+ "445": "1577",
458
+ "446": "1578",
459
+ "447": "1579",
460
+ "448": "158",
461
+ "449": "1580",
462
+ "450": "1581",
463
+ "451": "1582",
464
+ "452": "1583",
465
+ "453": "1584",
466
+ "454": "1585",
467
+ "455": "1586",
468
+ "456": "159",
469
+ "457": "160",
470
+ "458": "162",
471
+ "459": "163",
472
+ "460": "164",
473
+ "461": "165",
474
+ "462": "166",
475
+ "463": "167",
476
+ "464": "168",
477
+ "465": "169",
478
+ "466": "17",
479
+ "467": "170",
480
+ "468": "171",
481
+ "469": "172",
482
+ "470": "173",
483
+ "471": "174",
484
+ "472": "175",
485
+ "473": "177",
486
+ "474": "178",
487
+ "475": "179",
488
+ "476": "18",
489
+ "477": "180",
490
+ "478": "181",
491
+ "479": "182",
492
+ "480": "19",
493
+ "481": "192",
494
+ "482": "193",
495
+ "483": "194",
496
+ "484": "195",
497
+ "485": "197",
498
+ "486": "199",
499
+ "487": "20",
500
+ "488": "200",
501
+ "489": "202",
502
+ "490": "203",
503
+ "491": "204",
504
+ "492": "205",
505
+ "493": "206",
506
+ "494": "207",
507
+ "495": "208",
508
+ "496": "209",
509
+ "497": "210",
510
+ "498": "211",
511
+ "499": "212",
512
+ "500": "213",
513
+ "501": "214",
514
+ "502": "215",
515
+ "503": "216",
516
+ "504": "217",
517
+ "505": "218",
518
+ "506": "219",
519
+ "507": "22",
520
+ "508": "220",
521
+ "509": "221",
522
+ "510": "222",
523
+ "511": "223",
524
+ "512": "224",
525
+ "513": "225",
526
+ "514": "226",
527
+ "515": "227",
528
+ "516": "229",
529
+ "517": "23",
530
+ "518": "230",
531
+ "519": "231",
532
+ "520": "232",
533
+ "521": "233",
534
+ "522": "234",
535
+ "523": "236",
536
+ "524": "237",
537
+ "525": "238",
538
+ "526": "239",
539
+ "527": "24",
540
+ "528": "240",
541
+ "529": "241",
542
+ "530": "242",
543
+ "531": "243",
544
+ "532": "244",
545
+ "533": "245",
546
+ "534": "246",
547
+ "535": "247",
548
+ "536": "248",
549
+ "537": "249",
550
+ "538": "25",
551
+ "539": "250",
552
+ "540": "251",
553
+ "541": "252",
554
+ "542": "253",
555
+ "543": "254",
556
+ "544": "255",
557
+ "545": "256",
558
+ "546": "257",
559
+ "547": "259",
560
+ "548": "26",
561
+ "549": "260",
562
+ "550": "261",
563
+ "551": "262",
564
+ "552": "27",
565
+ "553": "28",
566
+ "554": "288",
567
+ "555": "289",
568
+ "556": "29",
569
+ "557": "290",
570
+ "558": "291",
571
+ "559": "292",
572
+ "560": "293",
573
+ "561": "294",
574
+ "562": "295",
575
+ "563": "296",
576
+ "564": "297",
577
+ "565": "298",
578
+ "566": "30",
579
+ "567": "300",
580
+ "568": "301",
581
+ "569": "302",
582
+ "570": "303",
583
+ "571": "304",
584
+ "572": "306",
585
+ "573": "307",
586
+ "574": "308",
587
+ "575": "309",
588
+ "576": "31",
589
+ "577": "310",
590
+ "578": "311",
591
+ "579": "312",
592
+ "580": "313",
593
+ "581": "315",
594
+ "582": "317",
595
+ "583": "318",
596
+ "584": "319",
597
+ "585": "32",
598
+ "586": "320",
599
+ "587": "321",
600
+ "588": "322",
601
+ "589": "323",
602
+ "590": "324",
603
+ "591": "325",
604
+ "592": "326",
605
+ "593": "327",
606
+ "594": "328",
607
+ "595": "329",
608
+ "596": "33",
609
+ "597": "330",
610
+ "598": "331",
611
+ "599": "332",
612
+ "600": "333",
613
+ "601": "334",
614
+ "602": "335",
615
+ "603": "336",
616
+ "604": "337",
617
+ "605": "338",
618
+ "606": "339",
619
+ "607": "34",
620
+ "608": "340",
621
+ "609": "341",
622
+ "610": "342",
623
+ "611": "343",
624
+ "612": "344",
625
+ "613": "345",
626
+ "614": "349",
627
+ "615": "35",
628
+ "616": "350",
629
+ "617": "351",
630
+ "618": "352",
631
+ "619": "353",
632
+ "620": "354",
633
+ "621": "355",
634
+ "622": "356",
635
+ "623": "358",
636
+ "624": "359",
637
+ "625": "36",
638
+ "626": "361",
639
+ "627": "362",
640
+ "628": "363",
641
+ "629": "364",
642
+ "630": "365",
643
+ "631": "366",
644
+ "632": "367",
645
+ "633": "368",
646
+ "634": "369",
647
+ "635": "37",
648
+ "636": "370",
649
+ "637": "371",
650
+ "638": "372",
651
+ "639": "373",
652
+ "640": "374",
653
+ "641": "375",
654
+ "642": "376",
655
+ "643": "377",
656
+ "644": "378",
657
+ "645": "379",
658
+ "646": "38",
659
+ "647": "380",
660
+ "648": "381",
661
+ "649": "382",
662
+ "650": "383",
663
+ "651": "384",
664
+ "652": "385",
665
+ "653": "386",
666
+ "654": "387",
667
+ "655": "388",
668
+ "656": "389",
669
+ "657": "39",
670
+ "658": "390",
671
+ "659": "391",
672
+ "660": "392",
673
+ "661": "393",
674
+ "662": "394",
675
+ "663": "395",
676
+ "664": "396",
677
+ "665": "397",
678
+ "666": "398",
679
+ "667": "399",
680
+ "668": "4",
681
+ "669": "40",
682
+ "670": "400",
683
+ "671": "401",
684
+ "672": "402",
685
+ "673": "403",
686
+ "674": "404",
687
+ "675": "405",
688
+ "676": "406",
689
+ "677": "407",
690
+ "678": "409",
691
+ "679": "41",
692
+ "680": "411",
693
+ "681": "412",
694
+ "682": "414",
695
+ "683": "415",
696
+ "684": "416",
697
+ "685": "418",
698
+ "686": "419",
699
+ "687": "42",
700
+ "688": "420",
701
+ "689": "421",
702
+ "690": "422",
703
+ "691": "423",
704
+ "692": "424",
705
+ "693": "425",
706
+ "694": "426",
707
+ "695": "427",
708
+ "696": "429",
709
+ "697": "43",
710
+ "698": "430",
711
+ "699": "431",
712
+ "700": "432",
713
+ "701": "433",
714
+ "702": "434",
715
+ "703": "435",
716
+ "704": "436",
717
+ "705": "437",
718
+ "706": "438",
719
+ "707": "439",
720
+ "708": "44",
721
+ "709": "440",
722
+ "710": "441",
723
+ "711": "442",
724
+ "712": "443",
725
+ "713": "444",
726
+ "714": "445",
727
+ "715": "446",
728
+ "716": "447",
729
+ "717": "448",
730
+ "718": "449",
731
+ "719": "45",
732
+ "720": "450",
733
+ "721": "451",
734
+ "722": "452",
735
+ "723": "453",
736
+ "724": "454",
737
+ "725": "455",
738
+ "726": "456",
739
+ "727": "457",
740
+ "728": "458",
741
+ "729": "459",
742
+ "730": "46",
743
+ "731": "460",
744
+ "732": "461",
745
+ "733": "462",
746
+ "734": "463",
747
+ "735": "464",
748
+ "736": "465",
749
+ "737": "466",
750
+ "738": "467",
751
+ "739": "468",
752
+ "740": "469",
753
+ "741": "47",
754
+ "742": "470",
755
+ "743": "471",
756
+ "744": "472",
757
+ "745": "473",
758
+ "746": "474",
759
+ "747": "475",
760
+ "748": "476",
761
+ "749": "477",
762
+ "750": "478",
763
+ "751": "479",
764
+ "752": "480",
765
+ "753": "481",
766
+ "754": "482",
767
+ "755": "483",
768
+ "756": "484",
769
+ "757": "485",
770
+ "758": "486",
771
+ "759": "487",
772
+ "760": "488",
773
+ "761": "489",
774
+ "762": "49",
775
+ "763": "490",
776
+ "764": "491",
777
+ "765": "492",
778
+ "766": "493",
779
+ "767": "494",
780
+ "768": "495",
781
+ "769": "496",
782
+ "770": "497",
783
+ "771": "499",
784
+ "772": "5",
785
+ "773": "50",
786
+ "774": "500",
787
+ "775": "501",
788
+ "776": "502",
789
+ "777": "503",
790
+ "778": "504",
791
+ "779": "505",
792
+ "780": "506",
793
+ "781": "507",
794
+ "782": "508",
795
+ "783": "509",
796
+ "784": "51",
797
+ "785": "510",
798
+ "786": "511",
799
+ "787": "512",
800
+ "788": "513",
801
+ "789": "514",
802
+ "790": "515",
803
+ "791": "516",
804
+ "792": "517",
805
+ "793": "518",
806
+ "794": "519",
807
+ "795": "52",
808
+ "796": "520",
809
+ "797": "521",
810
+ "798": "522",
811
+ "799": "523",
812
+ "800": "524",
813
+ "801": "525",
814
+ "802": "526",
815
+ "803": "527",
816
+ "804": "528",
817
+ "805": "529",
818
+ "806": "53",
819
+ "807": "530",
820
+ "808": "531",
821
+ "809": "532",
822
+ "810": "533",
823
+ "811": "534",
824
+ "812": "535",
825
+ "813": "536",
826
+ "814": "537",
827
+ "815": "538",
828
+ "816": "539",
829
+ "817": "54",
830
+ "818": "540",
831
+ "819": "541",
832
+ "820": "542",
833
+ "821": "543",
834
+ "822": "544",
835
+ "823": "546",
836
+ "824": "547",
837
+ "825": "548",
838
+ "826": "549",
839
+ "827": "55",
840
+ "828": "550",
841
+ "829": "551",
842
+ "830": "552",
843
+ "831": "553",
844
+ "832": "554",
845
+ "833": "555",
846
+ "834": "556",
847
+ "835": "557",
848
+ "836": "558",
849
+ "837": "559",
850
+ "838": "56",
851
+ "839": "560",
852
+ "840": "561",
853
+ "841": "562",
854
+ "842": "563",
855
+ "843": "564",
856
+ "844": "565",
857
+ "845": "566",
858
+ "846": "567",
859
+ "847": "568",
860
+ "848": "569",
861
+ "849": "57",
862
+ "850": "570",
863
+ "851": "571",
864
+ "852": "572",
865
+ "853": "573",
866
+ "854": "574",
867
+ "855": "575",
868
+ "856": "576",
869
+ "857": "577",
870
+ "858": "578",
871
+ "859": "579",
872
+ "860": "580",
873
+ "861": "581",
874
+ "862": "582",
875
+ "863": "583",
876
+ "864": "584",
877
+ "865": "585",
878
+ "866": "586",
879
+ "867": "587",
880
+ "868": "588",
881
+ "869": "589",
882
+ "870": "591",
883
+ "871": "593",
884
+ "872": "594",
885
+ "873": "595",
886
+ "874": "597",
887
+ "875": "598",
888
+ "876": "599",
889
+ "877": "6",
890
+ "878": "600",
891
+ "879": "601",
892
+ "880": "602",
893
+ "881": "603",
894
+ "882": "604",
895
+ "883": "605",
896
+ "884": "606",
897
+ "885": "607",
898
+ "886": "608",
899
+ "887": "609",
900
+ "888": "610",
901
+ "889": "611",
902
+ "890": "612",
903
+ "891": "613",
904
+ "892": "614",
905
+ "893": "615",
906
+ "894": "616",
907
+ "895": "618",
908
+ "896": "619",
909
+ "897": "620",
910
+ "898": "621",
911
+ "899": "622",
912
+ "900": "623",
913
+ "901": "624",
914
+ "902": "625",
915
+ "903": "626",
916
+ "904": "627",
917
+ "905": "628",
918
+ "906": "629",
919
+ "907": "630",
920
+ "908": "631",
921
+ "909": "632",
922
+ "910": "633",
923
+ "911": "634",
924
+ "912": "635",
925
+ "913": "636",
926
+ "914": "637",
927
+ "915": "638",
928
+ "916": "64",
929
+ "917": "640",
930
+ "918": "641",
931
+ "919": "643",
932
+ "920": "645",
933
+ "921": "646",
934
+ "922": "647",
935
+ "923": "648",
936
+ "924": "649",
937
+ "925": "65",
938
+ "926": "650",
939
+ "927": "651",
940
+ "928": "652",
941
+ "929": "653",
942
+ "930": "654",
943
+ "931": "655",
944
+ "932": "656",
945
+ "933": "657",
946
+ "934": "658",
947
+ "935": "659",
948
+ "936": "660",
949
+ "937": "661",
950
+ "938": "662",
951
+ "939": "663",
952
+ "940": "664",
953
+ "941": "665",
954
+ "942": "666",
955
+ "943": "667",
956
+ "944": "668",
957
+ "945": "669",
958
+ "946": "67",
959
+ "947": "670",
960
+ "948": "671",
961
+ "949": "672",
962
+ "950": "673",
963
+ "951": "675",
964
+ "952": "676",
965
+ "953": "677",
966
+ "954": "679",
967
+ "955": "680",
968
+ "956": "681",
969
+ "957": "682",
970
+ "958": "683",
971
+ "959": "684",
972
+ "960": "685",
973
+ "961": "686",
974
+ "962": "687",
975
+ "963": "688",
976
+ "964": "689",
977
+ "965": "69",
978
+ "966": "690",
979
+ "967": "691",
980
+ "968": "692",
981
+ "969": "694",
982
+ "970": "695",
983
+ "971": "696",
984
+ "972": "697",
985
+ "973": "698",
986
+ "974": "699",
987
+ "975": "7",
988
+ "976": "70",
989
+ "977": "700",
990
+ "978": "701",
991
+ "979": "702",
992
+ "980": "703",
993
+ "981": "704",
994
+ "982": "705",
995
+ "983": "706",
996
+ "984": "707",
997
+ "985": "708",
998
+ "986": "709",
999
+ "987": "71",
1000
+ "988": "710",
1001
+ "989": "711",
1002
+ "990": "712",
1003
+ "991": "713",
1004
+ "992": "714",
1005
+ "993": "72",
1006
+ "994": "721",
1007
+ "995": "722",
1008
+ "996": "723",
1009
+ "997": "724",
1010
+ "998": "725",
1011
+ "999": "726",
1012
+ "1000": "727",
1013
+ "1001": "728",
1014
+ "1002": "729",
1015
+ "1003": "73",
1016
+ "1004": "730",
1017
+ "1005": "731",
1018
+ "1006": "732",
1019
+ "1007": "733",
1020
+ "1008": "734",
1021
+ "1009": "735",
1022
+ "1010": "736",
1023
+ "1011": "737",
1024
+ "1012": "738",
1025
+ "1013": "739",
1026
+ "1014": "740",
1027
+ "1015": "741",
1028
+ "1016": "742",
1029
+ "1017": "743",
1030
+ "1018": "744",
1031
+ "1019": "745",
1032
+ "1020": "746",
1033
+ "1021": "747",
1034
+ "1022": "748",
1035
+ "1023": "749",
1036
+ "1024": "75",
1037
+ "1025": "750",
1038
+ "1026": "752",
1039
+ "1027": "753",
1040
+ "1028": "754",
1041
+ "1029": "755",
1042
+ "1030": "756",
1043
+ "1031": "757",
1044
+ "1032": "758",
1045
+ "1033": "759",
1046
+ "1034": "76",
1047
+ "1035": "760",
1048
+ "1036": "761",
1049
+ "1037": "762",
1050
+ "1038": "763",
1051
+ "1039": "764",
1052
+ "1040": "765",
1053
+ "1041": "766",
1054
+ "1042": "767",
1055
+ "1043": "768",
1056
+ "1044": "769",
1057
+ "1045": "77",
1058
+ "1046": "770",
1059
+ "1047": "772",
1060
+ "1048": "773",
1061
+ "1049": "774",
1062
+ "1050": "775",
1063
+ "1051": "776",
1064
+ "1052": "777",
1065
+ "1053": "778",
1066
+ "1054": "779",
1067
+ "1055": "78",
1068
+ "1056": "780",
1069
+ "1057": "781",
1070
+ "1058": "782",
1071
+ "1059": "783",
1072
+ "1060": "784",
1073
+ "1061": "785",
1074
+ "1062": "786",
1075
+ "1063": "787",
1076
+ "1064": "788",
1077
+ "1065": "789",
1078
+ "1066": "79",
1079
+ "1067": "790",
1080
+ "1068": "791",
1081
+ "1069": "792",
1082
+ "1070": "793",
1083
+ "1071": "794",
1084
+ "1072": "795",
1085
+ "1073": "796",
1086
+ "1074": "797",
1087
+ "1075": "798",
1088
+ "1076": "8",
1089
+ "1077": "80",
1090
+ "1078": "800",
1091
+ "1079": "801",
1092
+ "1080": "802",
1093
+ "1081": "803",
1094
+ "1082": "804",
1095
+ "1083": "805",
1096
+ "1084": "806",
1097
+ "1085": "807",
1098
+ "1086": "808",
1099
+ "1087": "809",
1100
+ "1088": "81",
1101
+ "1089": "810",
1102
+ "1090": "811",
1103
+ "1091": "812",
1104
+ "1092": "813",
1105
+ "1093": "814",
1106
+ "1094": "815",
1107
+ "1095": "816",
1108
+ "1096": "817",
1109
+ "1097": "818",
1110
+ "1098": "819",
1111
+ "1099": "82",
1112
+ "1100": "820",
1113
+ "1101": "821",
1114
+ "1102": "822",
1115
+ "1103": "824",
1116
+ "1104": "825",
1117
+ "1105": "826",
1118
+ "1106": "827",
1119
+ "1107": "828",
1120
+ "1108": "829",
1121
+ "1109": "83",
1122
+ "1110": "830",
1123
+ "1111": "831",
1124
+ "1112": "832",
1125
+ "1113": "833",
1126
+ "1114": "834",
1127
+ "1115": "835",
1128
+ "1116": "836",
1129
+ "1117": "837",
1130
+ "1118": "838",
1131
+ "1119": "839",
1132
+ "1120": "84",
1133
+ "1121": "840",
1134
+ "1122": "841",
1135
+ "1123": "842",
1136
+ "1124": "843",
1137
+ "1125": "844",
1138
+ "1126": "845",
1139
+ "1127": "846",
1140
+ "1128": "847",
1141
+ "1129": "848",
1142
+ "1130": "849",
1143
+ "1131": "85",
1144
+ "1132": "850",
1145
+ "1133": "851",
1146
+ "1134": "852",
1147
+ "1135": "853",
1148
+ "1136": "854",
1149
+ "1137": "855",
1150
+ "1138": "856",
1151
+ "1139": "857",
1152
+ "1140": "858",
1153
+ "1141": "859",
1154
+ "1142": "86",
1155
+ "1143": "863",
1156
+ "1144": "864",
1157
+ "1145": "865",
1158
+ "1146": "866",
1159
+ "1147": "868",
1160
+ "1148": "87",
1161
+ "1149": "870",
1162
+ "1150": "871",
1163
+ "1151": "872",
1164
+ "1152": "873",
1165
+ "1153": "874",
1166
+ "1154": "875",
1167
+ "1155": "876",
1168
+ "1156": "877",
1169
+ "1157": "878",
1170
+ "1158": "879",
1171
+ "1159": "88",
1172
+ "1160": "880",
1173
+ "1161": "881",
1174
+ "1162": "882",
1175
+ "1163": "883",
1176
+ "1164": "884",
1177
+ "1165": "885",
1178
+ "1166": "886",
1179
+ "1167": "887",
1180
+ "1168": "888",
1181
+ "1169": "889",
1182
+ "1170": "89",
1183
+ "1171": "890",
1184
+ "1172": "891",
1185
+ "1173": "892",
1186
+ "1174": "893",
1187
+ "1175": "894",
1188
+ "1176": "895",
1189
+ "1177": "896",
1190
+ "1178": "897",
1191
+ "1179": "898",
1192
+ "1180": "899",
1193
+ "1181": "9",
1194
+ "1182": "90",
1195
+ "1183": "900",
1196
+ "1184": "901",
1197
+ "1185": "903",
1198
+ "1186": "906",
1199
+ "1187": "909",
1200
+ "1188": "910",
1201
+ "1189": "911",
1202
+ "1190": "912",
1203
+ "1191": "913",
1204
+ "1192": "914",
1205
+ "1193": "915",
1206
+ "1194": "916",
1207
+ "1195": "917",
1208
+ "1196": "918",
1209
+ "1197": "92",
1210
+ "1198": "921",
1211
+ "1199": "922",
1212
+ "1200": "923",
1213
+ "1201": "924",
1214
+ "1202": "925",
1215
+ "1203": "926",
1216
+ "1204": "927",
1217
+ "1205": "928",
1218
+ "1206": "929",
1219
+ "1207": "930",
1220
+ "1208": "931",
1221
+ "1209": "932",
1222
+ "1210": "933",
1223
+ "1211": "934",
1224
+ "1212": "935",
1225
+ "1213": "936",
1226
+ "1214": "937",
1227
+ "1215": "938",
1228
+ "1216": "939",
1229
+ "1217": "940",
1230
+ "1218": "941",
1231
+ "1219": "942",
1232
+ "1220": "943",
1233
+ "1221": "944",
1234
+ "1222": "945",
1235
+ "1223": "946",
1236
+ "1224": "947",
1237
+ "1225": "948",
1238
+ "1226": "949",
1239
+ "1227": "950",
1240
+ "1228": "951",
1241
+ "1229": "952",
1242
+ "1230": "953",
1243
+ "1231": "954",
1244
+ "1232": "955",
1245
+ "1233": "956",
1246
+ "1234": "957",
1247
+ "1235": "958",
1248
+ "1236": "959",
1249
+ "1237": "960",
1250
+ "1238": "961",
1251
+ "1239": "962",
1252
+ "1240": "963",
1253
+ "1241": "964",
1254
+ "1242": "965",
1255
+ "1243": "966",
1256
+ "1244": "967",
1257
+ "1245": "968",
1258
+ "1246": "969",
1259
+ "1247": "97",
1260
+ "1248": "970",
1261
+ "1249": "971",
1262
+ "1250": "972",
1263
+ "1251": "973",
1264
+ "1252": "974",
1265
+ "1253": "975",
1266
+ "1254": "976",
1267
+ "1255": "977",
1268
+ "1256": "978",
1269
+ "1257": "979",
1270
+ "1258": "980",
1271
+ "1259": "981",
1272
+ "1260": "982",
1273
+ "1261": "983",
1274
+ "1262": "984",
1275
+ "1263": "985",
1276
+ "1264": "986",
1277
+ "1265": "989",
1278
+ "1266": "99",
1279
+ "1267": "990",
1280
+ "1268": "991",
1281
+ "1269": "992",
1282
+ "1270": "993",
1283
+ "1271": "994",
1284
+ "1272": "995",
1285
+ "1273": "996",
1286
+ "1274": "997",
1287
+ "1275": "998",
1288
+ "1276": "999"
1289
+ },
1290
+ "initializer_range": 0.02,
1291
+ "intermediate_size": 3072,
1292
+ "label2id": {
1293
+ "1": 0,
1294
+ "10": 1,
1295
+ "100": 2,
1296
+ "1003": 3,
1297
+ "1004": 4,
1298
+ "1005": 5,
1299
+ "1006": 6,
1300
+ "1007": 7,
1301
+ "1008": 8,
1302
+ "1009": 9,
1303
+ "101": 10,
1304
+ "1010": 11,
1305
+ "1011": 12,
1306
+ "1012": 13,
1307
+ "1013": 14,
1308
+ "1014": 15,
1309
+ "1017": 16,
1310
+ "1018": 17,
1311
+ "1019": 18,
1312
+ "102": 19,
1313
+ "1020": 20,
1314
+ "1021": 21,
1315
+ "1022": 22,
1316
+ "1023": 23,
1317
+ "103": 24,
1318
+ "1034": 25,
1319
+ "1035": 26,
1320
+ "104": 27,
1321
+ "1040": 28,
1322
+ "1043": 29,
1323
+ "1046": 30,
1324
+ "1047": 31,
1325
+ "1048": 32,
1326
+ "105": 33,
1327
+ "1050": 34,
1328
+ "1051": 35,
1329
+ "1052": 36,
1330
+ "1053": 37,
1331
+ "1054": 38,
1332
+ "1055": 39,
1333
+ "1056": 40,
1334
+ "1058": 41,
1335
+ "1059": 42,
1336
+ "1060": 43,
1337
+ "1062": 44,
1338
+ "107": 45,
1339
+ "1071": 46,
1340
+ "1073": 47,
1341
+ "108": 48,
1342
+ "1084": 49,
1343
+ "1086": 50,
1344
+ "1097": 51,
1345
+ "1099": 52,
1346
+ "11": 53,
1347
+ "110": 54,
1348
+ "1100": 55,
1349
+ "1106": 56,
1350
+ "1147": 57,
1351
+ "1148": 58,
1352
+ "1149": 59,
1353
+ "1150": 60,
1354
+ "1151": 61,
1355
+ "1152": 62,
1356
+ "1154": 63,
1357
+ "1156": 64,
1358
+ "1157": 65,
1359
+ "1158": 66,
1360
+ "1160": 67,
1361
+ "1161": 68,
1362
+ "1162": 69,
1363
+ "1166": 70,
1364
+ "1167": 71,
1365
+ "1169": 72,
1366
+ "1170": 73,
1367
+ "1171": 74,
1368
+ "1172": 75,
1369
+ "1173": 76,
1370
+ "1174": 77,
1371
+ "1175": 78,
1372
+ "1177": 79,
1373
+ "1178": 80,
1374
+ "1179": 81,
1375
+ "118": 82,
1376
+ "1180": 83,
1377
+ "1181": 84,
1378
+ "1184": 85,
1379
+ "1185": 86,
1380
+ "1186": 87,
1381
+ "1187": 88,
1382
+ "1188": 89,
1383
+ "1189": 90,
1384
+ "119": 91,
1385
+ "1190": 92,
1386
+ "1191": 93,
1387
+ "1192": 94,
1388
+ "1193": 95,
1389
+ "1195": 96,
1390
+ "1196": 97,
1391
+ "1198": 98,
1392
+ "1199": 99,
1393
+ "12": 100,
1394
+ "120": 101,
1395
+ "1201": 102,
1396
+ "1202": 103,
1397
+ "1203": 104,
1398
+ "1204": 105,
1399
+ "1205": 106,
1400
+ "1206": 107,
1401
+ "1207": 108,
1402
+ "1208": 109,
1403
+ "121": 110,
1404
+ "1210": 111,
1405
+ "1211": 112,
1406
+ "1212": 113,
1407
+ "1213": 114,
1408
+ "1217": 115,
1409
+ "1218": 116,
1410
+ "122": 117,
1411
+ "1222": 118,
1412
+ "1223": 119,
1413
+ "1224": 120,
1414
+ "1225": 121,
1415
+ "1226": 122,
1416
+ "1229": 123,
1417
+ "123": 124,
1418
+ "1230": 125,
1419
+ "1231": 126,
1420
+ "1232": 127,
1421
+ "1233": 128,
1422
+ "1234": 129,
1423
+ "1235": 130,
1424
+ "1236": 131,
1425
+ "1238": 132,
1426
+ "1239": 133,
1427
+ "124": 134,
1428
+ "1240": 135,
1429
+ "1241": 136,
1430
+ "1242": 137,
1431
+ "1243": 138,
1432
+ "1244": 139,
1433
+ "1245": 140,
1434
+ "1246": 141,
1435
+ "1247": 142,
1436
+ "1248": 143,
1437
+ "1249": 144,
1438
+ "125": 145,
1439
+ "1250": 146,
1440
+ "1251": 147,
1441
+ "1252": 148,
1442
+ "1253": 149,
1443
+ "1256": 150,
1444
+ "1257": 151,
1445
+ "1258": 152,
1446
+ "1259": 153,
1447
+ "126": 154,
1448
+ "1260": 155,
1449
+ "1261": 156,
1450
+ "1262": 157,
1451
+ "1263": 158,
1452
+ "1264": 159,
1453
+ "1266": 160,
1454
+ "1267": 161,
1455
+ "1268": 162,
1456
+ "1269": 163,
1457
+ "127": 164,
1458
+ "1270": 165,
1459
+ "1271": 166,
1460
+ "1272": 167,
1461
+ "1273": 168,
1462
+ "1274": 169,
1463
+ "1275": 170,
1464
+ "1276": 171,
1465
+ "1277": 172,
1466
+ "1278": 173,
1467
+ "1279": 174,
1468
+ "128": 175,
1469
+ "1280": 176,
1470
+ "1281": 177,
1471
+ "1282": 178,
1472
+ "1283": 179,
1473
+ "1284": 180,
1474
+ "1285": 181,
1475
+ "1287": 182,
1476
+ "1288": 183,
1477
+ "1289": 184,
1478
+ "1290": 185,
1479
+ "1291": 186,
1480
+ "1292": 187,
1481
+ "1293": 188,
1482
+ "1294": 189,
1483
+ "1295": 190,
1484
+ "1296": 191,
1485
+ "1297": 192,
1486
+ "1298": 193,
1487
+ "1299": 194,
1488
+ "13": 195,
1489
+ "1300": 196,
1490
+ "1301": 197,
1491
+ "1302": 198,
1492
+ "1303": 199,
1493
+ "1304": 200,
1494
+ "1305": 201,
1495
+ "1306": 202,
1496
+ "1307": 203,
1497
+ "1308": 204,
1498
+ "1309": 205,
1499
+ "1310": 206,
1500
+ "1311": 207,
1501
+ "1312": 208,
1502
+ "1313": 209,
1503
+ "1314": 210,
1504
+ "1315": 211,
1505
+ "1316": 212,
1506
+ "1317": 213,
1507
+ "1318": 214,
1508
+ "1319": 215,
1509
+ "1320": 216,
1510
+ "1321": 217,
1511
+ "1322": 218,
1512
+ "1323": 219,
1513
+ "1324": 220,
1514
+ "1325": 221,
1515
+ "1326": 222,
1516
+ "1327": 223,
1517
+ "1328": 224,
1518
+ "1329": 225,
1519
+ "133": 226,
1520
+ "1330": 227,
1521
+ "1331": 228,
1522
+ "1333": 229,
1523
+ "1334": 230,
1524
+ "1336": 231,
1525
+ "1340": 232,
1526
+ "1341": 233,
1527
+ "1342": 234,
1528
+ "1343": 235,
1529
+ "1346": 236,
1530
+ "135": 237,
1531
+ "1350": 238,
1532
+ "1351": 239,
1533
+ "1357": 240,
1534
+ "1359": 241,
1535
+ "136": 242,
1536
+ "1361": 243,
1537
+ "1362": 244,
1538
+ "1363": 245,
1539
+ "1364": 246,
1540
+ "1365": 247,
1541
+ "1367": 248,
1542
+ "1368": 249,
1543
+ "1369": 250,
1544
+ "137": 251,
1545
+ "1370": 252,
1546
+ "1371": 253,
1547
+ "1372": 254,
1548
+ "1373": 255,
1549
+ "1374": 256,
1550
+ "1376": 257,
1551
+ "1377": 258,
1552
+ "1378": 259,
1553
+ "1379": 260,
1554
+ "138": 261,
1555
+ "1380": 262,
1556
+ "1382": 263,
1557
+ "1383": 264,
1558
+ "1384": 265,
1559
+ "1385": 266,
1560
+ "1386": 267,
1561
+ "1387": 268,
1562
+ "1388": 269,
1563
+ "1389": 270,
1564
+ "139": 271,
1565
+ "1391": 272,
1566
+ "1396": 273,
1567
+ "1397": 274,
1568
+ "1398": 275,
1569
+ "1399": 276,
1570
+ "14": 277,
1571
+ "140": 278,
1572
+ "1400": 279,
1573
+ "1401": 280,
1574
+ "1402": 281,
1575
+ "1403": 282,
1576
+ "141": 283,
1577
+ "1413": 284,
1578
+ "1415": 285,
1579
+ "1416": 286,
1580
+ "1417": 287,
1581
+ "1419": 288,
1582
+ "142": 289,
1583
+ "1420": 290,
1584
+ "1421": 291,
1585
+ "1422": 292,
1586
+ "1423": 293,
1587
+ "1425": 294,
1588
+ "1426": 295,
1589
+ "1427": 296,
1590
+ "1428": 297,
1591
+ "1429": 298,
1592
+ "143": 299,
1593
+ "1430": 300,
1594
+ "1431": 301,
1595
+ "1432": 302,
1596
+ "1433": 303,
1597
+ "1438": 304,
1598
+ "1439": 305,
1599
+ "144": 306,
1600
+ "1441": 307,
1601
+ "1443": 308,
1602
+ "1444": 309,
1603
+ "1445": 310,
1604
+ "1446": 311,
1605
+ "1447": 312,
1606
+ "1448": 313,
1607
+ "1449": 314,
1608
+ "145": 315,
1609
+ "1450": 316,
1610
+ "1451": 317,
1611
+ "1452": 318,
1612
+ "1453": 319,
1613
+ "1454": 320,
1614
+ "1455": 321,
1615
+ "1456": 322,
1616
+ "1457": 323,
1617
+ "1458": 324,
1618
+ "1459": 325,
1619
+ "146": 326,
1620
+ "1460": 327,
1621
+ "1461": 328,
1622
+ "1462": 329,
1623
+ "1463": 330,
1624
+ "1464": 331,
1625
+ "1465": 332,
1626
+ "1466": 333,
1627
+ "1467": 334,
1628
+ "1468": 335,
1629
+ "1469": 336,
1630
+ "147": 337,
1631
+ "1470": 338,
1632
+ "1471": 339,
1633
+ "1473": 340,
1634
+ "1474": 341,
1635
+ "1475": 342,
1636
+ "1476": 343,
1637
+ "1477": 344,
1638
+ "1478": 345,
1639
+ "1479": 346,
1640
+ "1480": 347,
1641
+ "1481": 348,
1642
+ "1482": 349,
1643
+ "1483": 350,
1644
+ "1484": 351,
1645
+ "1485": 352,
1646
+ "1486": 353,
1647
+ "1487": 354,
1648
+ "1488": 355,
1649
+ "1489": 356,
1650
+ "1490": 357,
1651
+ "1491": 358,
1652
+ "1492": 359,
1653
+ "1493": 360,
1654
+ "1494": 361,
1655
+ "1495": 362,
1656
+ "1496": 363,
1657
+ "1497": 364,
1658
+ "1498": 365,
1659
+ "1499": 366,
1660
+ "15": 367,
1661
+ "1500": 368,
1662
+ "1501": 369,
1663
+ "1502": 370,
1664
+ "1507": 371,
1665
+ "1509": 372,
1666
+ "1510": 373,
1667
+ "1511": 374,
1668
+ "1512": 375,
1669
+ "1513": 376,
1670
+ "1514": 377,
1671
+ "1515": 378,
1672
+ "1516": 379,
1673
+ "1517": 380,
1674
+ "1518": 381,
1675
+ "1519": 382,
1676
+ "152": 383,
1677
+ "1520": 384,
1678
+ "1521": 385,
1679
+ "1522": 386,
1680
+ "1523": 387,
1681
+ "1524": 388,
1682
+ "1525": 389,
1683
+ "1526": 390,
1684
+ "1527": 391,
1685
+ "1528": 392,
1686
+ "1529": 393,
1687
+ "153": 394,
1688
+ "1530": 395,
1689
+ "1531": 396,
1690
+ "1532": 397,
1691
+ "1533": 398,
1692
+ "1534": 399,
1693
+ "1535": 400,
1694
+ "1536": 401,
1695
+ "1537": 402,
1696
+ "1538": 403,
1697
+ "1539": 404,
1698
+ "154": 405,
1699
+ "1540": 406,
1700
+ "1541": 407,
1701
+ "1542": 408,
1702
+ "1543": 409,
1703
+ "1544": 410,
1704
+ "1545": 411,
1705
+ "1546": 412,
1706
+ "1547": 413,
1707
+ "1548": 414,
1708
+ "1549": 415,
1709
+ "155": 416,
1710
+ "1550": 417,
1711
+ "1551": 418,
1712
+ "1552": 419,
1713
+ "1553": 420,
1714
+ "1554": 421,
1715
+ "1555": 422,
1716
+ "1556": 423,
1717
+ "1557": 424,
1718
+ "1558": 425,
1719
+ "1559": 426,
1720
+ "1560": 427,
1721
+ "1561": 428,
1722
+ "1562": 429,
1723
+ "1563": 430,
1724
+ "1564": 431,
1725
+ "1565": 432,
1726
+ "1566": 433,
1727
+ "1567": 434,
1728
+ "1568": 435,
1729
+ "1569": 436,
1730
+ "157": 437,
1731
+ "1570": 438,
1732
+ "1571": 439,
1733
+ "1572": 440,
1734
+ "1573": 441,
1735
+ "1574": 442,
1736
+ "1575": 443,
1737
+ "1576": 444,
1738
+ "1577": 445,
1739
+ "1578": 446,
1740
+ "1579": 447,
1741
+ "158": 448,
1742
+ "1580": 449,
1743
+ "1581": 450,
1744
+ "1582": 451,
1745
+ "1583": 452,
1746
+ "1584": 453,
1747
+ "1585": 454,
1748
+ "1586": 455,
1749
+ "159": 456,
1750
+ "160": 457,
1751
+ "162": 458,
1752
+ "163": 459,
1753
+ "164": 460,
1754
+ "165": 461,
1755
+ "166": 462,
1756
+ "167": 463,
1757
+ "168": 464,
1758
+ "169": 465,
1759
+ "17": 466,
1760
+ "170": 467,
1761
+ "171": 468,
1762
+ "172": 469,
1763
+ "173": 470,
1764
+ "174": 471,
1765
+ "175": 472,
1766
+ "177": 473,
1767
+ "178": 474,
1768
+ "179": 475,
1769
+ "18": 476,
1770
+ "180": 477,
1771
+ "181": 478,
1772
+ "182": 479,
1773
+ "19": 480,
1774
+ "192": 481,
1775
+ "193": 482,
1776
+ "194": 483,
1777
+ "195": 484,
1778
+ "197": 485,
1779
+ "199": 486,
1780
+ "20": 487,
1781
+ "200": 488,
1782
+ "202": 489,
1783
+ "203": 490,
1784
+ "204": 491,
1785
+ "205": 492,
1786
+ "206": 493,
1787
+ "207": 494,
1788
+ "208": 495,
1789
+ "209": 496,
1790
+ "210": 497,
1791
+ "211": 498,
1792
+ "212": 499,
1793
+ "213": 500,
1794
+ "214": 501,
1795
+ "215": 502,
1796
+ "216": 503,
1797
+ "217": 504,
1798
+ "218": 505,
1799
+ "219": 506,
1800
+ "22": 507,
1801
+ "220": 508,
1802
+ "221": 509,
1803
+ "222": 510,
1804
+ "223": 511,
1805
+ "224": 512,
1806
+ "225": 513,
1807
+ "226": 514,
1808
+ "227": 515,
1809
+ "229": 516,
1810
+ "23": 517,
1811
+ "230": 518,
1812
+ "231": 519,
1813
+ "232": 520,
1814
+ "233": 521,
1815
+ "234": 522,
1816
+ "236": 523,
1817
+ "237": 524,
1818
+ "238": 525,
1819
+ "239": 526,
1820
+ "24": 527,
1821
+ "240": 528,
1822
+ "241": 529,
1823
+ "242": 530,
1824
+ "243": 531,
1825
+ "244": 532,
1826
+ "245": 533,
1827
+ "246": 534,
1828
+ "247": 535,
1829
+ "248": 536,
1830
+ "249": 537,
1831
+ "25": 538,
1832
+ "250": 539,
1833
+ "251": 540,
1834
+ "252": 541,
1835
+ "253": 542,
1836
+ "254": 543,
1837
+ "255": 544,
1838
+ "256": 545,
1839
+ "257": 546,
1840
+ "259": 547,
1841
+ "26": 548,
1842
+ "260": 549,
1843
+ "261": 550,
1844
+ "262": 551,
1845
+ "27": 552,
1846
+ "28": 553,
1847
+ "288": 554,
1848
+ "289": 555,
1849
+ "29": 556,
1850
+ "290": 557,
1851
+ "291": 558,
1852
+ "292": 559,
1853
+ "293": 560,
1854
+ "294": 561,
1855
+ "295": 562,
1856
+ "296": 563,
1857
+ "297": 564,
1858
+ "298": 565,
1859
+ "30": 566,
1860
+ "300": 567,
1861
+ "301": 568,
1862
+ "302": 569,
1863
+ "303": 570,
1864
+ "304": 571,
1865
+ "306": 572,
1866
+ "307": 573,
1867
+ "308": 574,
1868
+ "309": 575,
1869
+ "31": 576,
1870
+ "310": 577,
1871
+ "311": 578,
1872
+ "312": 579,
1873
+ "313": 580,
1874
+ "315": 581,
1875
+ "317": 582,
1876
+ "318": 583,
1877
+ "319": 584,
1878
+ "32": 585,
1879
+ "320": 586,
1880
+ "321": 587,
1881
+ "322": 588,
1882
+ "323": 589,
1883
+ "324": 590,
1884
+ "325": 591,
1885
+ "326": 592,
1886
+ "327": 593,
1887
+ "328": 594,
1888
+ "329": 595,
1889
+ "33": 596,
1890
+ "330": 597,
1891
+ "331": 598,
1892
+ "332": 599,
1893
+ "333": 600,
1894
+ "334": 601,
1895
+ "335": 602,
1896
+ "336": 603,
1897
+ "337": 604,
1898
+ "338": 605,
1899
+ "339": 606,
1900
+ "34": 607,
1901
+ "340": 608,
1902
+ "341": 609,
1903
+ "342": 610,
1904
+ "343": 611,
1905
+ "344": 612,
1906
+ "345": 613,
1907
+ "349": 614,
1908
+ "35": 615,
1909
+ "350": 616,
1910
+ "351": 617,
1911
+ "352": 618,
1912
+ "353": 619,
1913
+ "354": 620,
1914
+ "355": 621,
1915
+ "356": 622,
1916
+ "358": 623,
1917
+ "359": 624,
1918
+ "36": 625,
1919
+ "361": 626,
1920
+ "362": 627,
1921
+ "363": 628,
1922
+ "364": 629,
1923
+ "365": 630,
1924
+ "366": 631,
1925
+ "367": 632,
1926
+ "368": 633,
1927
+ "369": 634,
1928
+ "37": 635,
1929
+ "370": 636,
1930
+ "371": 637,
1931
+ "372": 638,
1932
+ "373": 639,
1933
+ "374": 640,
1934
+ "375": 641,
1935
+ "376": 642,
1936
+ "377": 643,
1937
+ "378": 644,
1938
+ "379": 645,
1939
+ "38": 646,
1940
+ "380": 647,
1941
+ "381": 648,
1942
+ "382": 649,
1943
+ "383": 650,
1944
+ "384": 651,
1945
+ "385": 652,
1946
+ "386": 653,
1947
+ "387": 654,
1948
+ "388": 655,
1949
+ "389": 656,
1950
+ "39": 657,
1951
+ "390": 658,
1952
+ "391": 659,
1953
+ "392": 660,
1954
+ "393": 661,
1955
+ "394": 662,
1956
+ "395": 663,
1957
+ "396": 664,
1958
+ "397": 665,
1959
+ "398": 666,
1960
+ "399": 667,
1961
+ "4": 668,
1962
+ "40": 669,
1963
+ "400": 670,
1964
+ "401": 671,
1965
+ "402": 672,
1966
+ "403": 673,
1967
+ "404": 674,
1968
+ "405": 675,
1969
+ "406": 676,
1970
+ "407": 677,
1971
+ "409": 678,
1972
+ "41": 679,
1973
+ "411": 680,
1974
+ "412": 681,
1975
+ "414": 682,
1976
+ "415": 683,
1977
+ "416": 684,
1978
+ "418": 685,
1979
+ "419": 686,
1980
+ "42": 687,
1981
+ "420": 688,
1982
+ "421": 689,
1983
+ "422": 690,
1984
+ "423": 691,
1985
+ "424": 692,
1986
+ "425": 693,
1987
+ "426": 694,
1988
+ "427": 695,
1989
+ "429": 696,
1990
+ "43": 697,
1991
+ "430": 698,
1992
+ "431": 699,
1993
+ "432": 700,
1994
+ "433": 701,
1995
+ "434": 702,
1996
+ "435": 703,
1997
+ "436": 704,
1998
+ "437": 705,
1999
+ "438": 706,
2000
+ "439": 707,
2001
+ "44": 708,
2002
+ "440": 709,
2003
+ "441": 710,
2004
+ "442": 711,
2005
+ "443": 712,
2006
+ "444": 713,
2007
+ "445": 714,
2008
+ "446": 715,
2009
+ "447": 716,
2010
+ "448": 717,
2011
+ "449": 718,
2012
+ "45": 719,
2013
+ "450": 720,
2014
+ "451": 721,
2015
+ "452": 722,
2016
+ "453": 723,
2017
+ "454": 724,
2018
+ "455": 725,
2019
+ "456": 726,
2020
+ "457": 727,
2021
+ "458": 728,
2022
+ "459": 729,
2023
+ "46": 730,
2024
+ "460": 731,
2025
+ "461": 732,
2026
+ "462": 733,
2027
+ "463": 734,
2028
+ "464": 735,
2029
+ "465": 736,
2030
+ "466": 737,
2031
+ "467": 738,
2032
+ "468": 739,
2033
+ "469": 740,
2034
+ "47": 741,
2035
+ "470": 742,
2036
+ "471": 743,
2037
+ "472": 744,
2038
+ "473": 745,
2039
+ "474": 746,
2040
+ "475": 747,
2041
+ "476": 748,
2042
+ "477": 749,
2043
+ "478": 750,
2044
+ "479": 751,
2045
+ "480": 752,
2046
+ "481": 753,
2047
+ "482": 754,
2048
+ "483": 755,
2049
+ "484": 756,
2050
+ "485": 757,
2051
+ "486": 758,
2052
+ "487": 759,
2053
+ "488": 760,
2054
+ "489": 761,
2055
+ "49": 762,
2056
+ "490": 763,
2057
+ "491": 764,
2058
+ "492": 765,
2059
+ "493": 766,
2060
+ "494": 767,
2061
+ "495": 768,
2062
+ "496": 769,
2063
+ "497": 770,
2064
+ "499": 771,
2065
+ "5": 772,
2066
+ "50": 773,
2067
+ "500": 774,
2068
+ "501": 775,
2069
+ "502": 776,
2070
+ "503": 777,
2071
+ "504": 778,
2072
+ "505": 779,
2073
+ "506": 780,
2074
+ "507": 781,
2075
+ "508": 782,
2076
+ "509": 783,
2077
+ "51": 784,
2078
+ "510": 785,
2079
+ "511": 786,
2080
+ "512": 787,
2081
+ "513": 788,
2082
+ "514": 789,
2083
+ "515": 790,
2084
+ "516": 791,
2085
+ "517": 792,
2086
+ "518": 793,
2087
+ "519": 794,
2088
+ "52": 795,
2089
+ "520": 796,
2090
+ "521": 797,
2091
+ "522": 798,
2092
+ "523": 799,
2093
+ "524": 800,
2094
+ "525": 801,
2095
+ "526": 802,
2096
+ "527": 803,
2097
+ "528": 804,
2098
+ "529": 805,
2099
+ "53": 806,
2100
+ "530": 807,
2101
+ "531": 808,
2102
+ "532": 809,
2103
+ "533": 810,
2104
+ "534": 811,
2105
+ "535": 812,
2106
+ "536": 813,
2107
+ "537": 814,
2108
+ "538": 815,
2109
+ "539": 816,
2110
+ "54": 817,
2111
+ "540": 818,
2112
+ "541": 819,
2113
+ "542": 820,
2114
+ "543": 821,
2115
+ "544": 822,
2116
+ "546": 823,
2117
+ "547": 824,
2118
+ "548": 825,
2119
+ "549": 826,
2120
+ "55": 827,
2121
+ "550": 828,
2122
+ "551": 829,
2123
+ "552": 830,
2124
+ "553": 831,
2125
+ "554": 832,
2126
+ "555": 833,
2127
+ "556": 834,
2128
+ "557": 835,
2129
+ "558": 836,
2130
+ "559": 837,
2131
+ "56": 838,
2132
+ "560": 839,
2133
+ "561": 840,
2134
+ "562": 841,
2135
+ "563": 842,
2136
+ "564": 843,
2137
+ "565": 844,
2138
+ "566": 845,
2139
+ "567": 846,
2140
+ "568": 847,
2141
+ "569": 848,
2142
+ "57": 849,
2143
+ "570": 850,
2144
+ "571": 851,
2145
+ "572": 852,
2146
+ "573": 853,
2147
+ "574": 854,
2148
+ "575": 855,
2149
+ "576": 856,
2150
+ "577": 857,
2151
+ "578": 858,
2152
+ "579": 859,
2153
+ "580": 860,
2154
+ "581": 861,
2155
+ "582": 862,
2156
+ "583": 863,
2157
+ "584": 864,
2158
+ "585": 865,
2159
+ "586": 866,
2160
+ "587": 867,
2161
+ "588": 868,
2162
+ "589": 869,
2163
+ "591": 870,
2164
+ "593": 871,
2165
+ "594": 872,
2166
+ "595": 873,
2167
+ "597": 874,
2168
+ "598": 875,
2169
+ "599": 876,
2170
+ "6": 877,
2171
+ "600": 878,
2172
+ "601": 879,
2173
+ "602": 880,
2174
+ "603": 881,
2175
+ "604": 882,
2176
+ "605": 883,
2177
+ "606": 884,
2178
+ "607": 885,
2179
+ "608": 886,
2180
+ "609": 887,
2181
+ "610": 888,
2182
+ "611": 889,
2183
+ "612": 890,
2184
+ "613": 891,
2185
+ "614": 892,
2186
+ "615": 893,
2187
+ "616": 894,
2188
+ "618": 895,
2189
+ "619": 896,
2190
+ "620": 897,
2191
+ "621": 898,
2192
+ "622": 899,
2193
+ "623": 900,
2194
+ "624": 901,
2195
+ "625": 902,
2196
+ "626": 903,
2197
+ "627": 904,
2198
+ "628": 905,
2199
+ "629": 906,
2200
+ "630": 907,
2201
+ "631": 908,
2202
+ "632": 909,
2203
+ "633": 910,
2204
+ "634": 911,
2205
+ "635": 912,
2206
+ "636": 913,
2207
+ "637": 914,
2208
+ "638": 915,
2209
+ "64": 916,
2210
+ "640": 917,
2211
+ "641": 918,
2212
+ "643": 919,
2213
+ "645": 920,
2214
+ "646": 921,
2215
+ "647": 922,
2216
+ "648": 923,
2217
+ "649": 924,
2218
+ "65": 925,
2219
+ "650": 926,
2220
+ "651": 927,
2221
+ "652": 928,
2222
+ "653": 929,
2223
+ "654": 930,
2224
+ "655": 931,
2225
+ "656": 932,
2226
+ "657": 933,
2227
+ "658": 934,
2228
+ "659": 935,
2229
+ "660": 936,
2230
+ "661": 937,
2231
+ "662": 938,
2232
+ "663": 939,
2233
+ "664": 940,
2234
+ "665": 941,
2235
+ "666": 942,
2236
+ "667": 943,
2237
+ "668": 944,
2238
+ "669": 945,
2239
+ "67": 946,
2240
+ "670": 947,
2241
+ "671": 948,
2242
+ "672": 949,
2243
+ "673": 950,
2244
+ "675": 951,
2245
+ "676": 952,
2246
+ "677": 953,
2247
+ "679": 954,
2248
+ "680": 955,
2249
+ "681": 956,
2250
+ "682": 957,
2251
+ "683": 958,
2252
+ "684": 959,
2253
+ "685": 960,
2254
+ "686": 961,
2255
+ "687": 962,
2256
+ "688": 963,
2257
+ "689": 964,
2258
+ "69": 965,
2259
+ "690": 966,
2260
+ "691": 967,
2261
+ "692": 968,
2262
+ "694": 969,
2263
+ "695": 970,
2264
+ "696": 971,
2265
+ "697": 972,
2266
+ "698": 973,
2267
+ "699": 974,
2268
+ "7": 975,
2269
+ "70": 976,
2270
+ "700": 977,
2271
+ "701": 978,
2272
+ "702": 979,
2273
+ "703": 980,
2274
+ "704": 981,
2275
+ "705": 982,
2276
+ "706": 983,
2277
+ "707": 984,
2278
+ "708": 985,
2279
+ "709": 986,
2280
+ "71": 987,
2281
+ "710": 988,
2282
+ "711": 989,
2283
+ "712": 990,
2284
+ "713": 991,
2285
+ "714": 992,
2286
+ "72": 993,
2287
+ "721": 994,
2288
+ "722": 995,
2289
+ "723": 996,
2290
+ "724": 997,
2291
+ "725": 998,
2292
+ "726": 999,
2293
+ "727": 1000,
2294
+ "728": 1001,
2295
+ "729": 1002,
2296
+ "73": 1003,
2297
+ "730": 1004,
2298
+ "731": 1005,
2299
+ "732": 1006,
2300
+ "733": 1007,
2301
+ "734": 1008,
2302
+ "735": 1009,
2303
+ "736": 1010,
2304
+ "737": 1011,
2305
+ "738": 1012,
2306
+ "739": 1013,
2307
+ "740": 1014,
2308
+ "741": 1015,
2309
+ "742": 1016,
2310
+ "743": 1017,
2311
+ "744": 1018,
2312
+ "745": 1019,
2313
+ "746": 1020,
2314
+ "747": 1021,
2315
+ "748": 1022,
2316
+ "749": 1023,
2317
+ "75": 1024,
2318
+ "750": 1025,
2319
+ "752": 1026,
2320
+ "753": 1027,
2321
+ "754": 1028,
2322
+ "755": 1029,
2323
+ "756": 1030,
2324
+ "757": 1031,
2325
+ "758": 1032,
2326
+ "759": 1033,
2327
+ "76": 1034,
2328
+ "760": 1035,
2329
+ "761": 1036,
2330
+ "762": 1037,
2331
+ "763": 1038,
2332
+ "764": 1039,
2333
+ "765": 1040,
2334
+ "766": 1041,
2335
+ "767": 1042,
2336
+ "768": 1043,
2337
+ "769": 1044,
2338
+ "77": 1045,
2339
+ "770": 1046,
2340
+ "772": 1047,
2341
+ "773": 1048,
2342
+ "774": 1049,
2343
+ "775": 1050,
2344
+ "776": 1051,
2345
+ "777": 1052,
2346
+ "778": 1053,
2347
+ "779": 1054,
2348
+ "78": 1055,
2349
+ "780": 1056,
2350
+ "781": 1057,
2351
+ "782": 1058,
2352
+ "783": 1059,
2353
+ "784": 1060,
2354
+ "785": 1061,
2355
+ "786": 1062,
2356
+ "787": 1063,
2357
+ "788": 1064,
2358
+ "789": 1065,
2359
+ "79": 1066,
2360
+ "790": 1067,
2361
+ "791": 1068,
2362
+ "792": 1069,
2363
+ "793": 1070,
2364
+ "794": 1071,
2365
+ "795": 1072,
2366
+ "796": 1073,
2367
+ "797": 1074,
2368
+ "798": 1075,
2369
+ "8": 1076,
2370
+ "80": 1077,
2371
+ "800": 1078,
2372
+ "801": 1079,
2373
+ "802": 1080,
2374
+ "803": 1081,
2375
+ "804": 1082,
2376
+ "805": 1083,
2377
+ "806": 1084,
2378
+ "807": 1085,
2379
+ "808": 1086,
2380
+ "809": 1087,
2381
+ "81": 1088,
2382
+ "810": 1089,
2383
+ "811": 1090,
2384
+ "812": 1091,
2385
+ "813": 1092,
2386
+ "814": 1093,
2387
+ "815": 1094,
2388
+ "816": 1095,
2389
+ "817": 1096,
2390
+ "818": 1097,
2391
+ "819": 1098,
2392
+ "82": 1099,
2393
+ "820": 1100,
2394
+ "821": 1101,
2395
+ "822": 1102,
2396
+ "824": 1103,
2397
+ "825": 1104,
2398
+ "826": 1105,
2399
+ "827": 1106,
2400
+ "828": 1107,
2401
+ "829": 1108,
2402
+ "83": 1109,
2403
+ "830": 1110,
2404
+ "831": 1111,
2405
+ "832": 1112,
2406
+ "833": 1113,
2407
+ "834": 1114,
2408
+ "835": 1115,
2409
+ "836": 1116,
2410
+ "837": 1117,
2411
+ "838": 1118,
2412
+ "839": 1119,
2413
+ "84": 1120,
2414
+ "840": 1121,
2415
+ "841": 1122,
2416
+ "842": 1123,
2417
+ "843": 1124,
2418
+ "844": 1125,
2419
+ "845": 1126,
2420
+ "846": 1127,
2421
+ "847": 1128,
2422
+ "848": 1129,
2423
+ "849": 1130,
2424
+ "85": 1131,
2425
+ "850": 1132,
2426
+ "851": 1133,
2427
+ "852": 1134,
2428
+ "853": 1135,
2429
+ "854": 1136,
2430
+ "855": 1137,
2431
+ "856": 1138,
2432
+ "857": 1139,
2433
+ "858": 1140,
2434
+ "859": 1141,
2435
+ "86": 1142,
2436
+ "863": 1143,
2437
+ "864": 1144,
2438
+ "865": 1145,
2439
+ "866": 1146,
2440
+ "868": 1147,
2441
+ "87": 1148,
2442
+ "870": 1149,
2443
+ "871": 1150,
2444
+ "872": 1151,
2445
+ "873": 1152,
2446
+ "874": 1153,
2447
+ "875": 1154,
2448
+ "876": 1155,
2449
+ "877": 1156,
2450
+ "878": 1157,
2451
+ "879": 1158,
2452
+ "88": 1159,
2453
+ "880": 1160,
2454
+ "881": 1161,
2455
+ "882": 1162,
2456
+ "883": 1163,
2457
+ "884": 1164,
2458
+ "885": 1165,
2459
+ "886": 1166,
2460
+ "887": 1167,
2461
+ "888": 1168,
2462
+ "889": 1169,
2463
+ "89": 1170,
2464
+ "890": 1171,
2465
+ "891": 1172,
2466
+ "892": 1173,
2467
+ "893": 1174,
2468
+ "894": 1175,
2469
+ "895": 1176,
2470
+ "896": 1177,
2471
+ "897": 1178,
2472
+ "898": 1179,
2473
+ "899": 1180,
2474
+ "9": 1181,
2475
+ "90": 1182,
2476
+ "900": 1183,
2477
+ "901": 1184,
2478
+ "903": 1185,
2479
+ "906": 1186,
2480
+ "909": 1187,
2481
+ "910": 1188,
2482
+ "911": 1189,
2483
+ "912": 1190,
2484
+ "913": 1191,
2485
+ "914": 1192,
2486
+ "915": 1193,
2487
+ "916": 1194,
2488
+ "917": 1195,
2489
+ "918": 1196,
2490
+ "92": 1197,
2491
+ "921": 1198,
2492
+ "922": 1199,
2493
+ "923": 1200,
2494
+ "924": 1201,
2495
+ "925": 1202,
2496
+ "926": 1203,
2497
+ "927": 1204,
2498
+ "928": 1205,
2499
+ "929": 1206,
2500
+ "930": 1207,
2501
+ "931": 1208,
2502
+ "932": 1209,
2503
+ "933": 1210,
2504
+ "934": 1211,
2505
+ "935": 1212,
2506
+ "936": 1213,
2507
+ "937": 1214,
2508
+ "938": 1215,
2509
+ "939": 1216,
2510
+ "940": 1217,
2511
+ "941": 1218,
2512
+ "942": 1219,
2513
+ "943": 1220,
2514
+ "944": 1221,
2515
+ "945": 1222,
2516
+ "946": 1223,
2517
+ "947": 1224,
2518
+ "948": 1225,
2519
+ "949": 1226,
2520
+ "950": 1227,
2521
+ "951": 1228,
2522
+ "952": 1229,
2523
+ "953": 1230,
2524
+ "954": 1231,
2525
+ "955": 1232,
2526
+ "956": 1233,
2527
+ "957": 1234,
2528
+ "958": 1235,
2529
+ "959": 1236,
2530
+ "960": 1237,
2531
+ "961": 1238,
2532
+ "962": 1239,
2533
+ "963": 1240,
2534
+ "964": 1241,
2535
+ "965": 1242,
2536
+ "966": 1243,
2537
+ "967": 1244,
2538
+ "968": 1245,
2539
+ "969": 1246,
2540
+ "97": 1247,
2541
+ "970": 1248,
2542
+ "971": 1249,
2543
+ "972": 1250,
2544
+ "973": 1251,
2545
+ "974": 1252,
2546
+ "975": 1253,
2547
+ "976": 1254,
2548
+ "977": 1255,
2549
+ "978": 1256,
2550
+ "979": 1257,
2551
+ "980": 1258,
2552
+ "981": 1259,
2553
+ "982": 1260,
2554
+ "983": 1261,
2555
+ "984": 1262,
2556
+ "985": 1263,
2557
+ "986": 1264,
2558
+ "989": 1265,
2559
+ "99": 1266,
2560
+ "990": 1267,
2561
+ "991": 1268,
2562
+ "992": 1269,
2563
+ "993": 1270,
2564
+ "994": 1271,
2565
+ "995": 1272,
2566
+ "996": 1273,
2567
+ "997": 1274,
2568
+ "998": 1275,
2569
+ "999": 1276
2570
+ },
2571
+ "layer_norm_eps": 1e-12,
2572
+ "max_position_embeddings": 512,
2573
+ "model_type": "bert",
2574
+ "num_attention_heads": 12,
2575
+ "num_hidden_layers": 12,
2576
+ "pad_token_id": 0,
2577
+ "position_embedding_type": "absolute",
2578
+ "problem_type": "multi_label_classification",
2579
+ "torch_dtype": "float32",
2580
+ "transformers_version": "4.55.0",
2581
+ "type_vocab_size": 2,
2582
+ "use_cache": true,
2583
+ "vocab_size": 30522
2584
+ }
checkpoint-3375/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45a7a830ef075c6b8ba043a8abe68b749b7c61b93f130239834680afb5adc94f
3
+ size 441880548
checkpoint-3375/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:733bfdb78c212e677cc7aa6f2d95a11c2358a8ad3b9cf1b675f5c51220c64c0e
3
+ size 883885323
checkpoint-3375/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90ea4ba456319acfa4d3a381a247e4f6514d5eed4b45b54a4a0223e2c9f40d22
3
+ size 14645
checkpoint-3375/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:083864395cdb3da9a80aafd57169194b9eb4ee1269da1c0a51500a3de4b89509
3
+ size 1465
checkpoint-3375/special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
checkpoint-3375/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-3375/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "BertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
checkpoint-3375/trainer_state.json ADDED
@@ -0,0 +1,536 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 1125,
3
+ "best_metric": 0.0007731728834392315,
4
+ "best_model_checkpoint": "trained/bert_multilabel_text_classifier/checkpoint-1125",
5
+ "epoch": 3.0,
6
+ "eval_steps": 500,
7
+ "global_step": 3375,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.044444444444444446,
14
+ "grad_norm": 0.25056546926498413,
15
+ "learning_rate": 1.9709629629629633e-05,
16
+ "loss": 0.5964,
17
+ "step": 50
18
+ },
19
+ {
20
+ "epoch": 0.08888888888888889,
21
+ "grad_norm": 0.17194914817810059,
22
+ "learning_rate": 1.9413333333333336e-05,
23
+ "loss": 0.3456,
24
+ "step": 100
25
+ },
26
+ {
27
+ "epoch": 0.13333333333333333,
28
+ "grad_norm": 0.11451203376054764,
29
+ "learning_rate": 1.911703703703704e-05,
30
+ "loss": 0.2025,
31
+ "step": 150
32
+ },
33
+ {
34
+ "epoch": 0.17777777777777778,
35
+ "grad_norm": 0.08061835914850235,
36
+ "learning_rate": 1.882074074074074e-05,
37
+ "loss": 0.1318,
38
+ "step": 200
39
+ },
40
+ {
41
+ "epoch": 0.2222222222222222,
42
+ "grad_norm": 0.05962532013654709,
43
+ "learning_rate": 1.8524444444444444e-05,
44
+ "loss": 0.0945,
45
+ "step": 250
46
+ },
47
+ {
48
+ "epoch": 0.26666666666666666,
49
+ "grad_norm": 0.047490622848272324,
50
+ "learning_rate": 1.822814814814815e-05,
51
+ "loss": 0.0726,
52
+ "step": 300
53
+ },
54
+ {
55
+ "epoch": 0.3111111111111111,
56
+ "grad_norm": 0.038484182208776474,
57
+ "learning_rate": 1.7931851851851853e-05,
58
+ "loss": 0.0585,
59
+ "step": 350
60
+ },
61
+ {
62
+ "epoch": 0.35555555555555557,
63
+ "grad_norm": 0.03241903707385063,
64
+ "learning_rate": 1.7635555555555555e-05,
65
+ "loss": 0.049,
66
+ "step": 400
67
+ },
68
+ {
69
+ "epoch": 0.4,
70
+ "grad_norm": 0.02833125926554203,
71
+ "learning_rate": 1.733925925925926e-05,
72
+ "loss": 0.0427,
73
+ "step": 450
74
+ },
75
+ {
76
+ "epoch": 0.4444444444444444,
77
+ "grad_norm": 0.024066274985671043,
78
+ "learning_rate": 1.7042962962962964e-05,
79
+ "loss": 0.037,
80
+ "step": 500
81
+ },
82
+ {
83
+ "epoch": 0.4888888888888889,
84
+ "grad_norm": 0.023793209344148636,
85
+ "learning_rate": 1.674666666666667e-05,
86
+ "loss": 0.0334,
87
+ "step": 550
88
+ },
89
+ {
90
+ "epoch": 0.5333333333333333,
91
+ "grad_norm": 0.025505442172288895,
92
+ "learning_rate": 1.6450370370370373e-05,
93
+ "loss": 0.0307,
94
+ "step": 600
95
+ },
96
+ {
97
+ "epoch": 0.5777777777777777,
98
+ "grad_norm": 0.023647351190447807,
99
+ "learning_rate": 1.6154074074074075e-05,
100
+ "loss": 0.0283,
101
+ "step": 650
102
+ },
103
+ {
104
+ "epoch": 0.6222222222222222,
105
+ "grad_norm": 0.018704526126384735,
106
+ "learning_rate": 1.5857777777777778e-05,
107
+ "loss": 0.0264,
108
+ "step": 700
109
+ },
110
+ {
111
+ "epoch": 0.6666666666666666,
112
+ "grad_norm": 0.020357510074973106,
113
+ "learning_rate": 1.556148148148148e-05,
114
+ "loss": 0.0252,
115
+ "step": 750
116
+ },
117
+ {
118
+ "epoch": 0.7111111111111111,
119
+ "grad_norm": 0.015282705426216125,
120
+ "learning_rate": 1.5265185185185187e-05,
121
+ "loss": 0.0232,
122
+ "step": 800
123
+ },
124
+ {
125
+ "epoch": 0.7555555555555555,
126
+ "grad_norm": 0.019114945083856583,
127
+ "learning_rate": 1.4968888888888891e-05,
128
+ "loss": 0.0223,
129
+ "step": 850
130
+ },
131
+ {
132
+ "epoch": 0.8,
133
+ "grad_norm": 0.016722247004508972,
134
+ "learning_rate": 1.4672592592592594e-05,
135
+ "loss": 0.0208,
136
+ "step": 900
137
+ },
138
+ {
139
+ "epoch": 0.8444444444444444,
140
+ "grad_norm": 0.016854777932167053,
141
+ "learning_rate": 1.4376296296296296e-05,
142
+ "loss": 0.02,
143
+ "step": 950
144
+ },
145
+ {
146
+ "epoch": 0.8888888888888888,
147
+ "grad_norm": 0.01701257936656475,
148
+ "learning_rate": 1.408e-05,
149
+ "loss": 0.0194,
150
+ "step": 1000
151
+ },
152
+ {
153
+ "epoch": 0.9333333333333333,
154
+ "grad_norm": 0.016065537929534912,
155
+ "learning_rate": 1.3783703703703705e-05,
156
+ "loss": 0.0187,
157
+ "step": 1050
158
+ },
159
+ {
160
+ "epoch": 0.9777777777777777,
161
+ "grad_norm": 0.01564837247133255,
162
+ "learning_rate": 1.348740740740741e-05,
163
+ "loss": 0.0187,
164
+ "step": 1100
165
+ },
166
+ {
167
+ "epoch": 1.0,
168
+ "eval_loss": 0.0170283243060112,
169
+ "eval_macro_f1": 0.0007731728834392315,
170
+ "eval_micro_f1": 0.38728897715988087,
171
+ "eval_runtime": 1.3725,
172
+ "eval_samples_per_second": 728.62,
173
+ "eval_steps_per_second": 91.077,
174
+ "eval_subset_accuracy": 0.001,
175
+ "step": 1125
176
+ },
177
+ {
178
+ "epoch": 1.0222222222222221,
179
+ "grad_norm": 0.014304032549262047,
180
+ "learning_rate": 1.3191111111111112e-05,
181
+ "loss": 0.0184,
182
+ "step": 1150
183
+ },
184
+ {
185
+ "epoch": 1.0666666666666667,
186
+ "grad_norm": 0.013109758496284485,
187
+ "learning_rate": 1.2894814814814816e-05,
188
+ "loss": 0.0173,
189
+ "step": 1200
190
+ },
191
+ {
192
+ "epoch": 1.1111111111111112,
193
+ "grad_norm": 0.01453586295247078,
194
+ "learning_rate": 1.2598518518518519e-05,
195
+ "loss": 0.0161,
196
+ "step": 1250
197
+ },
198
+ {
199
+ "epoch": 1.1555555555555554,
200
+ "grad_norm": 0.015925494953989983,
201
+ "learning_rate": 1.2302222222222225e-05,
202
+ "loss": 0.0161,
203
+ "step": 1300
204
+ },
205
+ {
206
+ "epoch": 1.2,
207
+ "grad_norm": 0.015366824343800545,
208
+ "learning_rate": 1.2005925925925928e-05,
209
+ "loss": 0.0166,
210
+ "step": 1350
211
+ },
212
+ {
213
+ "epoch": 1.2444444444444445,
214
+ "grad_norm": 0.011549337767064571,
215
+ "learning_rate": 1.170962962962963e-05,
216
+ "loss": 0.0154,
217
+ "step": 1400
218
+ },
219
+ {
220
+ "epoch": 1.2888888888888888,
221
+ "grad_norm": 0.012960967607796192,
222
+ "learning_rate": 1.1413333333333335e-05,
223
+ "loss": 0.0157,
224
+ "step": 1450
225
+ },
226
+ {
227
+ "epoch": 1.3333333333333333,
228
+ "grad_norm": 0.013876300305128098,
229
+ "learning_rate": 1.1117037037037037e-05,
230
+ "loss": 0.0154,
231
+ "step": 1500
232
+ },
233
+ {
234
+ "epoch": 1.3777777777777778,
235
+ "grad_norm": 0.013066369108855724,
236
+ "learning_rate": 1.082074074074074e-05,
237
+ "loss": 0.0148,
238
+ "step": 1550
239
+ },
240
+ {
241
+ "epoch": 1.4222222222222223,
242
+ "grad_norm": 0.012255179695785046,
243
+ "learning_rate": 1.0524444444444446e-05,
244
+ "loss": 0.0151,
245
+ "step": 1600
246
+ },
247
+ {
248
+ "epoch": 1.4666666666666668,
249
+ "grad_norm": 0.011660152114927769,
250
+ "learning_rate": 1.0228148148148149e-05,
251
+ "loss": 0.0142,
252
+ "step": 1650
253
+ },
254
+ {
255
+ "epoch": 1.511111111111111,
256
+ "grad_norm": 0.018514148890972137,
257
+ "learning_rate": 9.931851851851853e-06,
258
+ "loss": 0.0145,
259
+ "step": 1700
260
+ },
261
+ {
262
+ "epoch": 1.5555555555555556,
263
+ "grad_norm": 0.013358614407479763,
264
+ "learning_rate": 9.635555555555557e-06,
265
+ "loss": 0.0136,
266
+ "step": 1750
267
+ },
268
+ {
269
+ "epoch": 1.6,
270
+ "grad_norm": 0.011820090934634209,
271
+ "learning_rate": 9.33925925925926e-06,
272
+ "loss": 0.0144,
273
+ "step": 1800
274
+ },
275
+ {
276
+ "epoch": 1.6444444444444444,
277
+ "grad_norm": 0.017100291326642036,
278
+ "learning_rate": 9.042962962962963e-06,
279
+ "loss": 0.0146,
280
+ "step": 1850
281
+ },
282
+ {
283
+ "epoch": 1.6888888888888889,
284
+ "grad_norm": 0.014295758679509163,
285
+ "learning_rate": 8.746666666666667e-06,
286
+ "loss": 0.0135,
287
+ "step": 1900
288
+ },
289
+ {
290
+ "epoch": 1.7333333333333334,
291
+ "grad_norm": 0.011741062626242638,
292
+ "learning_rate": 8.450370370370371e-06,
293
+ "loss": 0.0141,
294
+ "step": 1950
295
+ },
296
+ {
297
+ "epoch": 1.7777777777777777,
298
+ "grad_norm": 0.016170430928468704,
299
+ "learning_rate": 8.154074074074074e-06,
300
+ "loss": 0.0147,
301
+ "step": 2000
302
+ },
303
+ {
304
+ "epoch": 1.8222222222222222,
305
+ "grad_norm": 0.015337902121245861,
306
+ "learning_rate": 7.857777777777778e-06,
307
+ "loss": 0.0135,
308
+ "step": 2050
309
+ },
310
+ {
311
+ "epoch": 1.8666666666666667,
312
+ "grad_norm": 0.014960219152271748,
313
+ "learning_rate": 7.561481481481482e-06,
314
+ "loss": 0.013,
315
+ "step": 2100
316
+ },
317
+ {
318
+ "epoch": 1.911111111111111,
319
+ "grad_norm": 0.016356410458683968,
320
+ "learning_rate": 7.265185185185186e-06,
321
+ "loss": 0.0126,
322
+ "step": 2150
323
+ },
324
+ {
325
+ "epoch": 1.9555555555555557,
326
+ "grad_norm": 0.016427526250481606,
327
+ "learning_rate": 6.96888888888889e-06,
328
+ "loss": 0.0132,
329
+ "step": 2200
330
+ },
331
+ {
332
+ "epoch": 2.0,
333
+ "grad_norm": 0.009968223981559277,
334
+ "learning_rate": 6.672592592592592e-06,
335
+ "loss": 0.0126,
336
+ "step": 2250
337
+ },
338
+ {
339
+ "epoch": 2.0,
340
+ "eval_loss": 0.012450361624360085,
341
+ "eval_macro_f1": 0.0007731728834392315,
342
+ "eval_micro_f1": 0.38728897715988087,
343
+ "eval_runtime": 1.4199,
344
+ "eval_samples_per_second": 704.295,
345
+ "eval_steps_per_second": 88.037,
346
+ "eval_subset_accuracy": 0.001,
347
+ "step": 2250
348
+ },
349
+ {
350
+ "epoch": 2.0444444444444443,
351
+ "grad_norm": 0.013971192762255669,
352
+ "learning_rate": 6.376296296296297e-06,
353
+ "loss": 0.0133,
354
+ "step": 2300
355
+ },
356
+ {
357
+ "epoch": 2.088888888888889,
358
+ "grad_norm": 0.012733048759400845,
359
+ "learning_rate": 6.08e-06,
360
+ "loss": 0.0125,
361
+ "step": 2350
362
+ },
363
+ {
364
+ "epoch": 2.1333333333333333,
365
+ "grad_norm": 0.01237008348107338,
366
+ "learning_rate": 5.783703703703705e-06,
367
+ "loss": 0.0129,
368
+ "step": 2400
369
+ },
370
+ {
371
+ "epoch": 2.1777777777777776,
372
+ "grad_norm": 0.014322527684271336,
373
+ "learning_rate": 5.487407407407408e-06,
374
+ "loss": 0.0127,
375
+ "step": 2450
376
+ },
377
+ {
378
+ "epoch": 2.2222222222222223,
379
+ "grad_norm": 0.012235715053975582,
380
+ "learning_rate": 5.1911111111111116e-06,
381
+ "loss": 0.0128,
382
+ "step": 2500
383
+ },
384
+ {
385
+ "epoch": 2.2666666666666666,
386
+ "grad_norm": 0.011698862537741661,
387
+ "learning_rate": 4.894814814814815e-06,
388
+ "loss": 0.0133,
389
+ "step": 2550
390
+ },
391
+ {
392
+ "epoch": 2.311111111111111,
393
+ "grad_norm": 0.01482357643544674,
394
+ "learning_rate": 4.5985185185185186e-06,
395
+ "loss": 0.0128,
396
+ "step": 2600
397
+ },
398
+ {
399
+ "epoch": 2.3555555555555556,
400
+ "grad_norm": 0.01061360165476799,
401
+ "learning_rate": 4.302222222222223e-06,
402
+ "loss": 0.0132,
403
+ "step": 2650
404
+ },
405
+ {
406
+ "epoch": 2.4,
407
+ "grad_norm": 0.0190553180873394,
408
+ "learning_rate": 4.005925925925926e-06,
409
+ "loss": 0.0121,
410
+ "step": 2700
411
+ },
412
+ {
413
+ "epoch": 2.4444444444444446,
414
+ "grad_norm": 0.012238995172083378,
415
+ "learning_rate": 3.7096296296296295e-06,
416
+ "loss": 0.0122,
417
+ "step": 2750
418
+ },
419
+ {
420
+ "epoch": 2.488888888888889,
421
+ "grad_norm": 0.011436214670538902,
422
+ "learning_rate": 3.4133333333333334e-06,
423
+ "loss": 0.0126,
424
+ "step": 2800
425
+ },
426
+ {
427
+ "epoch": 2.533333333333333,
428
+ "grad_norm": 0.014483662322163582,
429
+ "learning_rate": 3.1170370370370373e-06,
430
+ "loss": 0.0123,
431
+ "step": 2850
432
+ },
433
+ {
434
+ "epoch": 2.5777777777777775,
435
+ "grad_norm": 0.010435127653181553,
436
+ "learning_rate": 2.8207407407407412e-06,
437
+ "loss": 0.0115,
438
+ "step": 2900
439
+ },
440
+ {
441
+ "epoch": 2.6222222222222222,
442
+ "grad_norm": 0.010050828568637371,
443
+ "learning_rate": 2.5244444444444447e-06,
444
+ "loss": 0.012,
445
+ "step": 2950
446
+ },
447
+ {
448
+ "epoch": 2.6666666666666665,
449
+ "grad_norm": 0.01314499881118536,
450
+ "learning_rate": 2.2281481481481482e-06,
451
+ "loss": 0.0124,
452
+ "step": 3000
453
+ },
454
+ {
455
+ "epoch": 2.7111111111111112,
456
+ "grad_norm": 0.017557885497808456,
457
+ "learning_rate": 1.931851851851852e-06,
458
+ "loss": 0.0127,
459
+ "step": 3050
460
+ },
461
+ {
462
+ "epoch": 2.7555555555555555,
463
+ "grad_norm": 0.014554030261933804,
464
+ "learning_rate": 1.6355555555555559e-06,
465
+ "loss": 0.0124,
466
+ "step": 3100
467
+ },
468
+ {
469
+ "epoch": 2.8,
470
+ "grad_norm": 0.010911783203482628,
471
+ "learning_rate": 1.3392592592592594e-06,
472
+ "loss": 0.0128,
473
+ "step": 3150
474
+ },
475
+ {
476
+ "epoch": 2.8444444444444446,
477
+ "grad_norm": 0.01358073577284813,
478
+ "learning_rate": 1.042962962962963e-06,
479
+ "loss": 0.0121,
480
+ "step": 3200
481
+ },
482
+ {
483
+ "epoch": 2.888888888888889,
484
+ "grad_norm": 0.017485886812210083,
485
+ "learning_rate": 7.466666666666668e-07,
486
+ "loss": 0.0123,
487
+ "step": 3250
488
+ },
489
+ {
490
+ "epoch": 2.9333333333333336,
491
+ "grad_norm": 0.014273952692747116,
492
+ "learning_rate": 4.503703703703704e-07,
493
+ "loss": 0.0123,
494
+ "step": 3300
495
+ },
496
+ {
497
+ "epoch": 2.977777777777778,
498
+ "grad_norm": 0.011057054623961449,
499
+ "learning_rate": 1.540740740740741e-07,
500
+ "loss": 0.0118,
501
+ "step": 3350
502
+ },
503
+ {
504
+ "epoch": 3.0,
505
+ "eval_loss": 0.011671863496303558,
506
+ "eval_macro_f1": 0.0007731728834392315,
507
+ "eval_micro_f1": 0.38728897715988087,
508
+ "eval_runtime": 1.4275,
509
+ "eval_samples_per_second": 700.522,
510
+ "eval_steps_per_second": 87.565,
511
+ "eval_subset_accuracy": 0.001,
512
+ "step": 3375
513
+ }
514
+ ],
515
+ "logging_steps": 50,
516
+ "max_steps": 3375,
517
+ "num_input_tokens_seen": 0,
518
+ "num_train_epochs": 3,
519
+ "save_steps": 500,
520
+ "stateful_callbacks": {
521
+ "TrainerControl": {
522
+ "args": {
523
+ "should_epoch_stop": false,
524
+ "should_evaluate": false,
525
+ "should_log": false,
526
+ "should_save": true,
527
+ "should_training_stop": true
528
+ },
529
+ "attributes": {}
530
+ }
531
+ },
532
+ "total_flos": 7185323013120000.0,
533
+ "train_batch_size": 8,
534
+ "trial_name": null,
535
+ "trial_params": null
536
+ }
checkpoint-3375/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee46aba967c8873c2f61f80b1ad656e6b063317ea662c3d4695c8442bcd9f6da
3
+ size 5841
checkpoint-3375/vocab.txt ADDED
The diff for this file is too large to render. See raw diff
 
checkpoint-61830/config.json ADDED
@@ -0,0 +1,2584 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertForSequenceClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "id2label": {
12
+ "0": "1",
13
+ "1": "10",
14
+ "2": "100",
15
+ "3": "1003",
16
+ "4": "1004",
17
+ "5": "1005",
18
+ "6": "1006",
19
+ "7": "1007",
20
+ "8": "1008",
21
+ "9": "1009",
22
+ "10": "101",
23
+ "11": "1010",
24
+ "12": "1011",
25
+ "13": "1012",
26
+ "14": "1013",
27
+ "15": "1014",
28
+ "16": "1017",
29
+ "17": "1018",
30
+ "18": "1019",
31
+ "19": "102",
32
+ "20": "1020",
33
+ "21": "1021",
34
+ "22": "1022",
35
+ "23": "1023",
36
+ "24": "103",
37
+ "25": "1034",
38
+ "26": "1035",
39
+ "27": "104",
40
+ "28": "1040",
41
+ "29": "1043",
42
+ "30": "1046",
43
+ "31": "1047",
44
+ "32": "1048",
45
+ "33": "105",
46
+ "34": "1050",
47
+ "35": "1051",
48
+ "36": "1052",
49
+ "37": "1053",
50
+ "38": "1054",
51
+ "39": "1055",
52
+ "40": "1056",
53
+ "41": "1058",
54
+ "42": "1059",
55
+ "43": "1060",
56
+ "44": "1062",
57
+ "45": "107",
58
+ "46": "1071",
59
+ "47": "1073",
60
+ "48": "108",
61
+ "49": "1084",
62
+ "50": "1086",
63
+ "51": "1097",
64
+ "52": "1099",
65
+ "53": "11",
66
+ "54": "110",
67
+ "55": "1100",
68
+ "56": "1106",
69
+ "57": "1147",
70
+ "58": "1148",
71
+ "59": "1149",
72
+ "60": "1150",
73
+ "61": "1151",
74
+ "62": "1152",
75
+ "63": "1154",
76
+ "64": "1156",
77
+ "65": "1157",
78
+ "66": "1158",
79
+ "67": "1160",
80
+ "68": "1161",
81
+ "69": "1162",
82
+ "70": "1166",
83
+ "71": "1167",
84
+ "72": "1169",
85
+ "73": "1170",
86
+ "74": "1171",
87
+ "75": "1172",
88
+ "76": "1173",
89
+ "77": "1174",
90
+ "78": "1175",
91
+ "79": "1177",
92
+ "80": "1178",
93
+ "81": "1179",
94
+ "82": "118",
95
+ "83": "1180",
96
+ "84": "1181",
97
+ "85": "1184",
98
+ "86": "1185",
99
+ "87": "1186",
100
+ "88": "1187",
101
+ "89": "1188",
102
+ "90": "1189",
103
+ "91": "119",
104
+ "92": "1190",
105
+ "93": "1191",
106
+ "94": "1192",
107
+ "95": "1193",
108
+ "96": "1195",
109
+ "97": "1196",
110
+ "98": "1198",
111
+ "99": "1199",
112
+ "100": "12",
113
+ "101": "120",
114
+ "102": "1201",
115
+ "103": "1202",
116
+ "104": "1203",
117
+ "105": "1204",
118
+ "106": "1205",
119
+ "107": "1206",
120
+ "108": "1207",
121
+ "109": "1208",
122
+ "110": "121",
123
+ "111": "1210",
124
+ "112": "1211",
125
+ "113": "1212",
126
+ "114": "1213",
127
+ "115": "1217",
128
+ "116": "1218",
129
+ "117": "122",
130
+ "118": "1222",
131
+ "119": "1223",
132
+ "120": "1224",
133
+ "121": "1225",
134
+ "122": "1226",
135
+ "123": "1229",
136
+ "124": "123",
137
+ "125": "1230",
138
+ "126": "1231",
139
+ "127": "1232",
140
+ "128": "1233",
141
+ "129": "1234",
142
+ "130": "1235",
143
+ "131": "1236",
144
+ "132": "1238",
145
+ "133": "1239",
146
+ "134": "124",
147
+ "135": "1240",
148
+ "136": "1241",
149
+ "137": "1242",
150
+ "138": "1243",
151
+ "139": "1244",
152
+ "140": "1245",
153
+ "141": "1246",
154
+ "142": "1247",
155
+ "143": "1248",
156
+ "144": "1249",
157
+ "145": "125",
158
+ "146": "1250",
159
+ "147": "1251",
160
+ "148": "1252",
161
+ "149": "1253",
162
+ "150": "1256",
163
+ "151": "1257",
164
+ "152": "1258",
165
+ "153": "1259",
166
+ "154": "126",
167
+ "155": "1260",
168
+ "156": "1261",
169
+ "157": "1262",
170
+ "158": "1263",
171
+ "159": "1264",
172
+ "160": "1266",
173
+ "161": "1267",
174
+ "162": "1268",
175
+ "163": "1269",
176
+ "164": "127",
177
+ "165": "1270",
178
+ "166": "1271",
179
+ "167": "1272",
180
+ "168": "1273",
181
+ "169": "1274",
182
+ "170": "1275",
183
+ "171": "1276",
184
+ "172": "1277",
185
+ "173": "1278",
186
+ "174": "1279",
187
+ "175": "128",
188
+ "176": "1280",
189
+ "177": "1281",
190
+ "178": "1282",
191
+ "179": "1283",
192
+ "180": "1284",
193
+ "181": "1285",
194
+ "182": "1287",
195
+ "183": "1288",
196
+ "184": "1289",
197
+ "185": "1290",
198
+ "186": "1291",
199
+ "187": "1292",
200
+ "188": "1293",
201
+ "189": "1294",
202
+ "190": "1295",
203
+ "191": "1296",
204
+ "192": "1297",
205
+ "193": "1298",
206
+ "194": "1299",
207
+ "195": "13",
208
+ "196": "1300",
209
+ "197": "1301",
210
+ "198": "1302",
211
+ "199": "1303",
212
+ "200": "1304",
213
+ "201": "1305",
214
+ "202": "1306",
215
+ "203": "1307",
216
+ "204": "1308",
217
+ "205": "1309",
218
+ "206": "1310",
219
+ "207": "1311",
220
+ "208": "1312",
221
+ "209": "1313",
222
+ "210": "1314",
223
+ "211": "1315",
224
+ "212": "1316",
225
+ "213": "1317",
226
+ "214": "1318",
227
+ "215": "1319",
228
+ "216": "1320",
229
+ "217": "1321",
230
+ "218": "1322",
231
+ "219": "1323",
232
+ "220": "1324",
233
+ "221": "1325",
234
+ "222": "1326",
235
+ "223": "1327",
236
+ "224": "1328",
237
+ "225": "1329",
238
+ "226": "133",
239
+ "227": "1330",
240
+ "228": "1331",
241
+ "229": "1333",
242
+ "230": "1334",
243
+ "231": "1336",
244
+ "232": "1340",
245
+ "233": "1341",
246
+ "234": "1342",
247
+ "235": "1343",
248
+ "236": "1346",
249
+ "237": "135",
250
+ "238": "1350",
251
+ "239": "1351",
252
+ "240": "1357",
253
+ "241": "1359",
254
+ "242": "136",
255
+ "243": "1361",
256
+ "244": "1362",
257
+ "245": "1363",
258
+ "246": "1364",
259
+ "247": "1365",
260
+ "248": "1367",
261
+ "249": "1368",
262
+ "250": "1369",
263
+ "251": "137",
264
+ "252": "1370",
265
+ "253": "1371",
266
+ "254": "1372",
267
+ "255": "1373",
268
+ "256": "1374",
269
+ "257": "1376",
270
+ "258": "1377",
271
+ "259": "1378",
272
+ "260": "1379",
273
+ "261": "138",
274
+ "262": "1380",
275
+ "263": "1382",
276
+ "264": "1383",
277
+ "265": "1384",
278
+ "266": "1385",
279
+ "267": "1386",
280
+ "268": "1387",
281
+ "269": "1388",
282
+ "270": "1389",
283
+ "271": "139",
284
+ "272": "1391",
285
+ "273": "1396",
286
+ "274": "1397",
287
+ "275": "1398",
288
+ "276": "1399",
289
+ "277": "14",
290
+ "278": "140",
291
+ "279": "1400",
292
+ "280": "1401",
293
+ "281": "1402",
294
+ "282": "1403",
295
+ "283": "141",
296
+ "284": "1413",
297
+ "285": "1415",
298
+ "286": "1416",
299
+ "287": "1417",
300
+ "288": "1419",
301
+ "289": "142",
302
+ "290": "1420",
303
+ "291": "1421",
304
+ "292": "1422",
305
+ "293": "1423",
306
+ "294": "1425",
307
+ "295": "1426",
308
+ "296": "1427",
309
+ "297": "1428",
310
+ "298": "1429",
311
+ "299": "143",
312
+ "300": "1430",
313
+ "301": "1431",
314
+ "302": "1432",
315
+ "303": "1433",
316
+ "304": "1438",
317
+ "305": "1439",
318
+ "306": "144",
319
+ "307": "1441",
320
+ "308": "1443",
321
+ "309": "1444",
322
+ "310": "1445",
323
+ "311": "1446",
324
+ "312": "1447",
325
+ "313": "1448",
326
+ "314": "1449",
327
+ "315": "145",
328
+ "316": "1450",
329
+ "317": "1451",
330
+ "318": "1452",
331
+ "319": "1453",
332
+ "320": "1454",
333
+ "321": "1455",
334
+ "322": "1456",
335
+ "323": "1457",
336
+ "324": "1458",
337
+ "325": "1459",
338
+ "326": "146",
339
+ "327": "1460",
340
+ "328": "1461",
341
+ "329": "1462",
342
+ "330": "1463",
343
+ "331": "1464",
344
+ "332": "1465",
345
+ "333": "1466",
346
+ "334": "1467",
347
+ "335": "1468",
348
+ "336": "1469",
349
+ "337": "147",
350
+ "338": "1470",
351
+ "339": "1471",
352
+ "340": "1473",
353
+ "341": "1474",
354
+ "342": "1475",
355
+ "343": "1476",
356
+ "344": "1477",
357
+ "345": "1478",
358
+ "346": "1479",
359
+ "347": "1480",
360
+ "348": "1481",
361
+ "349": "1482",
362
+ "350": "1483",
363
+ "351": "1484",
364
+ "352": "1485",
365
+ "353": "1486",
366
+ "354": "1487",
367
+ "355": "1488",
368
+ "356": "1489",
369
+ "357": "1490",
370
+ "358": "1491",
371
+ "359": "1492",
372
+ "360": "1493",
373
+ "361": "1494",
374
+ "362": "1495",
375
+ "363": "1496",
376
+ "364": "1497",
377
+ "365": "1498",
378
+ "366": "1499",
379
+ "367": "15",
380
+ "368": "1500",
381
+ "369": "1501",
382
+ "370": "1502",
383
+ "371": "1507",
384
+ "372": "1509",
385
+ "373": "1510",
386
+ "374": "1511",
387
+ "375": "1512",
388
+ "376": "1513",
389
+ "377": "1514",
390
+ "378": "1515",
391
+ "379": "1516",
392
+ "380": "1517",
393
+ "381": "1518",
394
+ "382": "1519",
395
+ "383": "152",
396
+ "384": "1520",
397
+ "385": "1521",
398
+ "386": "1522",
399
+ "387": "1523",
400
+ "388": "1524",
401
+ "389": "1525",
402
+ "390": "1526",
403
+ "391": "1527",
404
+ "392": "1528",
405
+ "393": "1529",
406
+ "394": "153",
407
+ "395": "1530",
408
+ "396": "1531",
409
+ "397": "1532",
410
+ "398": "1533",
411
+ "399": "1534",
412
+ "400": "1535",
413
+ "401": "1536",
414
+ "402": "1537",
415
+ "403": "1538",
416
+ "404": "1539",
417
+ "405": "154",
418
+ "406": "1540",
419
+ "407": "1541",
420
+ "408": "1542",
421
+ "409": "1543",
422
+ "410": "1544",
423
+ "411": "1545",
424
+ "412": "1546",
425
+ "413": "1547",
426
+ "414": "1548",
427
+ "415": "1549",
428
+ "416": "155",
429
+ "417": "1550",
430
+ "418": "1551",
431
+ "419": "1552",
432
+ "420": "1553",
433
+ "421": "1554",
434
+ "422": "1555",
435
+ "423": "1556",
436
+ "424": "1557",
437
+ "425": "1558",
438
+ "426": "1559",
439
+ "427": "1560",
440
+ "428": "1561",
441
+ "429": "1562",
442
+ "430": "1563",
443
+ "431": "1564",
444
+ "432": "1565",
445
+ "433": "1566",
446
+ "434": "1567",
447
+ "435": "1568",
448
+ "436": "1569",
449
+ "437": "157",
450
+ "438": "1570",
451
+ "439": "1571",
452
+ "440": "1572",
453
+ "441": "1573",
454
+ "442": "1574",
455
+ "443": "1575",
456
+ "444": "1576",
457
+ "445": "1577",
458
+ "446": "1578",
459
+ "447": "1579",
460
+ "448": "158",
461
+ "449": "1580",
462
+ "450": "1581",
463
+ "451": "1582",
464
+ "452": "1583",
465
+ "453": "1584",
466
+ "454": "1585",
467
+ "455": "1586",
468
+ "456": "159",
469
+ "457": "160",
470
+ "458": "162",
471
+ "459": "163",
472
+ "460": "164",
473
+ "461": "165",
474
+ "462": "166",
475
+ "463": "167",
476
+ "464": "168",
477
+ "465": "169",
478
+ "466": "17",
479
+ "467": "170",
480
+ "468": "171",
481
+ "469": "172",
482
+ "470": "173",
483
+ "471": "174",
484
+ "472": "175",
485
+ "473": "177",
486
+ "474": "178",
487
+ "475": "179",
488
+ "476": "18",
489
+ "477": "180",
490
+ "478": "181",
491
+ "479": "182",
492
+ "480": "19",
493
+ "481": "192",
494
+ "482": "193",
495
+ "483": "194",
496
+ "484": "195",
497
+ "485": "197",
498
+ "486": "199",
499
+ "487": "20",
500
+ "488": "200",
501
+ "489": "202",
502
+ "490": "203",
503
+ "491": "204",
504
+ "492": "205",
505
+ "493": "206",
506
+ "494": "207",
507
+ "495": "208",
508
+ "496": "209",
509
+ "497": "210",
510
+ "498": "211",
511
+ "499": "212",
512
+ "500": "213",
513
+ "501": "214",
514
+ "502": "215",
515
+ "503": "216",
516
+ "504": "217",
517
+ "505": "218",
518
+ "506": "219",
519
+ "507": "22",
520
+ "508": "220",
521
+ "509": "221",
522
+ "510": "222",
523
+ "511": "223",
524
+ "512": "224",
525
+ "513": "225",
526
+ "514": "226",
527
+ "515": "227",
528
+ "516": "229",
529
+ "517": "23",
530
+ "518": "230",
531
+ "519": "231",
532
+ "520": "232",
533
+ "521": "233",
534
+ "522": "234",
535
+ "523": "236",
536
+ "524": "237",
537
+ "525": "238",
538
+ "526": "239",
539
+ "527": "24",
540
+ "528": "240",
541
+ "529": "241",
542
+ "530": "242",
543
+ "531": "243",
544
+ "532": "244",
545
+ "533": "245",
546
+ "534": "246",
547
+ "535": "247",
548
+ "536": "248",
549
+ "537": "249",
550
+ "538": "25",
551
+ "539": "250",
552
+ "540": "251",
553
+ "541": "252",
554
+ "542": "253",
555
+ "543": "254",
556
+ "544": "255",
557
+ "545": "256",
558
+ "546": "257",
559
+ "547": "259",
560
+ "548": "26",
561
+ "549": "260",
562
+ "550": "261",
563
+ "551": "262",
564
+ "552": "27",
565
+ "553": "28",
566
+ "554": "288",
567
+ "555": "289",
568
+ "556": "29",
569
+ "557": "290",
570
+ "558": "291",
571
+ "559": "292",
572
+ "560": "293",
573
+ "561": "294",
574
+ "562": "295",
575
+ "563": "296",
576
+ "564": "297",
577
+ "565": "298",
578
+ "566": "30",
579
+ "567": "300",
580
+ "568": "301",
581
+ "569": "302",
582
+ "570": "303",
583
+ "571": "304",
584
+ "572": "306",
585
+ "573": "307",
586
+ "574": "308",
587
+ "575": "309",
588
+ "576": "31",
589
+ "577": "310",
590
+ "578": "311",
591
+ "579": "312",
592
+ "580": "313",
593
+ "581": "315",
594
+ "582": "317",
595
+ "583": "318",
596
+ "584": "319",
597
+ "585": "32",
598
+ "586": "320",
599
+ "587": "321",
600
+ "588": "322",
601
+ "589": "323",
602
+ "590": "324",
603
+ "591": "325",
604
+ "592": "326",
605
+ "593": "327",
606
+ "594": "328",
607
+ "595": "329",
608
+ "596": "33",
609
+ "597": "330",
610
+ "598": "331",
611
+ "599": "332",
612
+ "600": "333",
613
+ "601": "334",
614
+ "602": "335",
615
+ "603": "336",
616
+ "604": "337",
617
+ "605": "338",
618
+ "606": "339",
619
+ "607": "34",
620
+ "608": "340",
621
+ "609": "341",
622
+ "610": "342",
623
+ "611": "343",
624
+ "612": "344",
625
+ "613": "345",
626
+ "614": "349",
627
+ "615": "35",
628
+ "616": "350",
629
+ "617": "351",
630
+ "618": "352",
631
+ "619": "353",
632
+ "620": "354",
633
+ "621": "355",
634
+ "622": "356",
635
+ "623": "358",
636
+ "624": "359",
637
+ "625": "36",
638
+ "626": "361",
639
+ "627": "362",
640
+ "628": "363",
641
+ "629": "364",
642
+ "630": "365",
643
+ "631": "366",
644
+ "632": "367",
645
+ "633": "368",
646
+ "634": "369",
647
+ "635": "37",
648
+ "636": "370",
649
+ "637": "371",
650
+ "638": "372",
651
+ "639": "373",
652
+ "640": "374",
653
+ "641": "375",
654
+ "642": "376",
655
+ "643": "377",
656
+ "644": "378",
657
+ "645": "379",
658
+ "646": "38",
659
+ "647": "380",
660
+ "648": "381",
661
+ "649": "382",
662
+ "650": "383",
663
+ "651": "384",
664
+ "652": "385",
665
+ "653": "386",
666
+ "654": "387",
667
+ "655": "388",
668
+ "656": "389",
669
+ "657": "39",
670
+ "658": "390",
671
+ "659": "391",
672
+ "660": "392",
673
+ "661": "393",
674
+ "662": "394",
675
+ "663": "395",
676
+ "664": "396",
677
+ "665": "397",
678
+ "666": "398",
679
+ "667": "399",
680
+ "668": "4",
681
+ "669": "40",
682
+ "670": "400",
683
+ "671": "401",
684
+ "672": "402",
685
+ "673": "403",
686
+ "674": "404",
687
+ "675": "405",
688
+ "676": "406",
689
+ "677": "407",
690
+ "678": "409",
691
+ "679": "41",
692
+ "680": "411",
693
+ "681": "412",
694
+ "682": "414",
695
+ "683": "415",
696
+ "684": "416",
697
+ "685": "418",
698
+ "686": "419",
699
+ "687": "42",
700
+ "688": "420",
701
+ "689": "421",
702
+ "690": "422",
703
+ "691": "423",
704
+ "692": "424",
705
+ "693": "425",
706
+ "694": "426",
707
+ "695": "427",
708
+ "696": "429",
709
+ "697": "43",
710
+ "698": "430",
711
+ "699": "431",
712
+ "700": "432",
713
+ "701": "433",
714
+ "702": "434",
715
+ "703": "435",
716
+ "704": "436",
717
+ "705": "437",
718
+ "706": "438",
719
+ "707": "439",
720
+ "708": "44",
721
+ "709": "440",
722
+ "710": "441",
723
+ "711": "442",
724
+ "712": "443",
725
+ "713": "444",
726
+ "714": "445",
727
+ "715": "446",
728
+ "716": "447",
729
+ "717": "448",
730
+ "718": "449",
731
+ "719": "45",
732
+ "720": "450",
733
+ "721": "451",
734
+ "722": "452",
735
+ "723": "453",
736
+ "724": "454",
737
+ "725": "455",
738
+ "726": "456",
739
+ "727": "457",
740
+ "728": "458",
741
+ "729": "459",
742
+ "730": "46",
743
+ "731": "460",
744
+ "732": "461",
745
+ "733": "462",
746
+ "734": "463",
747
+ "735": "464",
748
+ "736": "465",
749
+ "737": "466",
750
+ "738": "467",
751
+ "739": "468",
752
+ "740": "469",
753
+ "741": "47",
754
+ "742": "470",
755
+ "743": "471",
756
+ "744": "472",
757
+ "745": "473",
758
+ "746": "474",
759
+ "747": "475",
760
+ "748": "476",
761
+ "749": "477",
762
+ "750": "478",
763
+ "751": "479",
764
+ "752": "480",
765
+ "753": "481",
766
+ "754": "482",
767
+ "755": "483",
768
+ "756": "484",
769
+ "757": "485",
770
+ "758": "486",
771
+ "759": "487",
772
+ "760": "488",
773
+ "761": "489",
774
+ "762": "49",
775
+ "763": "490",
776
+ "764": "491",
777
+ "765": "492",
778
+ "766": "493",
779
+ "767": "494",
780
+ "768": "495",
781
+ "769": "496",
782
+ "770": "497",
783
+ "771": "499",
784
+ "772": "5",
785
+ "773": "50",
786
+ "774": "500",
787
+ "775": "501",
788
+ "776": "502",
789
+ "777": "503",
790
+ "778": "504",
791
+ "779": "505",
792
+ "780": "506",
793
+ "781": "507",
794
+ "782": "508",
795
+ "783": "509",
796
+ "784": "51",
797
+ "785": "510",
798
+ "786": "511",
799
+ "787": "512",
800
+ "788": "513",
801
+ "789": "514",
802
+ "790": "515",
803
+ "791": "516",
804
+ "792": "517",
805
+ "793": "518",
806
+ "794": "519",
807
+ "795": "52",
808
+ "796": "520",
809
+ "797": "521",
810
+ "798": "522",
811
+ "799": "523",
812
+ "800": "524",
813
+ "801": "525",
814
+ "802": "526",
815
+ "803": "527",
816
+ "804": "528",
817
+ "805": "529",
818
+ "806": "53",
819
+ "807": "530",
820
+ "808": "531",
821
+ "809": "532",
822
+ "810": "533",
823
+ "811": "534",
824
+ "812": "535",
825
+ "813": "536",
826
+ "814": "537",
827
+ "815": "538",
828
+ "816": "539",
829
+ "817": "54",
830
+ "818": "540",
831
+ "819": "541",
832
+ "820": "542",
833
+ "821": "543",
834
+ "822": "544",
835
+ "823": "546",
836
+ "824": "547",
837
+ "825": "548",
838
+ "826": "549",
839
+ "827": "55",
840
+ "828": "550",
841
+ "829": "551",
842
+ "830": "552",
843
+ "831": "553",
844
+ "832": "554",
845
+ "833": "555",
846
+ "834": "556",
847
+ "835": "557",
848
+ "836": "558",
849
+ "837": "559",
850
+ "838": "56",
851
+ "839": "560",
852
+ "840": "561",
853
+ "841": "562",
854
+ "842": "563",
855
+ "843": "564",
856
+ "844": "565",
857
+ "845": "566",
858
+ "846": "567",
859
+ "847": "568",
860
+ "848": "569",
861
+ "849": "57",
862
+ "850": "570",
863
+ "851": "571",
864
+ "852": "572",
865
+ "853": "573",
866
+ "854": "574",
867
+ "855": "575",
868
+ "856": "576",
869
+ "857": "577",
870
+ "858": "578",
871
+ "859": "579",
872
+ "860": "580",
873
+ "861": "581",
874
+ "862": "582",
875
+ "863": "583",
876
+ "864": "584",
877
+ "865": "585",
878
+ "866": "586",
879
+ "867": "587",
880
+ "868": "588",
881
+ "869": "589",
882
+ "870": "591",
883
+ "871": "593",
884
+ "872": "594",
885
+ "873": "595",
886
+ "874": "597",
887
+ "875": "598",
888
+ "876": "599",
889
+ "877": "6",
890
+ "878": "600",
891
+ "879": "601",
892
+ "880": "602",
893
+ "881": "603",
894
+ "882": "604",
895
+ "883": "605",
896
+ "884": "606",
897
+ "885": "607",
898
+ "886": "608",
899
+ "887": "609",
900
+ "888": "610",
901
+ "889": "611",
902
+ "890": "612",
903
+ "891": "613",
904
+ "892": "614",
905
+ "893": "615",
906
+ "894": "616",
907
+ "895": "618",
908
+ "896": "619",
909
+ "897": "620",
910
+ "898": "621",
911
+ "899": "622",
912
+ "900": "623",
913
+ "901": "624",
914
+ "902": "625",
915
+ "903": "626",
916
+ "904": "627",
917
+ "905": "628",
918
+ "906": "629",
919
+ "907": "630",
920
+ "908": "631",
921
+ "909": "632",
922
+ "910": "633",
923
+ "911": "634",
924
+ "912": "635",
925
+ "913": "636",
926
+ "914": "637",
927
+ "915": "638",
928
+ "916": "64",
929
+ "917": "640",
930
+ "918": "641",
931
+ "919": "643",
932
+ "920": "645",
933
+ "921": "646",
934
+ "922": "647",
935
+ "923": "648",
936
+ "924": "649",
937
+ "925": "65",
938
+ "926": "650",
939
+ "927": "651",
940
+ "928": "652",
941
+ "929": "653",
942
+ "930": "654",
943
+ "931": "655",
944
+ "932": "656",
945
+ "933": "657",
946
+ "934": "658",
947
+ "935": "659",
948
+ "936": "660",
949
+ "937": "661",
950
+ "938": "662",
951
+ "939": "663",
952
+ "940": "664",
953
+ "941": "665",
954
+ "942": "666",
955
+ "943": "667",
956
+ "944": "668",
957
+ "945": "669",
958
+ "946": "67",
959
+ "947": "670",
960
+ "948": "671",
961
+ "949": "672",
962
+ "950": "673",
963
+ "951": "675",
964
+ "952": "676",
965
+ "953": "677",
966
+ "954": "679",
967
+ "955": "680",
968
+ "956": "681",
969
+ "957": "682",
970
+ "958": "683",
971
+ "959": "684",
972
+ "960": "685",
973
+ "961": "686",
974
+ "962": "687",
975
+ "963": "688",
976
+ "964": "689",
977
+ "965": "69",
978
+ "966": "690",
979
+ "967": "691",
980
+ "968": "692",
981
+ "969": "694",
982
+ "970": "695",
983
+ "971": "696",
984
+ "972": "697",
985
+ "973": "698",
986
+ "974": "699",
987
+ "975": "7",
988
+ "976": "70",
989
+ "977": "700",
990
+ "978": "701",
991
+ "979": "702",
992
+ "980": "703",
993
+ "981": "704",
994
+ "982": "705",
995
+ "983": "706",
996
+ "984": "707",
997
+ "985": "708",
998
+ "986": "709",
999
+ "987": "71",
1000
+ "988": "710",
1001
+ "989": "711",
1002
+ "990": "712",
1003
+ "991": "713",
1004
+ "992": "714",
1005
+ "993": "72",
1006
+ "994": "721",
1007
+ "995": "722",
1008
+ "996": "723",
1009
+ "997": "724",
1010
+ "998": "725",
1011
+ "999": "726",
1012
+ "1000": "727",
1013
+ "1001": "728",
1014
+ "1002": "729",
1015
+ "1003": "73",
1016
+ "1004": "730",
1017
+ "1005": "731",
1018
+ "1006": "732",
1019
+ "1007": "733",
1020
+ "1008": "734",
1021
+ "1009": "735",
1022
+ "1010": "736",
1023
+ "1011": "737",
1024
+ "1012": "738",
1025
+ "1013": "739",
1026
+ "1014": "740",
1027
+ "1015": "741",
1028
+ "1016": "742",
1029
+ "1017": "743",
1030
+ "1018": "744",
1031
+ "1019": "745",
1032
+ "1020": "746",
1033
+ "1021": "747",
1034
+ "1022": "748",
1035
+ "1023": "749",
1036
+ "1024": "75",
1037
+ "1025": "750",
1038
+ "1026": "752",
1039
+ "1027": "753",
1040
+ "1028": "754",
1041
+ "1029": "755",
1042
+ "1030": "756",
1043
+ "1031": "757",
1044
+ "1032": "758",
1045
+ "1033": "759",
1046
+ "1034": "76",
1047
+ "1035": "760",
1048
+ "1036": "761",
1049
+ "1037": "762",
1050
+ "1038": "763",
1051
+ "1039": "764",
1052
+ "1040": "765",
1053
+ "1041": "766",
1054
+ "1042": "767",
1055
+ "1043": "768",
1056
+ "1044": "769",
1057
+ "1045": "77",
1058
+ "1046": "770",
1059
+ "1047": "772",
1060
+ "1048": "773",
1061
+ "1049": "774",
1062
+ "1050": "775",
1063
+ "1051": "776",
1064
+ "1052": "777",
1065
+ "1053": "778",
1066
+ "1054": "779",
1067
+ "1055": "78",
1068
+ "1056": "780",
1069
+ "1057": "781",
1070
+ "1058": "782",
1071
+ "1059": "783",
1072
+ "1060": "784",
1073
+ "1061": "785",
1074
+ "1062": "786",
1075
+ "1063": "787",
1076
+ "1064": "788",
1077
+ "1065": "789",
1078
+ "1066": "79",
1079
+ "1067": "790",
1080
+ "1068": "791",
1081
+ "1069": "792",
1082
+ "1070": "793",
1083
+ "1071": "794",
1084
+ "1072": "795",
1085
+ "1073": "796",
1086
+ "1074": "797",
1087
+ "1075": "798",
1088
+ "1076": "8",
1089
+ "1077": "80",
1090
+ "1078": "800",
1091
+ "1079": "801",
1092
+ "1080": "802",
1093
+ "1081": "803",
1094
+ "1082": "804",
1095
+ "1083": "805",
1096
+ "1084": "806",
1097
+ "1085": "807",
1098
+ "1086": "808",
1099
+ "1087": "809",
1100
+ "1088": "81",
1101
+ "1089": "810",
1102
+ "1090": "811",
1103
+ "1091": "812",
1104
+ "1092": "813",
1105
+ "1093": "814",
1106
+ "1094": "815",
1107
+ "1095": "816",
1108
+ "1096": "817",
1109
+ "1097": "818",
1110
+ "1098": "819",
1111
+ "1099": "82",
1112
+ "1100": "820",
1113
+ "1101": "821",
1114
+ "1102": "822",
1115
+ "1103": "824",
1116
+ "1104": "825",
1117
+ "1105": "826",
1118
+ "1106": "827",
1119
+ "1107": "828",
1120
+ "1108": "829",
1121
+ "1109": "83",
1122
+ "1110": "830",
1123
+ "1111": "831",
1124
+ "1112": "832",
1125
+ "1113": "833",
1126
+ "1114": "834",
1127
+ "1115": "835",
1128
+ "1116": "836",
1129
+ "1117": "837",
1130
+ "1118": "838",
1131
+ "1119": "839",
1132
+ "1120": "84",
1133
+ "1121": "840",
1134
+ "1122": "841",
1135
+ "1123": "842",
1136
+ "1124": "843",
1137
+ "1125": "844",
1138
+ "1126": "845",
1139
+ "1127": "846",
1140
+ "1128": "847",
1141
+ "1129": "848",
1142
+ "1130": "849",
1143
+ "1131": "85",
1144
+ "1132": "850",
1145
+ "1133": "851",
1146
+ "1134": "852",
1147
+ "1135": "853",
1148
+ "1136": "854",
1149
+ "1137": "855",
1150
+ "1138": "856",
1151
+ "1139": "857",
1152
+ "1140": "858",
1153
+ "1141": "859",
1154
+ "1142": "86",
1155
+ "1143": "863",
1156
+ "1144": "864",
1157
+ "1145": "865",
1158
+ "1146": "866",
1159
+ "1147": "868",
1160
+ "1148": "87",
1161
+ "1149": "870",
1162
+ "1150": "871",
1163
+ "1151": "872",
1164
+ "1152": "873",
1165
+ "1153": "874",
1166
+ "1154": "875",
1167
+ "1155": "876",
1168
+ "1156": "877",
1169
+ "1157": "878",
1170
+ "1158": "879",
1171
+ "1159": "88",
1172
+ "1160": "880",
1173
+ "1161": "881",
1174
+ "1162": "882",
1175
+ "1163": "883",
1176
+ "1164": "884",
1177
+ "1165": "885",
1178
+ "1166": "886",
1179
+ "1167": "887",
1180
+ "1168": "888",
1181
+ "1169": "889",
1182
+ "1170": "89",
1183
+ "1171": "890",
1184
+ "1172": "891",
1185
+ "1173": "892",
1186
+ "1174": "893",
1187
+ "1175": "894",
1188
+ "1176": "895",
1189
+ "1177": "896",
1190
+ "1178": "897",
1191
+ "1179": "898",
1192
+ "1180": "899",
1193
+ "1181": "9",
1194
+ "1182": "90",
1195
+ "1183": "900",
1196
+ "1184": "901",
1197
+ "1185": "903",
1198
+ "1186": "906",
1199
+ "1187": "909",
1200
+ "1188": "910",
1201
+ "1189": "911",
1202
+ "1190": "912",
1203
+ "1191": "913",
1204
+ "1192": "914",
1205
+ "1193": "915",
1206
+ "1194": "916",
1207
+ "1195": "917",
1208
+ "1196": "918",
1209
+ "1197": "92",
1210
+ "1198": "921",
1211
+ "1199": "922",
1212
+ "1200": "923",
1213
+ "1201": "924",
1214
+ "1202": "925",
1215
+ "1203": "926",
1216
+ "1204": "927",
1217
+ "1205": "928",
1218
+ "1206": "929",
1219
+ "1207": "930",
1220
+ "1208": "931",
1221
+ "1209": "932",
1222
+ "1210": "933",
1223
+ "1211": "934",
1224
+ "1212": "935",
1225
+ "1213": "936",
1226
+ "1214": "937",
1227
+ "1215": "938",
1228
+ "1216": "939",
1229
+ "1217": "940",
1230
+ "1218": "941",
1231
+ "1219": "942",
1232
+ "1220": "943",
1233
+ "1221": "944",
1234
+ "1222": "945",
1235
+ "1223": "946",
1236
+ "1224": "947",
1237
+ "1225": "948",
1238
+ "1226": "949",
1239
+ "1227": "950",
1240
+ "1228": "951",
1241
+ "1229": "952",
1242
+ "1230": "953",
1243
+ "1231": "954",
1244
+ "1232": "955",
1245
+ "1233": "956",
1246
+ "1234": "957",
1247
+ "1235": "958",
1248
+ "1236": "959",
1249
+ "1237": "960",
1250
+ "1238": "961",
1251
+ "1239": "962",
1252
+ "1240": "963",
1253
+ "1241": "964",
1254
+ "1242": "965",
1255
+ "1243": "966",
1256
+ "1244": "967",
1257
+ "1245": "968",
1258
+ "1246": "969",
1259
+ "1247": "97",
1260
+ "1248": "970",
1261
+ "1249": "971",
1262
+ "1250": "972",
1263
+ "1251": "973",
1264
+ "1252": "974",
1265
+ "1253": "975",
1266
+ "1254": "976",
1267
+ "1255": "977",
1268
+ "1256": "978",
1269
+ "1257": "979",
1270
+ "1258": "980",
1271
+ "1259": "981",
1272
+ "1260": "982",
1273
+ "1261": "983",
1274
+ "1262": "984",
1275
+ "1263": "985",
1276
+ "1264": "986",
1277
+ "1265": "989",
1278
+ "1266": "99",
1279
+ "1267": "990",
1280
+ "1268": "991",
1281
+ "1269": "992",
1282
+ "1270": "993",
1283
+ "1271": "994",
1284
+ "1272": "995",
1285
+ "1273": "996",
1286
+ "1274": "997",
1287
+ "1275": "998",
1288
+ "1276": "999"
1289
+ },
1290
+ "initializer_range": 0.02,
1291
+ "intermediate_size": 3072,
1292
+ "label2id": {
1293
+ "1": 0,
1294
+ "10": 1,
1295
+ "100": 2,
1296
+ "1003": 3,
1297
+ "1004": 4,
1298
+ "1005": 5,
1299
+ "1006": 6,
1300
+ "1007": 7,
1301
+ "1008": 8,
1302
+ "1009": 9,
1303
+ "101": 10,
1304
+ "1010": 11,
1305
+ "1011": 12,
1306
+ "1012": 13,
1307
+ "1013": 14,
1308
+ "1014": 15,
1309
+ "1017": 16,
1310
+ "1018": 17,
1311
+ "1019": 18,
1312
+ "102": 19,
1313
+ "1020": 20,
1314
+ "1021": 21,
1315
+ "1022": 22,
1316
+ "1023": 23,
1317
+ "103": 24,
1318
+ "1034": 25,
1319
+ "1035": 26,
1320
+ "104": 27,
1321
+ "1040": 28,
1322
+ "1043": 29,
1323
+ "1046": 30,
1324
+ "1047": 31,
1325
+ "1048": 32,
1326
+ "105": 33,
1327
+ "1050": 34,
1328
+ "1051": 35,
1329
+ "1052": 36,
1330
+ "1053": 37,
1331
+ "1054": 38,
1332
+ "1055": 39,
1333
+ "1056": 40,
1334
+ "1058": 41,
1335
+ "1059": 42,
1336
+ "1060": 43,
1337
+ "1062": 44,
1338
+ "107": 45,
1339
+ "1071": 46,
1340
+ "1073": 47,
1341
+ "108": 48,
1342
+ "1084": 49,
1343
+ "1086": 50,
1344
+ "1097": 51,
1345
+ "1099": 52,
1346
+ "11": 53,
1347
+ "110": 54,
1348
+ "1100": 55,
1349
+ "1106": 56,
1350
+ "1147": 57,
1351
+ "1148": 58,
1352
+ "1149": 59,
1353
+ "1150": 60,
1354
+ "1151": 61,
1355
+ "1152": 62,
1356
+ "1154": 63,
1357
+ "1156": 64,
1358
+ "1157": 65,
1359
+ "1158": 66,
1360
+ "1160": 67,
1361
+ "1161": 68,
1362
+ "1162": 69,
1363
+ "1166": 70,
1364
+ "1167": 71,
1365
+ "1169": 72,
1366
+ "1170": 73,
1367
+ "1171": 74,
1368
+ "1172": 75,
1369
+ "1173": 76,
1370
+ "1174": 77,
1371
+ "1175": 78,
1372
+ "1177": 79,
1373
+ "1178": 80,
1374
+ "1179": 81,
1375
+ "118": 82,
1376
+ "1180": 83,
1377
+ "1181": 84,
1378
+ "1184": 85,
1379
+ "1185": 86,
1380
+ "1186": 87,
1381
+ "1187": 88,
1382
+ "1188": 89,
1383
+ "1189": 90,
1384
+ "119": 91,
1385
+ "1190": 92,
1386
+ "1191": 93,
1387
+ "1192": 94,
1388
+ "1193": 95,
1389
+ "1195": 96,
1390
+ "1196": 97,
1391
+ "1198": 98,
1392
+ "1199": 99,
1393
+ "12": 100,
1394
+ "120": 101,
1395
+ "1201": 102,
1396
+ "1202": 103,
1397
+ "1203": 104,
1398
+ "1204": 105,
1399
+ "1205": 106,
1400
+ "1206": 107,
1401
+ "1207": 108,
1402
+ "1208": 109,
1403
+ "121": 110,
1404
+ "1210": 111,
1405
+ "1211": 112,
1406
+ "1212": 113,
1407
+ "1213": 114,
1408
+ "1217": 115,
1409
+ "1218": 116,
1410
+ "122": 117,
1411
+ "1222": 118,
1412
+ "1223": 119,
1413
+ "1224": 120,
1414
+ "1225": 121,
1415
+ "1226": 122,
1416
+ "1229": 123,
1417
+ "123": 124,
1418
+ "1230": 125,
1419
+ "1231": 126,
1420
+ "1232": 127,
1421
+ "1233": 128,
1422
+ "1234": 129,
1423
+ "1235": 130,
1424
+ "1236": 131,
1425
+ "1238": 132,
1426
+ "1239": 133,
1427
+ "124": 134,
1428
+ "1240": 135,
1429
+ "1241": 136,
1430
+ "1242": 137,
1431
+ "1243": 138,
1432
+ "1244": 139,
1433
+ "1245": 140,
1434
+ "1246": 141,
1435
+ "1247": 142,
1436
+ "1248": 143,
1437
+ "1249": 144,
1438
+ "125": 145,
1439
+ "1250": 146,
1440
+ "1251": 147,
1441
+ "1252": 148,
1442
+ "1253": 149,
1443
+ "1256": 150,
1444
+ "1257": 151,
1445
+ "1258": 152,
1446
+ "1259": 153,
1447
+ "126": 154,
1448
+ "1260": 155,
1449
+ "1261": 156,
1450
+ "1262": 157,
1451
+ "1263": 158,
1452
+ "1264": 159,
1453
+ "1266": 160,
1454
+ "1267": 161,
1455
+ "1268": 162,
1456
+ "1269": 163,
1457
+ "127": 164,
1458
+ "1270": 165,
1459
+ "1271": 166,
1460
+ "1272": 167,
1461
+ "1273": 168,
1462
+ "1274": 169,
1463
+ "1275": 170,
1464
+ "1276": 171,
1465
+ "1277": 172,
1466
+ "1278": 173,
1467
+ "1279": 174,
1468
+ "128": 175,
1469
+ "1280": 176,
1470
+ "1281": 177,
1471
+ "1282": 178,
1472
+ "1283": 179,
1473
+ "1284": 180,
1474
+ "1285": 181,
1475
+ "1287": 182,
1476
+ "1288": 183,
1477
+ "1289": 184,
1478
+ "1290": 185,
1479
+ "1291": 186,
1480
+ "1292": 187,
1481
+ "1293": 188,
1482
+ "1294": 189,
1483
+ "1295": 190,
1484
+ "1296": 191,
1485
+ "1297": 192,
1486
+ "1298": 193,
1487
+ "1299": 194,
1488
+ "13": 195,
1489
+ "1300": 196,
1490
+ "1301": 197,
1491
+ "1302": 198,
1492
+ "1303": 199,
1493
+ "1304": 200,
1494
+ "1305": 201,
1495
+ "1306": 202,
1496
+ "1307": 203,
1497
+ "1308": 204,
1498
+ "1309": 205,
1499
+ "1310": 206,
1500
+ "1311": 207,
1501
+ "1312": 208,
1502
+ "1313": 209,
1503
+ "1314": 210,
1504
+ "1315": 211,
1505
+ "1316": 212,
1506
+ "1317": 213,
1507
+ "1318": 214,
1508
+ "1319": 215,
1509
+ "1320": 216,
1510
+ "1321": 217,
1511
+ "1322": 218,
1512
+ "1323": 219,
1513
+ "1324": 220,
1514
+ "1325": 221,
1515
+ "1326": 222,
1516
+ "1327": 223,
1517
+ "1328": 224,
1518
+ "1329": 225,
1519
+ "133": 226,
1520
+ "1330": 227,
1521
+ "1331": 228,
1522
+ "1333": 229,
1523
+ "1334": 230,
1524
+ "1336": 231,
1525
+ "1340": 232,
1526
+ "1341": 233,
1527
+ "1342": 234,
1528
+ "1343": 235,
1529
+ "1346": 236,
1530
+ "135": 237,
1531
+ "1350": 238,
1532
+ "1351": 239,
1533
+ "1357": 240,
1534
+ "1359": 241,
1535
+ "136": 242,
1536
+ "1361": 243,
1537
+ "1362": 244,
1538
+ "1363": 245,
1539
+ "1364": 246,
1540
+ "1365": 247,
1541
+ "1367": 248,
1542
+ "1368": 249,
1543
+ "1369": 250,
1544
+ "137": 251,
1545
+ "1370": 252,
1546
+ "1371": 253,
1547
+ "1372": 254,
1548
+ "1373": 255,
1549
+ "1374": 256,
1550
+ "1376": 257,
1551
+ "1377": 258,
1552
+ "1378": 259,
1553
+ "1379": 260,
1554
+ "138": 261,
1555
+ "1380": 262,
1556
+ "1382": 263,
1557
+ "1383": 264,
1558
+ "1384": 265,
1559
+ "1385": 266,
1560
+ "1386": 267,
1561
+ "1387": 268,
1562
+ "1388": 269,
1563
+ "1389": 270,
1564
+ "139": 271,
1565
+ "1391": 272,
1566
+ "1396": 273,
1567
+ "1397": 274,
1568
+ "1398": 275,
1569
+ "1399": 276,
1570
+ "14": 277,
1571
+ "140": 278,
1572
+ "1400": 279,
1573
+ "1401": 280,
1574
+ "1402": 281,
1575
+ "1403": 282,
1576
+ "141": 283,
1577
+ "1413": 284,
1578
+ "1415": 285,
1579
+ "1416": 286,
1580
+ "1417": 287,
1581
+ "1419": 288,
1582
+ "142": 289,
1583
+ "1420": 290,
1584
+ "1421": 291,
1585
+ "1422": 292,
1586
+ "1423": 293,
1587
+ "1425": 294,
1588
+ "1426": 295,
1589
+ "1427": 296,
1590
+ "1428": 297,
1591
+ "1429": 298,
1592
+ "143": 299,
1593
+ "1430": 300,
1594
+ "1431": 301,
1595
+ "1432": 302,
1596
+ "1433": 303,
1597
+ "1438": 304,
1598
+ "1439": 305,
1599
+ "144": 306,
1600
+ "1441": 307,
1601
+ "1443": 308,
1602
+ "1444": 309,
1603
+ "1445": 310,
1604
+ "1446": 311,
1605
+ "1447": 312,
1606
+ "1448": 313,
1607
+ "1449": 314,
1608
+ "145": 315,
1609
+ "1450": 316,
1610
+ "1451": 317,
1611
+ "1452": 318,
1612
+ "1453": 319,
1613
+ "1454": 320,
1614
+ "1455": 321,
1615
+ "1456": 322,
1616
+ "1457": 323,
1617
+ "1458": 324,
1618
+ "1459": 325,
1619
+ "146": 326,
1620
+ "1460": 327,
1621
+ "1461": 328,
1622
+ "1462": 329,
1623
+ "1463": 330,
1624
+ "1464": 331,
1625
+ "1465": 332,
1626
+ "1466": 333,
1627
+ "1467": 334,
1628
+ "1468": 335,
1629
+ "1469": 336,
1630
+ "147": 337,
1631
+ "1470": 338,
1632
+ "1471": 339,
1633
+ "1473": 340,
1634
+ "1474": 341,
1635
+ "1475": 342,
1636
+ "1476": 343,
1637
+ "1477": 344,
1638
+ "1478": 345,
1639
+ "1479": 346,
1640
+ "1480": 347,
1641
+ "1481": 348,
1642
+ "1482": 349,
1643
+ "1483": 350,
1644
+ "1484": 351,
1645
+ "1485": 352,
1646
+ "1486": 353,
1647
+ "1487": 354,
1648
+ "1488": 355,
1649
+ "1489": 356,
1650
+ "1490": 357,
1651
+ "1491": 358,
1652
+ "1492": 359,
1653
+ "1493": 360,
1654
+ "1494": 361,
1655
+ "1495": 362,
1656
+ "1496": 363,
1657
+ "1497": 364,
1658
+ "1498": 365,
1659
+ "1499": 366,
1660
+ "15": 367,
1661
+ "1500": 368,
1662
+ "1501": 369,
1663
+ "1502": 370,
1664
+ "1507": 371,
1665
+ "1509": 372,
1666
+ "1510": 373,
1667
+ "1511": 374,
1668
+ "1512": 375,
1669
+ "1513": 376,
1670
+ "1514": 377,
1671
+ "1515": 378,
1672
+ "1516": 379,
1673
+ "1517": 380,
1674
+ "1518": 381,
1675
+ "1519": 382,
1676
+ "152": 383,
1677
+ "1520": 384,
1678
+ "1521": 385,
1679
+ "1522": 386,
1680
+ "1523": 387,
1681
+ "1524": 388,
1682
+ "1525": 389,
1683
+ "1526": 390,
1684
+ "1527": 391,
1685
+ "1528": 392,
1686
+ "1529": 393,
1687
+ "153": 394,
1688
+ "1530": 395,
1689
+ "1531": 396,
1690
+ "1532": 397,
1691
+ "1533": 398,
1692
+ "1534": 399,
1693
+ "1535": 400,
1694
+ "1536": 401,
1695
+ "1537": 402,
1696
+ "1538": 403,
1697
+ "1539": 404,
1698
+ "154": 405,
1699
+ "1540": 406,
1700
+ "1541": 407,
1701
+ "1542": 408,
1702
+ "1543": 409,
1703
+ "1544": 410,
1704
+ "1545": 411,
1705
+ "1546": 412,
1706
+ "1547": 413,
1707
+ "1548": 414,
1708
+ "1549": 415,
1709
+ "155": 416,
1710
+ "1550": 417,
1711
+ "1551": 418,
1712
+ "1552": 419,
1713
+ "1553": 420,
1714
+ "1554": 421,
1715
+ "1555": 422,
1716
+ "1556": 423,
1717
+ "1557": 424,
1718
+ "1558": 425,
1719
+ "1559": 426,
1720
+ "1560": 427,
1721
+ "1561": 428,
1722
+ "1562": 429,
1723
+ "1563": 430,
1724
+ "1564": 431,
1725
+ "1565": 432,
1726
+ "1566": 433,
1727
+ "1567": 434,
1728
+ "1568": 435,
1729
+ "1569": 436,
1730
+ "157": 437,
1731
+ "1570": 438,
1732
+ "1571": 439,
1733
+ "1572": 440,
1734
+ "1573": 441,
1735
+ "1574": 442,
1736
+ "1575": 443,
1737
+ "1576": 444,
1738
+ "1577": 445,
1739
+ "1578": 446,
1740
+ "1579": 447,
1741
+ "158": 448,
1742
+ "1580": 449,
1743
+ "1581": 450,
1744
+ "1582": 451,
1745
+ "1583": 452,
1746
+ "1584": 453,
1747
+ "1585": 454,
1748
+ "1586": 455,
1749
+ "159": 456,
1750
+ "160": 457,
1751
+ "162": 458,
1752
+ "163": 459,
1753
+ "164": 460,
1754
+ "165": 461,
1755
+ "166": 462,
1756
+ "167": 463,
1757
+ "168": 464,
1758
+ "169": 465,
1759
+ "17": 466,
1760
+ "170": 467,
1761
+ "171": 468,
1762
+ "172": 469,
1763
+ "173": 470,
1764
+ "174": 471,
1765
+ "175": 472,
1766
+ "177": 473,
1767
+ "178": 474,
1768
+ "179": 475,
1769
+ "18": 476,
1770
+ "180": 477,
1771
+ "181": 478,
1772
+ "182": 479,
1773
+ "19": 480,
1774
+ "192": 481,
1775
+ "193": 482,
1776
+ "194": 483,
1777
+ "195": 484,
1778
+ "197": 485,
1779
+ "199": 486,
1780
+ "20": 487,
1781
+ "200": 488,
1782
+ "202": 489,
1783
+ "203": 490,
1784
+ "204": 491,
1785
+ "205": 492,
1786
+ "206": 493,
1787
+ "207": 494,
1788
+ "208": 495,
1789
+ "209": 496,
1790
+ "210": 497,
1791
+ "211": 498,
1792
+ "212": 499,
1793
+ "213": 500,
1794
+ "214": 501,
1795
+ "215": 502,
1796
+ "216": 503,
1797
+ "217": 504,
1798
+ "218": 505,
1799
+ "219": 506,
1800
+ "22": 507,
1801
+ "220": 508,
1802
+ "221": 509,
1803
+ "222": 510,
1804
+ "223": 511,
1805
+ "224": 512,
1806
+ "225": 513,
1807
+ "226": 514,
1808
+ "227": 515,
1809
+ "229": 516,
1810
+ "23": 517,
1811
+ "230": 518,
1812
+ "231": 519,
1813
+ "232": 520,
1814
+ "233": 521,
1815
+ "234": 522,
1816
+ "236": 523,
1817
+ "237": 524,
1818
+ "238": 525,
1819
+ "239": 526,
1820
+ "24": 527,
1821
+ "240": 528,
1822
+ "241": 529,
1823
+ "242": 530,
1824
+ "243": 531,
1825
+ "244": 532,
1826
+ "245": 533,
1827
+ "246": 534,
1828
+ "247": 535,
1829
+ "248": 536,
1830
+ "249": 537,
1831
+ "25": 538,
1832
+ "250": 539,
1833
+ "251": 540,
1834
+ "252": 541,
1835
+ "253": 542,
1836
+ "254": 543,
1837
+ "255": 544,
1838
+ "256": 545,
1839
+ "257": 546,
1840
+ "259": 547,
1841
+ "26": 548,
1842
+ "260": 549,
1843
+ "261": 550,
1844
+ "262": 551,
1845
+ "27": 552,
1846
+ "28": 553,
1847
+ "288": 554,
1848
+ "289": 555,
1849
+ "29": 556,
1850
+ "290": 557,
1851
+ "291": 558,
1852
+ "292": 559,
1853
+ "293": 560,
1854
+ "294": 561,
1855
+ "295": 562,
1856
+ "296": 563,
1857
+ "297": 564,
1858
+ "298": 565,
1859
+ "30": 566,
1860
+ "300": 567,
1861
+ "301": 568,
1862
+ "302": 569,
1863
+ "303": 570,
1864
+ "304": 571,
1865
+ "306": 572,
1866
+ "307": 573,
1867
+ "308": 574,
1868
+ "309": 575,
1869
+ "31": 576,
1870
+ "310": 577,
1871
+ "311": 578,
1872
+ "312": 579,
1873
+ "313": 580,
1874
+ "315": 581,
1875
+ "317": 582,
1876
+ "318": 583,
1877
+ "319": 584,
1878
+ "32": 585,
1879
+ "320": 586,
1880
+ "321": 587,
1881
+ "322": 588,
1882
+ "323": 589,
1883
+ "324": 590,
1884
+ "325": 591,
1885
+ "326": 592,
1886
+ "327": 593,
1887
+ "328": 594,
1888
+ "329": 595,
1889
+ "33": 596,
1890
+ "330": 597,
1891
+ "331": 598,
1892
+ "332": 599,
1893
+ "333": 600,
1894
+ "334": 601,
1895
+ "335": 602,
1896
+ "336": 603,
1897
+ "337": 604,
1898
+ "338": 605,
1899
+ "339": 606,
1900
+ "34": 607,
1901
+ "340": 608,
1902
+ "341": 609,
1903
+ "342": 610,
1904
+ "343": 611,
1905
+ "344": 612,
1906
+ "345": 613,
1907
+ "349": 614,
1908
+ "35": 615,
1909
+ "350": 616,
1910
+ "351": 617,
1911
+ "352": 618,
1912
+ "353": 619,
1913
+ "354": 620,
1914
+ "355": 621,
1915
+ "356": 622,
1916
+ "358": 623,
1917
+ "359": 624,
1918
+ "36": 625,
1919
+ "361": 626,
1920
+ "362": 627,
1921
+ "363": 628,
1922
+ "364": 629,
1923
+ "365": 630,
1924
+ "366": 631,
1925
+ "367": 632,
1926
+ "368": 633,
1927
+ "369": 634,
1928
+ "37": 635,
1929
+ "370": 636,
1930
+ "371": 637,
1931
+ "372": 638,
1932
+ "373": 639,
1933
+ "374": 640,
1934
+ "375": 641,
1935
+ "376": 642,
1936
+ "377": 643,
1937
+ "378": 644,
1938
+ "379": 645,
1939
+ "38": 646,
1940
+ "380": 647,
1941
+ "381": 648,
1942
+ "382": 649,
1943
+ "383": 650,
1944
+ "384": 651,
1945
+ "385": 652,
1946
+ "386": 653,
1947
+ "387": 654,
1948
+ "388": 655,
1949
+ "389": 656,
1950
+ "39": 657,
1951
+ "390": 658,
1952
+ "391": 659,
1953
+ "392": 660,
1954
+ "393": 661,
1955
+ "394": 662,
1956
+ "395": 663,
1957
+ "396": 664,
1958
+ "397": 665,
1959
+ "398": 666,
1960
+ "399": 667,
1961
+ "4": 668,
1962
+ "40": 669,
1963
+ "400": 670,
1964
+ "401": 671,
1965
+ "402": 672,
1966
+ "403": 673,
1967
+ "404": 674,
1968
+ "405": 675,
1969
+ "406": 676,
1970
+ "407": 677,
1971
+ "409": 678,
1972
+ "41": 679,
1973
+ "411": 680,
1974
+ "412": 681,
1975
+ "414": 682,
1976
+ "415": 683,
1977
+ "416": 684,
1978
+ "418": 685,
1979
+ "419": 686,
1980
+ "42": 687,
1981
+ "420": 688,
1982
+ "421": 689,
1983
+ "422": 690,
1984
+ "423": 691,
1985
+ "424": 692,
1986
+ "425": 693,
1987
+ "426": 694,
1988
+ "427": 695,
1989
+ "429": 696,
1990
+ "43": 697,
1991
+ "430": 698,
1992
+ "431": 699,
1993
+ "432": 700,
1994
+ "433": 701,
1995
+ "434": 702,
1996
+ "435": 703,
1997
+ "436": 704,
1998
+ "437": 705,
1999
+ "438": 706,
2000
+ "439": 707,
2001
+ "44": 708,
2002
+ "440": 709,
2003
+ "441": 710,
2004
+ "442": 711,
2005
+ "443": 712,
2006
+ "444": 713,
2007
+ "445": 714,
2008
+ "446": 715,
2009
+ "447": 716,
2010
+ "448": 717,
2011
+ "449": 718,
2012
+ "45": 719,
2013
+ "450": 720,
2014
+ "451": 721,
2015
+ "452": 722,
2016
+ "453": 723,
2017
+ "454": 724,
2018
+ "455": 725,
2019
+ "456": 726,
2020
+ "457": 727,
2021
+ "458": 728,
2022
+ "459": 729,
2023
+ "46": 730,
2024
+ "460": 731,
2025
+ "461": 732,
2026
+ "462": 733,
2027
+ "463": 734,
2028
+ "464": 735,
2029
+ "465": 736,
2030
+ "466": 737,
2031
+ "467": 738,
2032
+ "468": 739,
2033
+ "469": 740,
2034
+ "47": 741,
2035
+ "470": 742,
2036
+ "471": 743,
2037
+ "472": 744,
2038
+ "473": 745,
2039
+ "474": 746,
2040
+ "475": 747,
2041
+ "476": 748,
2042
+ "477": 749,
2043
+ "478": 750,
2044
+ "479": 751,
2045
+ "480": 752,
2046
+ "481": 753,
2047
+ "482": 754,
2048
+ "483": 755,
2049
+ "484": 756,
2050
+ "485": 757,
2051
+ "486": 758,
2052
+ "487": 759,
2053
+ "488": 760,
2054
+ "489": 761,
2055
+ "49": 762,
2056
+ "490": 763,
2057
+ "491": 764,
2058
+ "492": 765,
2059
+ "493": 766,
2060
+ "494": 767,
2061
+ "495": 768,
2062
+ "496": 769,
2063
+ "497": 770,
2064
+ "499": 771,
2065
+ "5": 772,
2066
+ "50": 773,
2067
+ "500": 774,
2068
+ "501": 775,
2069
+ "502": 776,
2070
+ "503": 777,
2071
+ "504": 778,
2072
+ "505": 779,
2073
+ "506": 780,
2074
+ "507": 781,
2075
+ "508": 782,
2076
+ "509": 783,
2077
+ "51": 784,
2078
+ "510": 785,
2079
+ "511": 786,
2080
+ "512": 787,
2081
+ "513": 788,
2082
+ "514": 789,
2083
+ "515": 790,
2084
+ "516": 791,
2085
+ "517": 792,
2086
+ "518": 793,
2087
+ "519": 794,
2088
+ "52": 795,
2089
+ "520": 796,
2090
+ "521": 797,
2091
+ "522": 798,
2092
+ "523": 799,
2093
+ "524": 800,
2094
+ "525": 801,
2095
+ "526": 802,
2096
+ "527": 803,
2097
+ "528": 804,
2098
+ "529": 805,
2099
+ "53": 806,
2100
+ "530": 807,
2101
+ "531": 808,
2102
+ "532": 809,
2103
+ "533": 810,
2104
+ "534": 811,
2105
+ "535": 812,
2106
+ "536": 813,
2107
+ "537": 814,
2108
+ "538": 815,
2109
+ "539": 816,
2110
+ "54": 817,
2111
+ "540": 818,
2112
+ "541": 819,
2113
+ "542": 820,
2114
+ "543": 821,
2115
+ "544": 822,
2116
+ "546": 823,
2117
+ "547": 824,
2118
+ "548": 825,
2119
+ "549": 826,
2120
+ "55": 827,
2121
+ "550": 828,
2122
+ "551": 829,
2123
+ "552": 830,
2124
+ "553": 831,
2125
+ "554": 832,
2126
+ "555": 833,
2127
+ "556": 834,
2128
+ "557": 835,
2129
+ "558": 836,
2130
+ "559": 837,
2131
+ "56": 838,
2132
+ "560": 839,
2133
+ "561": 840,
2134
+ "562": 841,
2135
+ "563": 842,
2136
+ "564": 843,
2137
+ "565": 844,
2138
+ "566": 845,
2139
+ "567": 846,
2140
+ "568": 847,
2141
+ "569": 848,
2142
+ "57": 849,
2143
+ "570": 850,
2144
+ "571": 851,
2145
+ "572": 852,
2146
+ "573": 853,
2147
+ "574": 854,
2148
+ "575": 855,
2149
+ "576": 856,
2150
+ "577": 857,
2151
+ "578": 858,
2152
+ "579": 859,
2153
+ "580": 860,
2154
+ "581": 861,
2155
+ "582": 862,
2156
+ "583": 863,
2157
+ "584": 864,
2158
+ "585": 865,
2159
+ "586": 866,
2160
+ "587": 867,
2161
+ "588": 868,
2162
+ "589": 869,
2163
+ "591": 870,
2164
+ "593": 871,
2165
+ "594": 872,
2166
+ "595": 873,
2167
+ "597": 874,
2168
+ "598": 875,
2169
+ "599": 876,
2170
+ "6": 877,
2171
+ "600": 878,
2172
+ "601": 879,
2173
+ "602": 880,
2174
+ "603": 881,
2175
+ "604": 882,
2176
+ "605": 883,
2177
+ "606": 884,
2178
+ "607": 885,
2179
+ "608": 886,
2180
+ "609": 887,
2181
+ "610": 888,
2182
+ "611": 889,
2183
+ "612": 890,
2184
+ "613": 891,
2185
+ "614": 892,
2186
+ "615": 893,
2187
+ "616": 894,
2188
+ "618": 895,
2189
+ "619": 896,
2190
+ "620": 897,
2191
+ "621": 898,
2192
+ "622": 899,
2193
+ "623": 900,
2194
+ "624": 901,
2195
+ "625": 902,
2196
+ "626": 903,
2197
+ "627": 904,
2198
+ "628": 905,
2199
+ "629": 906,
2200
+ "630": 907,
2201
+ "631": 908,
2202
+ "632": 909,
2203
+ "633": 910,
2204
+ "634": 911,
2205
+ "635": 912,
2206
+ "636": 913,
2207
+ "637": 914,
2208
+ "638": 915,
2209
+ "64": 916,
2210
+ "640": 917,
2211
+ "641": 918,
2212
+ "643": 919,
2213
+ "645": 920,
2214
+ "646": 921,
2215
+ "647": 922,
2216
+ "648": 923,
2217
+ "649": 924,
2218
+ "65": 925,
2219
+ "650": 926,
2220
+ "651": 927,
2221
+ "652": 928,
2222
+ "653": 929,
2223
+ "654": 930,
2224
+ "655": 931,
2225
+ "656": 932,
2226
+ "657": 933,
2227
+ "658": 934,
2228
+ "659": 935,
2229
+ "660": 936,
2230
+ "661": 937,
2231
+ "662": 938,
2232
+ "663": 939,
2233
+ "664": 940,
2234
+ "665": 941,
2235
+ "666": 942,
2236
+ "667": 943,
2237
+ "668": 944,
2238
+ "669": 945,
2239
+ "67": 946,
2240
+ "670": 947,
2241
+ "671": 948,
2242
+ "672": 949,
2243
+ "673": 950,
2244
+ "675": 951,
2245
+ "676": 952,
2246
+ "677": 953,
2247
+ "679": 954,
2248
+ "680": 955,
2249
+ "681": 956,
2250
+ "682": 957,
2251
+ "683": 958,
2252
+ "684": 959,
2253
+ "685": 960,
2254
+ "686": 961,
2255
+ "687": 962,
2256
+ "688": 963,
2257
+ "689": 964,
2258
+ "69": 965,
2259
+ "690": 966,
2260
+ "691": 967,
2261
+ "692": 968,
2262
+ "694": 969,
2263
+ "695": 970,
2264
+ "696": 971,
2265
+ "697": 972,
2266
+ "698": 973,
2267
+ "699": 974,
2268
+ "7": 975,
2269
+ "70": 976,
2270
+ "700": 977,
2271
+ "701": 978,
2272
+ "702": 979,
2273
+ "703": 980,
2274
+ "704": 981,
2275
+ "705": 982,
2276
+ "706": 983,
2277
+ "707": 984,
2278
+ "708": 985,
2279
+ "709": 986,
2280
+ "71": 987,
2281
+ "710": 988,
2282
+ "711": 989,
2283
+ "712": 990,
2284
+ "713": 991,
2285
+ "714": 992,
2286
+ "72": 993,
2287
+ "721": 994,
2288
+ "722": 995,
2289
+ "723": 996,
2290
+ "724": 997,
2291
+ "725": 998,
2292
+ "726": 999,
2293
+ "727": 1000,
2294
+ "728": 1001,
2295
+ "729": 1002,
2296
+ "73": 1003,
2297
+ "730": 1004,
2298
+ "731": 1005,
2299
+ "732": 1006,
2300
+ "733": 1007,
2301
+ "734": 1008,
2302
+ "735": 1009,
2303
+ "736": 1010,
2304
+ "737": 1011,
2305
+ "738": 1012,
2306
+ "739": 1013,
2307
+ "740": 1014,
2308
+ "741": 1015,
2309
+ "742": 1016,
2310
+ "743": 1017,
2311
+ "744": 1018,
2312
+ "745": 1019,
2313
+ "746": 1020,
2314
+ "747": 1021,
2315
+ "748": 1022,
2316
+ "749": 1023,
2317
+ "75": 1024,
2318
+ "750": 1025,
2319
+ "752": 1026,
2320
+ "753": 1027,
2321
+ "754": 1028,
2322
+ "755": 1029,
2323
+ "756": 1030,
2324
+ "757": 1031,
2325
+ "758": 1032,
2326
+ "759": 1033,
2327
+ "76": 1034,
2328
+ "760": 1035,
2329
+ "761": 1036,
2330
+ "762": 1037,
2331
+ "763": 1038,
2332
+ "764": 1039,
2333
+ "765": 1040,
2334
+ "766": 1041,
2335
+ "767": 1042,
2336
+ "768": 1043,
2337
+ "769": 1044,
2338
+ "77": 1045,
2339
+ "770": 1046,
2340
+ "772": 1047,
2341
+ "773": 1048,
2342
+ "774": 1049,
2343
+ "775": 1050,
2344
+ "776": 1051,
2345
+ "777": 1052,
2346
+ "778": 1053,
2347
+ "779": 1054,
2348
+ "78": 1055,
2349
+ "780": 1056,
2350
+ "781": 1057,
2351
+ "782": 1058,
2352
+ "783": 1059,
2353
+ "784": 1060,
2354
+ "785": 1061,
2355
+ "786": 1062,
2356
+ "787": 1063,
2357
+ "788": 1064,
2358
+ "789": 1065,
2359
+ "79": 1066,
2360
+ "790": 1067,
2361
+ "791": 1068,
2362
+ "792": 1069,
2363
+ "793": 1070,
2364
+ "794": 1071,
2365
+ "795": 1072,
2366
+ "796": 1073,
2367
+ "797": 1074,
2368
+ "798": 1075,
2369
+ "8": 1076,
2370
+ "80": 1077,
2371
+ "800": 1078,
2372
+ "801": 1079,
2373
+ "802": 1080,
2374
+ "803": 1081,
2375
+ "804": 1082,
2376
+ "805": 1083,
2377
+ "806": 1084,
2378
+ "807": 1085,
2379
+ "808": 1086,
2380
+ "809": 1087,
2381
+ "81": 1088,
2382
+ "810": 1089,
2383
+ "811": 1090,
2384
+ "812": 1091,
2385
+ "813": 1092,
2386
+ "814": 1093,
2387
+ "815": 1094,
2388
+ "816": 1095,
2389
+ "817": 1096,
2390
+ "818": 1097,
2391
+ "819": 1098,
2392
+ "82": 1099,
2393
+ "820": 1100,
2394
+ "821": 1101,
2395
+ "822": 1102,
2396
+ "824": 1103,
2397
+ "825": 1104,
2398
+ "826": 1105,
2399
+ "827": 1106,
2400
+ "828": 1107,
2401
+ "829": 1108,
2402
+ "83": 1109,
2403
+ "830": 1110,
2404
+ "831": 1111,
2405
+ "832": 1112,
2406
+ "833": 1113,
2407
+ "834": 1114,
2408
+ "835": 1115,
2409
+ "836": 1116,
2410
+ "837": 1117,
2411
+ "838": 1118,
2412
+ "839": 1119,
2413
+ "84": 1120,
2414
+ "840": 1121,
2415
+ "841": 1122,
2416
+ "842": 1123,
2417
+ "843": 1124,
2418
+ "844": 1125,
2419
+ "845": 1126,
2420
+ "846": 1127,
2421
+ "847": 1128,
2422
+ "848": 1129,
2423
+ "849": 1130,
2424
+ "85": 1131,
2425
+ "850": 1132,
2426
+ "851": 1133,
2427
+ "852": 1134,
2428
+ "853": 1135,
2429
+ "854": 1136,
2430
+ "855": 1137,
2431
+ "856": 1138,
2432
+ "857": 1139,
2433
+ "858": 1140,
2434
+ "859": 1141,
2435
+ "86": 1142,
2436
+ "863": 1143,
2437
+ "864": 1144,
2438
+ "865": 1145,
2439
+ "866": 1146,
2440
+ "868": 1147,
2441
+ "87": 1148,
2442
+ "870": 1149,
2443
+ "871": 1150,
2444
+ "872": 1151,
2445
+ "873": 1152,
2446
+ "874": 1153,
2447
+ "875": 1154,
2448
+ "876": 1155,
2449
+ "877": 1156,
2450
+ "878": 1157,
2451
+ "879": 1158,
2452
+ "88": 1159,
2453
+ "880": 1160,
2454
+ "881": 1161,
2455
+ "882": 1162,
2456
+ "883": 1163,
2457
+ "884": 1164,
2458
+ "885": 1165,
2459
+ "886": 1166,
2460
+ "887": 1167,
2461
+ "888": 1168,
2462
+ "889": 1169,
2463
+ "89": 1170,
2464
+ "890": 1171,
2465
+ "891": 1172,
2466
+ "892": 1173,
2467
+ "893": 1174,
2468
+ "894": 1175,
2469
+ "895": 1176,
2470
+ "896": 1177,
2471
+ "897": 1178,
2472
+ "898": 1179,
2473
+ "899": 1180,
2474
+ "9": 1181,
2475
+ "90": 1182,
2476
+ "900": 1183,
2477
+ "901": 1184,
2478
+ "903": 1185,
2479
+ "906": 1186,
2480
+ "909": 1187,
2481
+ "910": 1188,
2482
+ "911": 1189,
2483
+ "912": 1190,
2484
+ "913": 1191,
2485
+ "914": 1192,
2486
+ "915": 1193,
2487
+ "916": 1194,
2488
+ "917": 1195,
2489
+ "918": 1196,
2490
+ "92": 1197,
2491
+ "921": 1198,
2492
+ "922": 1199,
2493
+ "923": 1200,
2494
+ "924": 1201,
2495
+ "925": 1202,
2496
+ "926": 1203,
2497
+ "927": 1204,
2498
+ "928": 1205,
2499
+ "929": 1206,
2500
+ "930": 1207,
2501
+ "931": 1208,
2502
+ "932": 1209,
2503
+ "933": 1210,
2504
+ "934": 1211,
2505
+ "935": 1212,
2506
+ "936": 1213,
2507
+ "937": 1214,
2508
+ "938": 1215,
2509
+ "939": 1216,
2510
+ "940": 1217,
2511
+ "941": 1218,
2512
+ "942": 1219,
2513
+ "943": 1220,
2514
+ "944": 1221,
2515
+ "945": 1222,
2516
+ "946": 1223,
2517
+ "947": 1224,
2518
+ "948": 1225,
2519
+ "949": 1226,
2520
+ "950": 1227,
2521
+ "951": 1228,
2522
+ "952": 1229,
2523
+ "953": 1230,
2524
+ "954": 1231,
2525
+ "955": 1232,
2526
+ "956": 1233,
2527
+ "957": 1234,
2528
+ "958": 1235,
2529
+ "959": 1236,
2530
+ "960": 1237,
2531
+ "961": 1238,
2532
+ "962": 1239,
2533
+ "963": 1240,
2534
+ "964": 1241,
2535
+ "965": 1242,
2536
+ "966": 1243,
2537
+ "967": 1244,
2538
+ "968": 1245,
2539
+ "969": 1246,
2540
+ "97": 1247,
2541
+ "970": 1248,
2542
+ "971": 1249,
2543
+ "972": 1250,
2544
+ "973": 1251,
2545
+ "974": 1252,
2546
+ "975": 1253,
2547
+ "976": 1254,
2548
+ "977": 1255,
2549
+ "978": 1256,
2550
+ "979": 1257,
2551
+ "980": 1258,
2552
+ "981": 1259,
2553
+ "982": 1260,
2554
+ "983": 1261,
2555
+ "984": 1262,
2556
+ "985": 1263,
2557
+ "986": 1264,
2558
+ "989": 1265,
2559
+ "99": 1266,
2560
+ "990": 1267,
2561
+ "991": 1268,
2562
+ "992": 1269,
2563
+ "993": 1270,
2564
+ "994": 1271,
2565
+ "995": 1272,
2566
+ "996": 1273,
2567
+ "997": 1274,
2568
+ "998": 1275,
2569
+ "999": 1276
2570
+ },
2571
+ "layer_norm_eps": 1e-12,
2572
+ "max_position_embeddings": 512,
2573
+ "model_type": "bert",
2574
+ "num_attention_heads": 12,
2575
+ "num_hidden_layers": 12,
2576
+ "pad_token_id": 0,
2577
+ "position_embedding_type": "absolute",
2578
+ "problem_type": "multi_label_classification",
2579
+ "torch_dtype": "float32",
2580
+ "transformers_version": "4.55.0",
2581
+ "type_vocab_size": 2,
2582
+ "use_cache": true,
2583
+ "vocab_size": 30522
2584
+ }
checkpoint-61830/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82a1a41998e156d6e0823a2f9d6c4f566f41549a7321c1167ae218c8a066edc6
3
+ size 441880548
checkpoint-61830/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d2ef3456e445e9f88f34c807530f653ec101357175ff8660cff88caeb614825
3
+ size 883885323
checkpoint-61830/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a4c6c4065edc7d67b3c594fe1881bf925563cdb72615f4c6f4ae0a2a6b20651
3
+ size 14645
checkpoint-61830/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bec10a8157012c7371aea97e7590995aadf2542cd36b3d8031f3ab5503911d3
3
+ size 1465
checkpoint-61830/special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }