01_ai_Yi_9B.md

Report for 01-ai/Yi-9B

Model info

• Model Info:
  • Tied embeddings: False
  • LM head uses bias: False
  • Embeddings shape: [64000, 4096]
• Tokenizer Info:
  • Vocab Size: 64000
  • Tokenizer Class: LlamaTokenizer
  • Tokenizer Type: BPE
  • Bytes handling: Byte Fallback
  • Token for verification prompt building: Acknowledgements
  • Token id for verification prompt building: 35477
• Indicator summary:
  • Indicator for under-trained tokens: E_{in} L2 Norm
  • Overall distribution: 0.883 +/- 0.121
• Detected Token Counts:
  • Number of tested under-trained tokens: 1274, 1266 non-special, 80 below p = 0.01 threshold, 12 below soft indicator threshold
  • Number of single byte tokens: 354, of which 112 below indicator threshold
  • Number of special tokens: 4, of which 3 below indicator threshold
  • Number of non-single-byte unreachable tokens: 4, of which 3 below indicator threshold

Under-trained token indicators plot

Verification plot

Under-trained token verification results

12 entries below threshold of 0.084

token_id	token	indicator	max_prob	in_other_tokens
58458	\\+::\\+	2.12047e-06	1.1e-05
38185	\\+\\_\\+\\+	2.13416e-06	1.1e-05
26510	\\+\\_\\+	2.15176e-06	1.1e-05	\\+\\_\\+\\+
32010	mabaochang	0.0150465	3.4e-07
31174	\\+::	0.01923	7.1e-06	\\+::\\+
52345	nzoem	0.0197519	1.1e-05
19111	\\+\\_\\	0.0228803	7.7e-06	\\+\\_\\+, \\+\\_\\+\\+
58973	Разпространение	0.0252404	5.9e-06
41270	mcited	0.0484112	0.00014	mcitedefault
14378	":"\ufeff	0.0673838	6e-05
19290	мври	0.0782237	0.049	птември, ктомври, ▁септември, ▁октомври, кември, ...
53246	mrrooter	0.0833254	0.00014

1254 additional entries above threshold

token_id	token	indicator	max_prob	in_other_tokens
52955	Родени	0.0841834	7.1e-05
18479	+\\_\\	0.0883692	0.018	\\+\\_\\, \\+\\_\\+, \\+\\_\\+\\+
58052	евру	0.0918016	4.6e-05	евруари
44047	mrroot	0.098026	0.36	mrrooter
20714	Източници	0.100705	0.015
53979	▁$\\|\\	0.10288	0.17
55040	_{(\\	0.103435	0.013
45501	}$\\\\\	0.103759	0.00025
27852	▁препратки	0.105868	0.00085
47419	[]{\\	0.106254	0.001
1062	vepfs	0.10854	0.2
47647	nConsequently	0.111215	4.4e-05
44270	^*(\\	0.114977	0.038
47523	Бележки	0.116821	0.37
54580	}--\\	0.11824	0.49
57778	}=(\\	0.119836	0.00075
11333	▁[…]\	0.123853	0.00024
46922	;\\;\\;\\;\\	0.125067	0.034
43942	▁селото	0.125853	0.068
27952	Външни	0.12765	0.0059
22613	▁$\\{\\	0.127785	0.014
59474	}}^\\	0.128831	0.0072
59159	)&=&\\	0.129638	0.0011
58699	nUltimately	0.130198	7.9e-05
27655	Вън	0.130646	0.31	Външни
50472	’”\	0.131916	0.075
57958	}&=&\\	0.131967	0.0053
53069	nquantum	0.132898	0.97
38169	}^{(\\	0.135213	0.068
37421	…”\	0.136747	0.011
48827	tvolatile	0.137151	0.22
31761	▁\\]\	0.140806	0.00077
55282	nResearchers	0.141879	0.073
45676	nWASHINGTON	0.142279	0.0049
50269	nRather	0.143648	0.0067
26341	nrespect	0.143697	0.93	nrespectively
58677	$\\%$	0.144106	0.17
37027	nClearly	0.144924	0.0023
54548	&$\\	0.146692	0.48
57541	nconsidered	0.146886	0.87
37655	nNevertheless	0.146927	0.0045
45337	nInterestingly	0.148264	0.00064
35932	)}_{\\	0.148761	0.0016
42242	nPersonally	0.148883	0.0011
46113	}=\\{	0.149417	0.77
32202	nrespectively	0.149461	0.036
47304	nSecondly	0.149779	0.011
39373	napproxim	0.150405	0.69
57483	napproach	0.15155	0.8
1095	redpajama	0.151617	0.69
54404	})^{\\	0.1522	0.00045
53931	nSimplify	0.152618	0.69
54413	nEventually	0.153803	0.00059
58456	})\\\\\	0.15394	0.00027
46451	\\|_{\\	0.155041	0.0064
52625	nmagnetic	0.156555	0.88
38615	▁$\\|	0.157244	0.38	▁$\\|\\
58452	▁&=&\\	0.157882	0.21
52323	}-{\\	0.157999	0.071
48085	)=-\\	0.158203	0.018
58364	}+{\\	0.15859	0.046
49889	nFortunately	0.159027	0.002
24417	~{\\	0.160436	0.12
45624	nRegardless	0.161305	0.022
53691	}}_\\	0.161756	0.0012
16963	}({\\	0.162402	0.0092
53580	nassociated	0.163596	0.96
50597	nparticular	0.165149	0.79
52211	nFirstly	0.16531	0.02
34224	|_{\\	0.166003	0.036	\\|_{\\
33785	nObviously	0.166631	0.00044
37488	▁$-\\	0.167454	0.057
34587	▁$[\\	0.16901	0.49
59512	)^{-\\	0.169045	0.0017
42668	nLastly	0.169704	0.00025
41844	nRegarding	0.170373	0.023
18027	nMoreover	0.170848	0.016
46457	nApparently	0.171027	0.03
50759	nGenerally	0.171432	0.046
49044	}^{-\\	0.172778	0.00089
37452	}=-\\	0.173362	0.1
36357	nThroughout	0.17433	0.00022
32078	$~\\	0.175035	0.92
46115	▁{$\\	0.175101	0.22
54430	\\%}	0.175979	0.0018
45474	]^{\\	0.176564	0.00018
53564	}={\\	0.176632	0.0017
55595	nhowever	0.177021	0.011
38853	nobtained	0.177651	0.6
52081	_{\\{	0.1799	0.27
15887	nSuppose	0.179978	0.078
31065	\\%)	0.180035	0.0047
57605	ntherefore	0.180146	0.075
55203	ninteraction	0.180539	0.99
50497	}{(\\	0.18077	0.0029
7956	~(\\	0.180977	0.93
31425	)_{\\	0.180989	0.013
45484	ncorrespond	0.181535	0.86
39074	<>();\	0.181856	0.015
58028	▁дъщер	0.182811	0.06
20408	\\|_{	0.183618	0.065	\\|_{\\
30058	\\}_{	0.184136	0.0062
52422	nDepending	0.184361	0.048
39987	nBasically	0.184964	0.0048
5340	RedPajama	0.185179	0.81
28072	)}(\\	0.185433	0.00037
28357	nBesides	0.185539	0.024
34141	nFIG	0.185709	0.74
47468	nTheorem	0.185958	0.99
59391	=&\\	0.188063	0.88
40586	nConsidering	0.1881	0.0095
44562	nWhatever	0.190772	0.31
34729	ncorresponding	0.190779	0.39
57030	nCompared	0.19145	0.92
22056	^{(\\	0.1917	0.09	}^{(\\
42298	nSpecifically	0.193027	0.016
39792	}{$\\	0.193035	0.082
56651	nABOUT	0.193216	0.86
21953	$\\\\\	0.193353	0.96	}$\\\\\
51317	nAside	0.193948	0.71
20132	nFurthermore	0.194074	0.0056
29938	▁🙂\	0.195477	0.92
55560	}<\\	0.196517	0.82
51711	":"（	0.197144	0.35
57326	nJosh	0.197462	0.8
56126	":"「	0.197763	0.0029
47809	nSeriously	0.197848	0.12
53537	▁албу	0.201191	0.29
26261	nSimilarly	0.202416	0.0021
31370	nUnlike	0.20243	0.15
59020	":"/*\	0.203803	0.00012
39340	}_{{\\	0.204256	0.076
48251	nmuch	0.204706	0.99
45065	ръц	0.204754	0.002
35723	nAssume	0.205112	0.89
29999	noperator	0.205345	1
46806	}{*}{\\	0.205551	0.0012
25545	nIndeed	0.205744	0.57
55725	nUsually	0.205759	0.15
52500	▁крал	0.206473	0.99
40469	+{\\	0.20681	0.53	}+{\\
53558	`);\	0.207134	0.011
54185	▁$%\	0.207484	0.97
19196	nMeanwhile	0.208088	0.41
24855	)~\\	0.208395	0.87
29930	$^{\\	0.208757	0.53
56199	nHopefully	0.209773	0.001
50124	\\/}	0.210085	0.68
59440	nperform	0.210099	0.98
17049	nOriginally	0.210586	0.56
31277	nEarlier	0.211202	0.62
19119	nHence	0.21134	0.042
43150	nincluding	0.211351	0.28
38233	）；\	0.212206	0.15
32247	comtag	0.212243	1
15298	▁$|\\	0.212468	0.29
15246	~$\\	0.212865	0.48
59473	nGreg	0.213339	0.93
34443	nargument	0.214896	0.99
56542	nagainst	0.215025	0.08
55471	nBTW	0.215208	0.72
42806	nImagine	0.215323	0.88
53694	nshows	0.215515	0.97
48357	nJesus	0.215526	0.8
53725	naccording	0.216287	0.022
47787	nKevin	0.216915	0.73
37742	-{\\	0.217278	0.71	}-{\\
32472	▁^{\\	0.218109	0.06
20000	точници	0.218344	0.0033	Източници
59016	/{\\	0.219311	0.98
47529	ncondition	0.219362	1	nconditions, ▁unconditional
24349	……”\	0.219637	0.0025
53603	ninline	0.219754	1
41157	)\\}$	0.219934	0.00034
17853	&=&\\	0.220382	0.66	}&=&\\, ▁&=&\\, )&=&\\
36883	nMuch	0.220658	0.95
53089	]\\\\\	0.221224	0.45
48798	})}{\\	0.221374	0.0039
52258	nWhenever	0.221745	0.003
17264	;\\;\\	0.222376	0.21	;\\;\\;\\;\\
42967	nconsider	0.223093	0.97	nconsidered
49862	nBeyond	0.223167	0.99
16003	nDespite	0.223469	0.067
3322	starcoder	0.223536	1
26116	nSpeaking	0.223624	0.78
19100	▁({\\	0.224575	0.32
46693	нския	0.225156	0.16
49800	▁януари	0.225244	0.24
29959	nAnyone	0.225713	0.21
54642	nWHAT	0.226612	0.0084
41130	nbeing	0.226809	0.96
51440	кември	0.227832	0.00046	▁декември
58600	nFederal	0.227934	0.99
45475	nConse	0.228259	0.99	nConsequently
49512	ктомври	0.228618	4.3e-05	▁октомври
54160	ември	0.228805	0.042	▁ноември
57742	nSounds	0.230132	1
50268	nshown	0.230599	0.89
47530	tprotected	0.230984	0.99
37563	nRated	0.231077	0.89
59044	nSpons	0.231132	0.96
58597	▁смърт	0.23127	0.59
19773	nAnyway	0.231966	0.67
55541	▁ноември	0.233066	0.99
42431	nOffic	0.233316	0.99
58601	nMatthew	0.233961	0.046
41314	ясто	0.234553	0.59	▁място
52603	▁декември	0.234562	0.64
26711	_{-\\	0.234693	0.042
54325	nProfessional	0.234826	0.99
52041	nJason	0.234844	0.94
44451	късно	0.236105	0.058
45402	▁цър	0.236727	0.013
37486	|{\\	0.237321	0.76
50969	nconstant	0.23738	0.95
47001	ninteg	0.237614	1	nintegral
42577	nUnless	0.237714	0.73
46456	▁Македония	0.238461	0.99
23073	nSometimes	0.238633	0.046
40798	nObama	0.238644	0.99
46662	▁\");\	0.23892	0.04
50055	nobserved	0.239238	0.95
41221	nrepresent	0.239451	0.97
57473	▁\";\	0.240189	0.012
31801	-$\\	0.240532	0.15
46485	{-\\	0.24067	0.89	}^{-\\, )^{-\\
36908	nUntil	0.240906	0.87
29537	nActually	0.240957	0.94
54107	ческата	0.240959	0.04
58620	Irefn	0.241149	0.68
48724	nSimply	0.241832	0.091
22918	nRecently	0.242225	0.64
54906	nGovernment	0.243905	0.78
28940	nAdditionally	0.244655	0.058
44496	nassoc	0.245394	1	nassociated
32602	\\\"{	0.24569	1
38943	nConclusion	0.246126	0.82
58248	nQuestions	0.246217	0.98
24673	nAmong	0.246603	0.3
41470	nINS	0.246823	1	nINSERT
50234	▁септември	0.247	0.77
54373	nPrivacy	0.247017	1
58870	nBeautiful	0.247068	0.9
51683	nconditions	0.24708	1
56486	ntransition	0.247582	1
52882	ncontin	0.247851	1
56278	nSarah	0.248038	0.38
28537	\")]\	0.248402	0.015
41755	nwithin	0.24869	0.99
29248	;\\;	0.24889	0.88	;\\;\\;\\;\\
59347	nstandard	0.249632	0.99
20664	nThough	0.249741	0.027
24187	nYet	0.250608	1
47299	Беле	0.250918	1	Бележки
40966	ърт	0.250956	0.87	▁смърт
48888	нуари	0.25243	0.016	▁януари
22527	nEDIT	0.252485	0.064
44797	nMrs	0.252982	0.98
22166	$_{\\	0.25353	0.42
53624	nTony	0.253631	0.84
13479	nFurther	0.253746	0.56	nFurthermore
58641	>(\"	0.254019	0.98
50865	▁октомври	0.254376	0.71
23782	=-\\	0.254407	1	}=-\\, )=-\\
53868	nModern	0.254566	0.98
24045	nSuch	0.254853	0.33
11894	nThus	0.255051	0.2
45030	nAssuming	0.255179	0.00054
22816	}\\}$	0.256067	0.027
30474	nEveryone	0.256714	0.29
58359	nKim	0.256943	0.18
51019	▁април	0.256976	0.27
18607	nThose	0.257037	0.73
42620	nUPDATE	0.257246	0.83
45601	ndescribe	0.257435	0.9	ndescribed
57669	nBrad	0.257759	0.77
35636	nvery	0.258163	0.95
46618	птември	0.258241	0.0022	▁септември
59312	nintegral	0.25847	1
55108	}}{{\\	0.258654	0.8
46599	naround	0.25897	0.99	▁turnaround
54937	nequations	0.259206	0.99
27997	nbeen	0.259472	0.96
58094	nCharles	0.259478	0.76
57597	\"][\"	0.259702	0.27
30929	\\|_	0.260066	0.98	\\|_{\\
53981	nProfessor	0.260759	0.91
53516	nImportant	0.261059	0.92
45237	_\\_\\	0.261572	0.91
45598	nLocated	0.261905	0.65
52395	nAlternatively	0.261989	0.1
48005	^{{\\	0.262008	0.062
44077	nmany	0.262167	1
36896	}}\\\\\	0.262196	0.0093
40879	}}}{\\	0.262498	0.53
50836	nIsrael	0.263114	0.97
35713	$^\\	0.263514	0.96
52479	nSomeone	0.263687	0.18
50591	})-(\\	0.264018	0.012
54641	nEric	0.264308	0.98
38870	nEver	0.264615	0.98	nEverything
33405	|}{\\	0.264917	0.034
42494	нската	0.264958	0.25
50520	nCRE	0.265608	1	nCREATE
53093	nPhotos	0.266277	1
19747	MNBVC	0.266422	1
34137	nYesterday	0.266866	0.98
50025	}\")\	0.267485	0.066
48547	nmoment	0.267618	1
39525	nJon	0.268659	1
21250	nWhether	0.268858	0.083
27560	\\'{	0.269395	1
49638	▁юли	0.269529	1
56871	nprobability	0.269721	0.96
41463	}}-\\	0.269915	0.019
43370	▁община	0.270353	1
50970	nsolution	0.270764	1
52331	nRepublic	0.270913	0.84
36269	▁\\|\\	0.270935	0.6
37562	$_\\	0.271288	0.7
9525	▁$(\\	0.271536	0.77
56752	▁страната	0.271756	0.53
48600	nsimilar	0.272468	1
54444	nanalysis	0.272681	0.98
35279	nUnited	0.27277	0.89
58065	nStephen	0.27372	0.7
58189	nmeans	0.273831	0.88
28362	▁}{\\	0.273957	0.98
13096	nTherefore	0.273975	0.64
42789	nMeet	0.273996	0.99
23880	}}^{\\	0.274092	0.076
24465	nSeveral	0.274891	0.69
50641	\"])\	0.274963	0.019
40735	nthose	0.275133	1
43507	npotential	0.275162	1
50111	nFeatured	0.275486	0.78
38041	nSteve	0.275613	0.95
45514	▁САЩ	0.275649	0.62
53108	)\\;	0.276693	0.58
39169	nparameter	0.276957	1	nparameters
41285	ntypedef	0.276972	0.98
58463	nApplying	0.277348	0.11
58087	nRon	0.277943	1
54409	▁заедно	0.278078	0.45
49142	tthrow	0.278303	1
36082	nboth	0.278811	0.99
29382	\"`\	0.278899	0.76
24159	ържа	0.27934	0.0039	▁държа, държа
30013	nTaking	0.279795	0.91
57368	nRecommended	0.280065	0.79
29156	}\\;	0.280207	0.018
14565	}}(\\	0.280228	0.015
59115	▁ръко	0.280731	0.051
42921	nReally	0.280742	0.87
52825	nneed	0.280743	1
35271	nLater	0.280881	0.99
40509	][\"	0.280922	0.98	\"][\"
58421	nFeel	0.281036	0.97
49984	<<\"	0.281306	1
40268	nRichard	0.281927	0.72
46473	nprivate	0.282106	1
30110	']);\	0.282712	0.042
21548	}}_{\\	0.282895	0.0061
46292	вършва	0.283748	0.0092
46538	▁”\	0.283756	0.66
15157	nsudo	0.28382	0.98
28576	nsince	0.284743	0.98
50965	nAsked	0.285083	0.99
30454	()));\	0.285696	0.31
29504	nWow	0.285839	1
40683	):=\\	0.285889	0.51
12942	\\%$	0.286016	0.86	$\\%$
45840	▁\\\\[	0.286917	0.93
34889	npresent	0.287408	1
43673	nGeorge	0.287479	0.16
52279	nExperience	0.28778	0.28
33602	ntemperature	0.288004	1
58934	baichuan	0.288141	1
47440	nabove	0.288379	1
38873	ncharacter	0.288892	0.98
58363	nFred	0.289179	0.95
56997	▁империя	0.289338	1
48162	nBorn	0.290087	0.97
24467	nVery	0.290108	0.59
11425	":"“	0.290261	0.79
37788	nAlong	0.290765	0.63
59485	nOtherwise	0.291658	0.14
46285	@{\\	0.291665	0.88
27928	nDisclaimer	0.291669	0.53
39090	nwithout	0.291967	0.99
58334	▁();\	0.292757	0.5
54003	)}+\\	0.293572	0.54
43978	npossible	0.293583	1
31861	nextern	0.293938	0.99
26192	}{{\\	0.293952	0.62	}}{{\\
52363	nRyan	0.294271	0.99
37008	▁ѝ	0.294446	1
39644	nmost	0.294773	1
37412	nagain	0.294998	1	nagainst
58894	yuchi	0.295202	1
31256	nmeasure	0.29547	1
15369	)\\\\\	0.296013	0.16	})\\\\\
26502	▁\\}$	0.296034	0.62
33851	nWithin	0.296161	0.87
41649	▁започва	0.296437	0.18
46238	nstrong	0.29722	1
57229	nFri	0.297327	0.99
58989	nvia	0.297463	1
21430	nYeah	0.297676	0.31
43876	nEducation	0.297893	0.99
43924	nINSERT	0.298057	0.95
57422	nTue	0.298269	0.97
16588	nusername	0.298283	0.99
20769	nbetween	0.298425	0.99
47472	▁началото	0.298564	0.69
46513	nproblem	0.298681	1
4136	▁${\\	0.298752	0.77
39087	nStay	0.298945	1
47207	Биография	0.299042	1
25732	nobserv	0.299055	1	nobserved
52522	nHistor	0.299287	0.93
46973	nReviews	0.299337	1
54593	nInteresting	0.299719	1
53570	nSenior	0.301497	0.99
13037	_{{\\	0.301642	0.61	}_{{\\
43285	nAlmost	0.301791	0.18
14791	)^{\\	0.30182	0.093	})^{\\
20233	nUnfortunately	0.301944	0.21
9949	nAlthough	0.302176	0.014
47110	nduring	0.302232	0.99
42147	дът	0.302302	0.0069
59042	nIron	0.30246	0.97
37856	▁;)\	0.30247	0.99
20776	nQuote	0.302473	0.95
39805	\\;\\	0.302499	0.7	;\\;\\;\\;\\
58274	евруари	0.302621	0.0031
22815	&=\\	0.302763	0.89
25586	)^\\	0.303077	0.42
42572	▁ези	0.303893	0.42	▁език
47358	nHad	0.304239	1
58056	nGrant	0.304282	0.99
35935	npeople	0.304328	0.99
22093	nInstead	0.304355	0.041
38253	nPeter	0.304637	0.98
51654	nsystems	0.304702	1
54990	nMartin	0.304715	0.98
10591	▁$\\{	0.305167	0.94	▁$\\{\\
16919	>();\	0.305325	0.57	<>();\
47052	▁музика	0.305653	1
37927	nQuick	0.305788	0.83
44407	nQuality	0.307056	0.98
36288	nHope	0.307175	0.93	nHopefully
42528	nNice	0.30796	0.99
58264	$\\%	0.308738	1	$\\%$
46346	▁българ	0.308787	0.92
58417	)\\}	0.308836	0.93
55503	*\\*\\	0.309816	0.99
53998	*{\\	0.310594	1
25096	nbecause	0.31085	0.63
14703	){\\	0.311	0.86
35249	nJim	0.311262	0.83
39626	nExcellent	0.311424	1
33752	ncould	0.311432	0.99
53596	йския	0.311467	0.11
28214	nNotice	0.312034	0.88
53831	nAdam	0.312408	0.99
43661	nDaniel	0.313101	0.91
13984	{$\\	0.313826	0.52	}{$\\, ▁{$\\
28031	\\|^	0.313836	0.96
26735	nPolice	0.313906	1
51445	nLittle	0.314495	0.8
53140	nident	0.314564	1	▁unidentified
28212	nOkay	0.314852	0.59
18773	dbcbb	0.315181	1
42854	▁срещу	0.31624	0.95
29793	nBelow	0.316595	0.97
45515	nBrian	0.316604	0.86
46804	twhile	0.316993	0.93
50720	поред	0.317505	0.99
58695	▁училище	0.317923	1
31127	nMike	0.318089	0.7
50022	стър	0.318097	0.93
25854	:=\\	0.318201	1	):=\\
16171	nWednesday	0.318538	0.74
47564	tAssert	0.318597	0.99
33072	nChris	0.319225	0.94	nChristian
23840	nwould	0.31923	0.47
52527	navailable	0.319401	1
24516	nDue	0.319653	0.94
52483	nproperties	0.319823	0.98
46256	nLogged	0.319997	0.95
55948	nExcept	0.32016	0.99
8268	}_\\	0.320284	0.35	}}_\\
42737	nequation	0.320483	1	nequations
27582	($\\	0.320544	0.98
45028	nUpon	0.320734	0.55
54163	nBrown	0.321299	1
43286	ndeterm	0.321723	1
41389	nWomen	0.322039	1
26112	nBeing	0.322312	0.67
44603	nJoe	0.322493	1
28086	nPresident	0.322741	0.92
38447	▁където	0.322843	0.62
38698	ncalcul	0.323293	1
43144	▁дъ	0.323433	0.74	▁дъщер
47114	nWilliam	0.323473	0.55
56688	nAbove	0.323589	0.98
58615	nRom	0.323744	0.96
34089	nStudents	0.324118	0.99
17416	nfortunately	0.324415	0.041	nUnfortunately, Unfortunately
22760	▁»\	0.324606	1
46914	▁}}\"	0.324988	0.98
33459	▁село	0.325061	1	▁селото
54400	nWed	0.325491	0.95
35344	nfollowing	0.325796	0.87
48504	nmust	0.325849	1
26236	ския	0.325951	0.8	нския, йския
44000	▁:-)\	0.326272	0.95
57727	\"=>	0.326552	1
43492	nPersonal	0.326627	0.96
40486	nknow	0.326714	1	▁Unknown
40563	nScott	0.326761	0.82
21871	nNever	0.327308	0.89	nNevertheless
54244	nCombining	0.327637	0.59
43629	nNov	0.327673	1
23833	\"))\	0.32771	0.31
29228	nRecent	0.327852	0.93
37348	nCome	0.328017	0.97
36423	nEnjoy	0.328214	0.95
54630	柬埔	0.328233	1	柬埔寨
24505	nprov	0.328702	1
17538	npackage	0.328838	1
22535	nPerhaps	0.329481	0.11
32734	nFormer	0.329565	0.98
27681	'));\	0.329901	0.48
55901	▁получава	0.329934	0.65
41051	▁'';\	0.330201	0.81
20709	nThrough	0.33054	0.95	nThroughout
41378	nFrank	0.330705	0.96
20659	nStill	0.330735	0.96
17688	nHey	0.331214	0.97
26593	nrequire	0.331586	1
44852	ninvest	0.331802	1
37854	върш	0.331901	0.073	вършва
59394	ерцо	0.331916	0.98
54866	nComing	0.331921	0.96
32663	nNational	0.332188	0.99
36332	дето	0.332386	1	▁където
41505	通用领域	0.332422	0.98
41453	nMatt	0.332552	0.94	nMatthew
52503	nFinding	0.332615	0.82
57332	ntogether	0.333189	0.98
16583	nThursday	0.333288	0.57
40103	nRecall	0.333425	1
21147	=\\{	0.333668	1	}=\\{
13147	)}{\\	0.333786	0.69	})}{\\
59401	nanaly	0.334013	1
34980	nRobert	0.334452	0.98
48719	прил	0.334499	1	▁април
41001	вява	0.334537	0.36
29166	$(\\	0.334588	1
53048	nCongratulations	0.334852	0.7
39806	nMary	0.335438	1
27867	impse	0.335665	1	▁glimpse
47990	nKing	0.33607	1
52083	▁името	0.33613	0.15
18650	nSaturday	0.336234	0.99
31781	ninformation	0.336275	0.92
30028	nenergy	0.336755	1
51196	▁август	0.336797	1
14385	ългар	0.336799	0.0043	ългарски, ▁български, ългария, ▁България, Български, ...
30783	nimpl	0.336964	1
23794	nRemember	0.337029	0.94
50137	nsection	0.337598	0.99
38766	nWritten	0.338021	0.96
50582	вият	0.338406	0.32
54317	nregion	0.338587	1
39612	nJeff	0.338623	0.91
44014	ngreat	0.339172	1
34352	nHappy	0.339374	0.99
42023	кръ	0.339763	1	▁кръ
24674	nAdvertisement	0.340107	0.98
51319	nsingle	0.340149	1
40449	{|\\	0.340197	0.91
49835	nBre	0.34021	0.98	nBreak
53066	nchange	0.340467	1
44456	nPerformance	0.3406	1
41922	▁Пър	0.340754	0.99
58849	▁_\\	0.341165	1
51503	nCommun	0.341256	0.89
15211	tprivate	0.341392	1
48963	nprodu	0.341583	1	nproduct
30226	nPhot	0.341837	0.98	nPhotos
26195	▁forumYou	0.342274	0.0021
12709	nBecause	0.342369	0.081
34361	\\}\	0.342537	1
38338	nNothing	0.343074	0.67
42159	nWashington	0.343247	0.79
34606	nResearch	0.343308	0.99	nResearchers
24782	nInterest	0.34334	0.99	nInterestingly, nInteresting
12698	nFigure	0.344219	1
31104	nWant	0.344223	1
49153	～\	0.344679	1
11251	^{-\\	0.344825	0.46	}^{-\\, )^{-\\
18278	nFollowing	0.344932	0.75
10303	ълга	0.345206	0.15	ългар, ългарски, ▁български, ългария, ▁България, ...
41139	nPrior	0.345385	0.99
47381	nNick	0.345871	0.97
42518	nDevelop	0.345909	0.93
53438	▁Дими	0.346012	1
55804	nJun	0.34639	0.99
45322	nHop	0.346512	1	nHopefully
54046	nSha	0.346588	1
35396	nbool	0.346597	0.99
24457	{(\\	0.346603	0.98	}^{(\\, }{(\\, _{(\\
24541	ългария	0.346843	0.00017	▁България
33852	tassert	0.347048	1
44419	▁{}\"	0.347048	0.98
24717	'];\	0.347701	0.61
42119	nPosts	0.347982	0.99
53187	nMarc	0.348218	0.99
52592	%\">\	0.348361	0.073
39831	ndensity	0.348444	1
37591	)}=\\	0.348639	0.12
29270	nshould	0.348843	0.96
35018	tuint	0.349303	1
33894	nSimilar	0.349355	0.93
45568	nfunctions	0.349815	1
51179	nDefine	0.350013	0.99
34396	}}+\\	0.350468	0.097
45940	▁намира	0.350574	0.7
50586	лната	0.350587	0.21
44924	nAndrew	0.350782	0.58
16179	nTuesday	0.350861	0.75
39026	nMart	0.350967	0.98	nMartin
18797	nJan	0.351	1	nJanuary
55964	nAND	0.351233	1
22252	▁→\	0.351695	1
18397	nSunday	0.351748	0.98
53687	рича	0.351761	0.95
50529	nproduct	0.351795	0.97
22668	nunder	0.352169	1
44776	nChapter	0.352496	0.98
15701	nMonday	0.352575	0.98
50564	nphase	0.35287	1
45385	nEasy	0.353203	1
18909	nConsider	0.353218	0.79	nConsidering
40568	ngeneral	0.353452	0.98
8062	nAccording	0.353724	0.038
31550	▁\"\";\	0.354062	0.072
40299	nMicrosoft	0.354208	0.97
36449	ските	0.354397	0.93
53058	乌鲁木	0.355402	1	乌鲁木齐
35267	nPhil	0.355414	0.99
54936	▁различни	0.355808	0.76
55299	=\"@	0.356101	0.99
58646	nGrand	0.35628	0.87
26741	nJune	0.356546	0.93
45482	▁светов	0.357203	1
30282	nGod	0.357332	0.93
29283	▁\\{\\	0.357351	1
59069	nMus	0.357456	0.25
37264	ncomput	0.35802	1
31615	nSolve	0.358122	1
58161	nScience	0.358137	1
57672	tdefault	0.358499	1
34916	ndistribution	0.358781	0.99
50200	nDave	0.359038	0.32
50140	nCommunity	0.359063	0.98
41268	^@^@	0.359151	1
51882	nYoung	0.359432	0.96
57431	ninterface	0.359444	1
41305	nIntroduction	0.359454	0.99
52521	nEither	0.359498	0.98
39187	nEverything	0.359697	0.93
22047	nalso	0.359842	0.97
50006	nanother	0.360356	0.99
57110	nCREATE	0.36036	0.75
42055	nMel	0.36048	1
50505	nParticip	0.360576	0.99
31989	={\\	0.360602	0.85	}={\\
55201	ndescribed	0.360739	0.84
19857	nMaybe	0.360878	0.98
40939	nparameters	0.361206	1
42196	nInternational	0.361542	0.9
59108	nJac	0.361613	1
15625	${\\	0.362387	0.99
21170	(-\\	0.3624	0.97
57294	(\\{	0.362914	0.98
18738	nHaving	0.363014	0.056
31565	nJul	0.363029	0.98
31384	tstatic	0.36328	1
7965	}^\\	0.363382	0.91	}}^\\
41328	nstud	0.363451	1
25572	nJuly	0.363494	0.37
35954	▁{{\\	0.363617	0.79
42192	nTrump	0.363785	0.99
37219	nAltern	0.365197	0.78	nAlternatively
25337	▁_{\\	0.365636	0.71
13472	nnamespace	0.365873	0.96
25797	ninto	0.366023	1
44140	tLet	0.366209	1
43133	nApart	0.366559	0.98
41115	nPros	0.366717	1
50830	})+\\	0.36738	0.0032
29534	tvoid	0.367484	0.99
41277	mcitedefault	0.367504	0.23
33538	MzUx	0.367673	0.17
26923	nTheir	0.367797	0.88
32584	MzUy	0.368618	0.95
44371	$\\{	0.368677	1
29387	nJames	0.368794	0.98
32015	_;\	0.368811	1
51766	▁март	0.369046	1
45194	nsecond	0.369136	1
35454	nAsk	0.369401	0.98	nAsked
10172	nFinally	0.369498	0.98
38001	nGive	0.369512	0.82
57866	]=\\	0.369661	0.96
54814	nbackground	0.369681	1
54923	nstill	0.369864	1
34223	nhere	0.370093	1
26849	nJanuary	0.370101	0.71
55016	nSpring	0.37049	0.97
40485	nTell	0.371725	0.98
5957	nHowever	0.371743	0.059
11981	nDuring	0.372233	0.91
40827	nVisit	0.37266	1
56585	▁—\	0.372807	1
31721	nQuestion	0.372936	0.9	nQuestions
46094	nDan	0.37308	0.99
18947	nplt	0.373162	1
33207	．\	0.373207	0.9
57012	$|\\	0.37327	0.96
27433	nDecember	0.373335	0.36
21482	nLooking	0.373596	0.33
32408	nSocial	0.373728	0.96
43554	\\}}	0.373778	1
58504	nDepartment	0.373855	0.97
20248	}/\\	0.374129	1
55347	nINT	0.374351	0.96
18124	nDoes	0.374556	0.57
28924	——\	0.374602	1
56346	nUsers	0.375106	0.99
31243	nAlex	0.375189	0.78
29268	nFour	0.375212	0.94
31707	njust	0.375316	0.93	▁injustice, ▁unjust
52569	nperson	0.375646	1
58341	nChristian	0.375708	0.38
55348	nMad	0.375752	1
45638	ndescription	0.375805	0.99
43932	^-\\	0.375808	0.96
39785	nOrgan	0.375971	0.99
53065	ниците	0.37601	0.58
40266	nStory	0.376018	1
57275	телите	0.376167	0.082
43251	▁разпо	0.376228	0.74
47104	nMal	0.376232	1
16034	nFig	0.376416	0.96
57402	nJoined	0.376627	1
16212	nstatic	0.376795	1
18206	\"));\	0.376903	0.037
30283	nCong	0.377134	0.99	nCongratulations
35385	nEarly	0.377268	0.78
52016	\"];\	0.377508	0.13
47063	()))\	0.377555	0.87
6927	\\]\	0.377751	0.98	▁\\]\
31864	▁изпол	0.378353	0.034	▁използва
50136	▁жители	0.378657	0.53
39852	nCou	0.378787	1
37397	nLess	0.378916	0.99
30201	nCurrently	0.379162	0.67
34019	nJack	0.379797	0.99
19851	nOverall	0.379827	0.99
53314	▁града	0.379943	0.88
24693	MzIx	0.380207	0.78
35926	nUniversity	0.380544	0.88
55600	加哥	0.380588	1	芝加哥
43947	▁семейство	0.381063	0.99
52188	nCalifornia	0.381147	0.95
42958	▁ръ	0.381218	0.98	▁ръко
27754	nOctober	0.381452	0.25
41100	nMaking	0.381689	0.86
32866	nSure	0.381784	0.99
48039	▁кръ	0.381944	0.91
46710	▁няколко	0.382101	0.5
56284	▁работи	0.382293	1
37859	nThings	0.382723	1
29931	nLearn	0.382849	0.99	nLearning
40323	nWorking	0.382955	0.98
24549	nbefore	0.38304	1
58930	nLiving	0.383046	0.94
28131	nNovember	0.383067	0.77
52320	ръща	0.383068	0.23
51566	телни	0.383591	0.24
23963	MzIz	0.383954	0.99
30758	$};\	0.384094	0.23
35596	nThird	0.384285	1
32678	nGetting	0.384505	0.92
26393	nSen	0.38456	0.99	nSend, nSenior
42292	nBrand	0.384742	1
54895	nlayout	0.384767	1
57714	nphot	0.38501	1
55422	nbegin	0.385299	1
29905	nReferences	0.385428	1
7890	▁($\\	0.385698	0.97
50078	nmodels	0.386988	1
42376	ninclude	0.387274	0.98
6064	\\}$	0.387432	0.6	}\\}$, ▁\\}$, )\\}$
38605	▁държа	0.387456	0.96
58950	(|\\	0.387558	0.96
11392	nEven	0.388041	0.99	nEvent, nEventually
30484	nwho	0.388046	0.99
52277	nWebsite	0.388151	0.98
33583	▁става	0.388197	0.79
52022	nInternet	0.388274	0.99
56313	norgan	0.388615	0.98
38420	nsame	0.388996	1
50073	▁>>\	0.38908	1
47570	nEss	0.389089	1
43328	nBel	0.389477	0.97
49190	nHuman	0.390099	0.96
44962	\"--	0.3902	1
36919	▁група	0.390271	1
46426	nAlways	0.390591	0.96
50336	nMor	0.390765	0.98
57081	nprogram	0.391022	1
46257	▁продъл	0.391079	0.97
54439	=\"\">\	0.391454	0.18
47165	(\"<	0.391756	0.99
45431	nQuant	0.391857	0.99
24032	MzIw	0.391993	0.92
59328	nRock	0.392384	1
16107	nGreat	0.392538	0.98
56270	$(\"	0.392553	0.97
26634	nthrough	0.392557	0.88
24798	nSorry	0.393066	0.95
42223	▁място	0.393164	0.59
22396	ICENSE	0.393521	1	LICENSE, ▁LICENSE
17525	nPeople	0.393614	1
49270	▁голя	0.393909	0.19
33351	)/\\	0.394105	0.67
43299	▁Той	0.39414	1
54077	nStaff	0.394504	1
15833	nGiven	0.395154	0.98
38895	nthree	0.395521	1
25762	}}=\\	0.396016	0.11
47360	nGuest	0.396287	0.98
33616	MzUz	0.396437	0.16
55358	nMoving	0.396756	0.98
43314	nFive	0.396761	0.97
52112	nContin	0.397066	0.99
45937	нява	0.397109	0.6
13583	nhave	0.397317	0.99
28606	▁\\#	0.397513	0.99
54233	nNor	0.39761	1
37365	+\\+	0.397741	1	\\+\\_\\+\\+
20436	nKeep	0.397788	0.99
7256	nusing	0.397807	0.98
48012	\x94\	0.397959	1
41426	nUpdated	0.397977	0.99
25164	nwhat	0.398468	0.99
17852	nRelated	0.398808	0.98
21979	nDavid	0.398858	0.99
27561	nWas	0.398909	1	nWashington
57467	nHol	0.399185	0.99
46561	nbased	0.399443	1
58279	nLearning	0.399508	0.97
38067	nNotes	0.39956	1
37249	nInvest	0.399639	0.99
38645	nNone	0.399705	0.99
44156	nHam	0.399737	1
34696	▁\"\"\	0.399852	0.93
7986	nAlso	0.39994	0.8
36678	nCould	0.400118	0.12
9315	nWhy	0.40032	0.99
35207	▁София	0.400573	1
30292	чава	0.400706	0.99	▁получава
19371	nTHE	0.401192	0.98
7213	}\\\\\	0.401426	0.92	}}\\\\\
44649	стъ	0.401445	0.93	стър, стъп
21488	ntheir	0.401733	0.71
42727	nposted	0.401782	0.99
31786	nhad	0.401897	1
27717	nSeptember	0.401922	0.48
48962	▁река	0.402028	1
23492	nabout	0.402088	1
45090	nsuper	0.40213	1
53924	nLarge	0.4022	1
25674	ското	0.402426	0.66
41023	ъм	0.402499	1
51501	nWood	0.402555	0.98
55859	\\>	0.402572	1
56144	ък	0.402581	0.99	▁ръко
42653	nMembers	0.402908	1
15204	nHis	0.403078	0.95	nHistory, nHistor
33743	nmass	0.403275	1
24390	})=\\	0.403336	0.16
102	。	0.403372	1
34150	nSouth	0.403509	0.95
57481	▁следва	0.404053	0.98
42289	ncons	0.404526	1	nconsider, nconstant, nconsidered
19595	}[\\	0.40485	0.92
52249	nMade	0.404858	1
42013	ьор	0.404988	0.89
29514	nnop	0.40534	1
45961	nOverview	0.405564	1
48003	орги	0.405648	0.9	▁Георги
26400	^+\\	0.40586	0.93
35472	nKnow	0.406014	0.92
23153	wenshu	0.406171	1
55612	nTips	0.406902	1
24736	)));\	0.407199	0.027	()));\
47929	nhim	0.40729	1
16040	▁%}\	0.407785	0.96
35533	▁бъ	0.407811	0.91	▁бъде, ▁българ
46342	▁откри	0.407842	1
30300	nNEW	0.408142	0.94
51092	\ufeff\	0.408225	0.99
54648	nLondon	0.408439	0.96
28018	nExper	0.408527	1	nExperience
53539	▁тери	0.408588	1
38831	nCustomer	0.408624	0.99
31286	(\"\\	0.408715	0.96
15685	)-\\	0.409366	0.94
18840	\\}\\	0.409446	0.9
40837	▁тях	0.409493	0.11
24065	▁\\(\\	0.409497	0.96
39956	nLead	0.409598	0.99
43725	nCOM	0.410058	0.97
54399	nGra	0.410061	1	nGrant, nGrand
53974	nmade	0.410577	1
24562	MzIy	0.410636	0.66
24639	nDear	0.411071	0.071
55923	nListen	0.411173	0.99
50476	nFeb	0.411831	1
40797	nNOTE	0.412281	0.75
51021	tfunction	0.412408	0.99
50433	nSix	0.412464	0.99
56530	nBon	0.412534	0.99
46819	nElect	0.412633	1
50814	▁изпъл	0.412753	0.94
29580	nhis	0.412833	1
11248	nMany	0.413362	0.94
25223	nMarch	0.414176	0.88
49336	nalong	0.414266	1
33797	nused	0.414319	1	▁unused
47024	▁когато	0.414559	0.89
41379	nRating	0.414573	1
43515	nHard	0.414659	1
43493	nSomething	0.414673	0.98
12547	ollary	0.414773	1	corollary, ▁Corollary, ▁corollary, Corollary
59145	nMid	0.414826	0.99
40579	nFood	0.415115	0.99
50541	nUN	0.41512	1
23024	++;\	0.415442	0.99
43746	nexample	0.415462	1
16221	nFriday	0.415507	0.95
50127	nProb	0.416105	0.98
10420	npublic	0.41631	0.98
26597	nChrist	0.416401	0.9	nChristian
44483	nCompany	0.416535	0.99
56931	▁Георги	0.417042	0.98
25344	nyour	0.41707	0.77
31442	tmov	0.417143	1
22127	nwhile	0.417393	0.99	▁meanwhile
14696	nHave	0.417413	0.8
28039	nFebruary	0.417484	0.66
34275	▁–\	0.417512	0.94
18383	]{\\	0.417745	0.28	[]{\\
49582	nFriend	0.417748	0.95
50302	{%\	0.418157	1
35913	nCON	0.418511	0.97
59324	гава	0.419149	0.75
30385	nselect	0.419178	1
56464	nflu	0.41968	1
58119	казва	0.419829	0.7
43573	▁\\:	0.420019	1
38393	nBill	0.420096	0.97
45883	'):\	0.420174	0.97
54098	nApr	0.420226	0.99
28857	nPublished	0.420236	1
24524	▁});\	0.420275	0.92
30914	\"}\	0.420331	0.94
32008	__":"	0.420695	0.99
57472	преки	0.420876	0.14
59568	▁	0.420915	0.99
57265	nIll	0.421022	0.98
27546	nAugust	0.421126	0.84
34054	ците	0.421623	0.52	ниците
55773	▁пъ	0.421689	0.99
50457	nyears	0.421844	1
41422	nfind	0.42186	1
45256	nThomas	0.422062	0.83
12543	nToday	0.422458	0.99
33774	nApple	0.422926	0.99
52008	nTL	0.423445	1
52549	twhere	0.423569	1
46468	nedit	0.423697	1
50359	>\"\	0.423726	0.92
56687	nDeep	0.42415	1
8076	({\\	0.42489	0.99	}({\\, ▁({\\
47677	norig	0.425064	1
51623	nIndia	0.425094	0.94
40341	\">{{	0.425157	0.98
26795	▁[];\	0.425409	0.6
47947	едно	0.425479	0.99	▁едно, ▁заедно
53387	nyear	0.425547	1
33614	ntemplate	0.426	1	▁contemplate
10290	nMost	0.426011	0.99
33670	nresult	0.426124	1
15601	nUnder	0.426364	0.95
52644	nAdding	0.426543	0.99
28596	▁=>\	0.426553	1
14021	tthis	0.426587	1
26328	nMichael	0.426624	0.95
24609	nApril	0.426849	0.68
43940	nLatest	0.427038	0.99
54440	tSystem	0.427126	0.99
45936	густ	0.42734	0.91	▁август
28589	强险	0.427818	1	交强险
9964	nvoid	0.42798	1
40433	}\\|	0.42807	0.87
31962	maba	0.428189	1	mabaochang
52605	nCategories	0.428486	0.99
24555	++)\	0.428601	0.53
48060	)\"\	0.428638	0.99
32336	nsee	0.428886	1	▁unseen
53833	▁импе	0.429305	0.99	▁империя
13155	▁година	0.42947	0.99
25307	nWould	0.4295	0.98
53826	nPet	0.429798	0.97
54236	nMass	0.43012	0.93
52340	`)\	0.43034	1
34779	nAbstract	0.430585	1
42654	nDifferent	0.430773	0.67
27256	▁години	0.430804	0.98
41214	}\"\	0.430863	0.99
10151	":"\\	0.430985	0.91
57403	nmatrix	0.431028	1
33591	▁\"^	0.431324	1
55421	nlook	0.431326	1
46703	nAppl	0.431438	1	nApplying, nApplication
48799	nAmazon	0.43179	0.98
8492	nJust	0.431844	0.58
101	，	0.431884	1
29705	nWithout	0.432026	0.99
23304	nPerson	0.432028	1	nPersonally, nPersonal
39123	nmov	0.432083	1
53282	tbool	0.432301	1
41155	▁дъл	0.432324	1
38577	nright	0.432376	1	▁downright
35423	nProv	0.432456	0.96
24288	nonly	0.433008	1
34991	nSer	0.433375	0.95	nService, nSeriously
34169	нията	0.43339	0.36
37840	nCollect	0.433457	0.99
52298	▁\")	0.433472	0.88
7033	nwhich	0.433593	0.97
14721	nWho	0.434214	0.92
48491	nRound	0.434455	1
19055	nwhen	0.434672	0.93
31110	nresults	0.434733	1
36823	▁създа	0.434788	0.98
44628	tswitch	0.434827	1
33544	nNorth	0.435138	0.97
35899	▁вър	0.435251	0.94	▁върху
26447	▁град	0.43542	0.95	▁града
47654	цата	0.435655	0.53
53511	nlight	0.435769	1	▁enlightened
35011	nThink	0.436156	0.9
63175	ѝ	0.436487	1
48086	npres	0.436754	1
55875	\\\":\\\"	0.436875	0.93
52638	nToo	0.437283	1
10669	nThank	0.437365	0.96
30404	nAdditional	0.437388	0.98
52935	nDam	0.437726	1
15784	nBoth	0.437999	0.82
26431	nfirst	0.438601	1
31085	щата	0.43871	0.11
8238	}}{\\	0.438952	0.99	}}}{\\
44254	nCredit	0.438965	1
40470	nwww	0.439925	1
55830	[-\\	0.440018	0.96
7361	tpublic	0.440108	1
31428	nCopyright	0.44071	0.85
32052	\\\\[	0.440765	1	▁\\\\[
6918	nThey	0.440985	1
49887	nLand	0.441048	1
57758	_\"	0.441089	1
30624	nBusiness	0.441846	0.99
58751	}}\"	0.441916	0.97
5920	());\	0.441972	0.59
13759	▁…\	0.442184	1
29890	nnumber	0.442266	0.98
40970	nWest	0.442638	0.94
24758	nIts	0.442712	0.94
50937	nMen	0.44381	1
39223	вежда	0.443889	0.43
53922	▁свър	0.443945	0.97
4114	}_{\\	0.444076	0.67	}}_{\\, )}_{\\
57269	nfour	0.444186	1
38964	nChina	0.444318	0.99
45493	nAug	0.444359	0.95
8834	nYes	0.444404	1	nYesterday
10993	▁\\;	0.444573	0.98
59118	nthanks	0.445161	0.99
49737	▁едно	0.445366	0.98
41159	nTravel	0.445916	0.96
27265	nGeneral	0.445976	0.96	nGenerally
25895	nvari	0.446046	1	invariant, ▁invariance, ▁invariants, ▁invariably
13156	▁:)\	0.446532	0.99
26461	nTom	0.446774	0.8
6336	nSince	0.446809	0.99
57421	Iref	0.447491	1	Irefn
49719	ntake	0.447567	1
27460	(\"/	0.448407	0.99
55044	nInteg	0.448545	0.99
29856	▁също	0.448602	0.57
30945	ngiven	0.448679	1
24447	tbreak	0.448744	1	▁outbreak
52977	▁върху	0.449229	0.94
32384	nprocess	0.449614	1
25543	nhow	0.449667	0.99	nhowever
34439	дъл	0.450211	1	▁дъл, ▁продъл
42462	nBuilding	0.45072	0.96
35962	[{\\	0.450898	0.97
39393	nmain	0.451302	1
38027	nAnn	0.451303	1
30196	nSpecial	0.451339	0.99
40132	nSchool	0.451575	0.99
38691	nInformation	0.451668	0.81
32758	ността	0.451683	0.51
44745	nDigital	0.452162	1
46424	nProm	0.452571	0.98
32935	nBig	0.452864	1
27214	nPut	0.452907	0.99
18927	nWhich	0.453006	0.99
40265	nExpl	0.453055	1
20260	={\"	0.453312	1
58594	▁чове	0.453534	0.97
21127	jupy	0.453634	1	jupytext, jupyter, ▁jupyter
55234	nSU	0.453704	1
42677	}\\}	0.453833	0.69
31977	nJo	0.453859	0.99	nJon, nJoe, nJob, nJosh, nJoined
51390	▁тази	0.453952	0.15
49635	nSat	0.453965	1
45748	nTen	0.454156	0.96
19695	MzAx	0.454217	0.42
43050	nReading	0.454224	0.99
39622	▁вси	0.454271	1	▁всички
9091	nAnother	0.454341	0.97
51472	nComput	0.454407	0.99
56682	nTip	0.45459	1
56828	nBlog	0.454909	0.91
21623	ството	0.455276	0.54
51290	nPal	0.455366	1
23303	nThree	0.45539	1
48358	nblack	0.455414	1
46915	nPhone	0.455457	0.95
34407	}\\)	0.455534	0.14
30607	nafter	0.455582	1
3246	nwhere	0.455677	0.99
25837	ният	0.455834	0.62	нията
55388	nHotel	0.455835	1
54369	nimage	0.456278	1
35384	nmult	0.456301	1
39735	▁Македо	0.456411	0.99	▁Македония
14589	nWhere	0.456576	0.99
30247	▁няко	0.45706	0.15	▁няколко
15036	▁къ	0.457102	1	▁към, ▁където
12593	ската	0.457163	0.95	нската, ческата
26977	▁predecess	0.457388	0.99	▁predecessor, ▁predecessors
10523	nEvery	0.457771	0.96	nEveryone, nEverything
59147	ncoe	0.457868	0.99
17889	nComments	0.45808	1
52300	nAppro	0.458378	0.99
43300	▁още	0.458456	0.98
26094	nlet	0.458477	1	▁inlet
45891	▁револю	0.459433	0.99
41509	nSmall	0.459483	0.99
45902	nGoing	0.459504	0.88
567	▁the	0.459966	1	▁they, ▁their, ▁there, ▁them, ▁then, ...
20566	ninte	0.460107	0.99	ninterest, ninteg, ninteraction, ninterface, nintegral
56957	)\\)	0.460125	0.99
39263	nvalues	0.460224	1
53715	nTur	0.46046	0.99
37967	▁както	0.460634	0.64
20281	▁practition	0.46077	0.99	▁practitioners, ▁practitioner
45253	nBob	0.461075	1
50389	ъз	0.46128	0.3
44827	给付金钱	0.461445	0.97	给付金钱义务
39490	tstruct	0.46196	1
21050	\"]\	0.462033	0.49
56381	tresult	0.462541	1
55718	nnormal	0.462568	0.99
21357	▁~\\	0.462752	0.99
53654	(\"[	0.463107	1
33327	▁път	0.463406	1
21245	nAmeric	0.463432	1	nAmerican
26736	neffect	0.463729	1	▁ineffective, neffective
25587	nBen	0.46394	0.99
48127	nimportant	0.464106	0.98
29791	nrem	0.464411	1
53189	nSimple	0.46481	1
11920	nUsing	0.464915	0.75
53561	стъп	0.465041	0.33
14553	」\	0.465168	0.78
4304	}^{\\	0.465414	0.51	}}^{\\
50171	\">[	0.46551	0.022
8319	nThanks	0.4657	1
38145	утбо	0.466167	0.019	▁футбо
31701	nHot	0.466771	0.99	nHotel
38412	nAnonymous	0.46694	1
1958	":"__	0.467034	0.92
50626	`;\	0.46726	0.98
49193	nsource	0.467578	1
48973	nUl	0.467745	1	nUltimately
26389	nBas	0.468003	1	nBasically
46753	nTurn	0.46824	0.99
30880	nShould	0.468349	0.74
59386	nPH	0.468386	1
51385	▁Йо	0.468406	1
55072	\">(	0.468796	0.67
48779	nCook	0.468801	0.98
48875	nPrevious	0.468873	0.99
48730	nStandard	0.469091	0.99
26851	nPaul	0.47029	0.71
19793	ването	0.47068	0.5
33163	nAnal	0.470708	0.98	nAnaly
36679	norder	0.471134	1
42364	ncurrent	0.471153	1	concurrent
20820	\":\	0.471267	0.97	\\\":\\\"
34096	nFalse	0.471321	1
32033	nNeed	0.471366	0.99
41213	nLaw	0.471888	0.99
47181	tfloat	0.471977	1
58730	nrange	0.472035	1
36312	nLife	0.472081	0.99
37797	лява	0.47219	0.93
40973	nAverage	0.472474	1
57480	nBottom	0.472863	1
19487	nPhoto	0.472911	1	nPhotos
33801	▁война	0.473158	1
55509	nExamples	0.473361	1
14909	\\{\\	0.473447	0.98	▁$\\{\\, ▁\\{\\
13143	本实用	0.473513	0.96	本实用新型, ▁本实用新型, 本实用新型的, ▁本实用新型的
55270	nRev	0.473891	1
45714	▁север	0.473911	1
25737	цията	0.474323	0.65
53064	▁тези	0.474427	0.98
31287	nPublic	0.474548	0.99
42725	期间履行	0.474557	0.71	指定的期间履行

Byte tokens

112 entries below threshold of 0.168

token_id	token	indicator	ord	hex	byte_type	reencoded
339	<0x22>	2.06589e-06	34	0x22	ascii	59592: "
498	<0xC1>	2.07852e-06	193	0xC1	unused_utf8
414	<0x6D>	2.08643e-06	109	0x6D	ascii	59583: m
314	<0x09>	2.08734e-06	9	0x09	ascii	126: \t
420	<0x73>	2.08785e-06	115	0x73	ascii	59575: s
383	<0x4E>	2.08876e-06	78	0x4E	ascii	59618: N
557	<0xFC>	2.09012e-06	252	0xFC	unused_utf8
372	<0x43>	2.09111e-06	67	0x43	ascii	59608: C
410	<0x69>	2.09197e-06	105	0x69	ascii	59574: i
551	<0xF6>	2.09523e-06	246	0xF6	unused_utf8
348	<0x2B>	2.09569e-06	43	0x2B	ascii	59660: +
378	<0x49>	2.09569e-06	73	0x49	ascii	59597: I
388	<0x53>	2.09661e-06	83	0x53	ascii	59602: S
418	<0x71>	2.0989e-06	113	0x71	ascii	59619: q
430	<0x7D>	2.1003e-06	125	0x7D	ascii	59596: }
550	<0xF5>	2.1003e-06	245	0xF5	unused_utf8
359	<0x36>	2.10351e-06	54	0x36	ascii	83: 6
364	<0x3B>	2.10353e-06	59	0x3B	ascii	59631: ;
379	<0x4A>	2.10586e-06	74	0x4A	ascii	59649: J
353	<0x30>	2.10721e-06	48	0x30	ascii	77: 0

92 additional entries below threshold

token_id	token	indicator	ord	hex	byte_type	reencoded
387	<0x52>	2.10721e-06	82	0x52	ascii	59615: R
407	<0x66>	2.1086e-06	102	0x66	ascii	59585: f
404	<0x63>	2.10904e-06	99	0x63	ascii	59581: c
367	<0x3E>	2.10949e-06	62	0x3E	ascii	59644: >
360	<0x37>	2.11042e-06	55	0x37	ascii	84: 7
399	<0x5E>	2.1127e-06	94	0x5E	ascii	59641: ^
393	<0x58>	2.11364e-06	88	0x58	ascii	59733: X
497	<0xC0>	2.11407e-06	192	0xC0	unused_utf8
402	<0x61>	2.11454e-06	97	0x61	ascii	59572: a
352	<0x2F>	2.11499e-06	47	0x2F	ascii	59598: /
417	<0x70>	2.11499e-06	112	0x70	ascii	59584: p
385	<0x50>	2.115e-06	80	0x50	ascii	59612: P
401	<0x60>	2.115e-06	96	0x60	ascii	59848: `
358	<0x35>	2.11595e-06	53	0x35	ascii	82: 5
409	<0x68>	2.11639e-06	104	0x68	ascii	59578: h
361	<0x38>	2.11686e-06	56	0x38	ascii	85: 8
403	<0x62>	2.11729e-06	98	0x62	ascii	59588: b
406	<0x65>	2.11733e-06	101	0x65	ascii	59569: e
431	<0x7E>	2.11775e-06	126	0x7E	ascii	59734: ~
337	<0x20>	2.11822e-06	32	0x20	ascii	59568: ▁
408	<0x67>	2.11865e-06	103	0x67	ascii	59586: g
398	<0x5D>	2.11958e-06	93	0x5D	ascii	59651: ]
357	<0x34>	2.12002e-06	52	0x34	ascii	81: 4
376	<0x47>	2.12053e-06	71	0x47	ascii	59628: G
421	<0x74>	2.12093e-06	116	0x74	ascii	59570: t
340	<0x23>	2.12276e-06	35	0x23	ascii	59697: #
366	<0x3D>	2.12279e-06	61	0x3D	ascii	59611: =
386	<0x51>	2.12321e-06	81	0x51	ascii	59745: Q
346	<0x29>	2.12368e-06	41	0x29	ascii	59604: )
423	<0x76>	2.12368e-06	118	0x76	ascii	59590: v
426	<0x79>	2.12368e-06	121	0x79	ascii	59587: y
553	<0xF8>	2.12371e-06	248	0xF8	unused_utf8
391	<0x56>	2.12458e-06	86	0x56	ascii	59645: V
428	<0x7B>	2.12551e-06	123	0x7B	ascii	59595: {
560	<0xFF>	2.12599e-06	255	0xFF	unused_utf8
355	<0x32>	2.12733e-06	50	0x32	ascii	79: 2
552	<0xF7>	2.12733e-06	247	0xF7	unused_utf8
554	<0xF9>	2.12777e-06	249	0xF9	unused_utf8
422	<0x75>	2.13007e-06	117	0x75	ascii	59582: u
558	<0xFD>	2.13095e-06	253	0xFD	unused_utf8
424	<0x77>	2.13099e-06	119	0x77	ascii	59589: w
416	<0x6F>	2.1314e-06	111	0x6F	ascii	59573: o
397	<0x5C>	2.13234e-06	92	0x5C	ascii	59580: \
396	<0x5B>	2.13506e-06	91	0x5B	ascii	59653: [
425	<0x78>	2.13549e-06	120	0x78	ascii	59607: x
371	<0x42>	2.1355e-06	66	0x42	ascii	59616: B
354	<0x31>	2.13555e-06	49	0x31	ascii	78: 1
415	<0x6E>	2.13594e-06	110	0x6E	ascii	59571: n
413	<0x6C>	2.13596e-06	108	0x6C	ascii	59577: l
389	<0x54>	2.13597e-06	84	0x54	ascii	59600: T
411	<0x6A>	2.13597e-06	106	0x6A	ascii	59617: j
365	<0x3C>	2.13686e-06	60	0x3C	ascii	59666: <
344	<0x27>	2.13688e-06	39	0x27	ascii	59610: '
419	<0x72>	2.13736e-06	114	0x72	ascii	59576: r
381	<0x4C>	2.13781e-06	76	0x4C	ascii	59620: L
429	<0x7C>	2.14003e-06	124	0x7C	ascii	59705: |
370	<0x41>	2.14006e-06	65	0x41	ascii	59603: A
373	<0x44>	2.1405e-06	68	0x44	ascii	59614: D
380	<0x4B>	2.1405e-06	75	0x4B	ascii	59655: K
343	<0x26>	2.14051e-06	38	0x26	ascii	59640: &
350	<0x2D>	2.14095e-06	45	0x2D	ascii	59594: -
318	<0x0D>	2.1414e-06	13	0x0D	ascii	143: \r
349	<0x2C>	2.14183e-06	44	0x2C	ascii	97: ,
315	<0x0A>	2.14228e-06	10	0x0A	ascii	144: \n
351	<0x2E>	2.14365e-06	46	0x2E	ascii	98: .
338	<0x21>	2.14455e-06	33	0x21	ascii	99: !
375	<0x46>	2.14455e-06	70	0x46	ascii	59621: F
342	<0x25>	2.14548e-06	37	0x25	ascii	59677: %
556	<0xFB>	2.14591e-06	251	0xFB	unused_utf8
382	<0x4D>	2.14636e-06	77	0x4D	ascii	59609: M
363	<0x3A>	2.14639e-06	58	0x3A	ascii	59601: :
559	<0xFE>	2.14818e-06	254	0xFE	unused_utf8
362	<0x39>	2.14819e-06	57	0x39	ascii	86: 9
400	<0x5F>	2.1486e-06	95	0x5F	ascii	59593: _
374	<0x45>	2.14999e-06	69	0x45	ascii	59613: E
356	<0x33>	2.15041e-06	51	0x33	ascii	80: 3
377	<0x48>	2.15448e-06	72	0x48	ascii	59624: H
384	<0x4F>	2.15582e-06	79	0x4F	ascii	59622: O
390	<0x55>	2.15672e-06	85	0x55	ascii	59639: U
347	<0x2A>	2.15761e-06	42	0x2A	ascii	59636: *
369	<0x40>	2.15763e-06	64	0x40	ascii	59879: @
368	<0x3F>	2.15898e-06	63	0x3F	ascii	100: ?
313	<0x08>	2.15988e-06	8	0x08	ascii	142: \x08
345	<0x28>	2.16118e-06	40	0x28	ascii	59605: (
405	<0x64>	2.16392e-06	100	0x64	ascii	59579: d
427	<0x7A>	2.16434e-06	122	0x7A	ascii	59627: z
412	<0x6B>	2.17059e-06	107	0x6B	ascii	59591: k
394	<0x59>	2.17325e-06	89	0x59	ascii	59656: Y
555	<0xFA>	2.17682e-06	250	0xFA	unused_utf8
341	<0x24>	2.18525e-06	36	0x24	ascii	59606: $
392	<0x57>	2.19321e-06	87	0x57	ascii	59623: W
395	<0x5A>	2.19411e-06	90	0x5A	ascii	59840: Z

242 additional entries above threshold

token_id	token	indicator	ord	hex	byte_type
98	.	0.310995	46	0x2E	ascii
144	\n	0.334304	10	0x0A	ascii
97	,	0.3691	44	0x2C	ascii
59601	:	0.454675	58	0x3A	ascii
59610	'	0.467823	39	0x27	ascii
59631	;	0.481388	59	0x3B	ascii
59592	"	0.487747	34	0x22	ascii
77	0	0.490377	48	0x30	ascii
99	!	0.510753	33	0x21	ascii
100	?	0.52049	63	0x3F	ascii
59604	)	0.520693	41	0x29	ascii
78	1	0.526262	49	0x31	ascii
79	2	0.527424	50	0x32	ascii
59575	s	0.528776	115	0x73	ascii
59593	_	0.532446	95	0x5F	ascii
59594	-	0.535997	45	0x2D	ascii
59605	(	0.543614	40	0x28	ascii
80	3	0.561457	51	0x33	ascii
59644	>	0.566352	62	0x3E	ascii
546	<0xF1>	0.571061	241	0xF1	utf8
547	<0xF2>	0.577392	242	0xF2	utf8
86	9	0.586097	57	0x39	ascii
59651	]	0.593131	93	0x5D	ascii
59572	a	0.595001	97	0x61	ascii
59611	=	0.598604	61	0x3D	ascii
59570	t	0.599509	116	0x74	ascii
59603	A	0.601331	65	0x41	ascii
81	4	0.604641	52	0x34	ascii
82	5	0.613663	53	0x35	ascii
59579	d	0.614421	100	0x64	ascii
59583	m	0.614578	109	0x6D	ascii
59598	/	0.61518	47	0x2F	ascii
83	6	0.616839	54	0x36	ascii
59574	i	0.616871	105	0x69	ascii
59597	I	0.619068	73	0x49	ascii
59581	c	0.620494	99	0x63	ascii
59569	e	0.621878	101	0x65	ascii
59608	C	0.623438	67	0x43	ascii
59697	#	0.625832	35	0x23	ascii
59656	Y	0.629653	89	0x59	ascii
59573	o	0.630141	111	0x6F	ascii
59571	n	0.630452	110	0x6E	ascii
59636	*	0.631372	42	0x2A	ascii
59580	\	0.631897	92	0x5C	ascii
59614	D	0.63204	68	0x44	ascii
59584	p	0.634138	112	0x70	ascii
59602	S	0.637553	83	0x53	ascii
59622	O	0.637822	79	0x4F	ascii
59587	y	0.638823	121	0x79	ascii
59653	[	0.640394	91	0x5B	ascii
84	7	0.641152	55	0x37	ascii
59620	L	0.641281	76	0x4C	ascii
59585	f	0.641539	102	0x66	ascii
59613	E	0.641944	69	0x45	ascii
59609	M	0.641955	77	0x4D	ascii
59586	g	0.643845	103	0x67	ascii
59607	x	0.64502	120	0x78	ascii
126	\t	0.645559	9	0x09	ascii
59596	}	0.646116	125	0x7D	ascii
59600	T	0.646397	84	0x54	ascii
59612	P	0.646817	80	0x50	ascii
59576	r	0.647407	114	0x72	ascii
85	8	0.647849	56	0x38	ascii
59628	G	0.650072	71	0x47	ascii
59660	+	0.650605	43	0x2B	ascii
59588	b	0.650788	98	0x62	ascii
59618	N	0.651491	78	0x4E	ascii
59621	F	0.652243	70	0x46	ascii
59577	l	0.654065	108	0x6C	ascii
59615	R	0.655446	82	0x52	ascii
59616	B	0.655501	66	0x42	ascii
59595	{	0.659871	123	0x7B	ascii
59624	H	0.660396	72	0x48	ascii
59645	V	0.660971	86	0x56	ascii
59582	u	0.662542	117	0x75	ascii
59591	k	0.662844	107	0x6B	ascii
59655	K	0.663044	75	0x4B	ascii
59578	h	0.665077	104	0x68	ascii
59590	v	0.666364	118	0x76	ascii
534	<0xE5>	0.670589	229	0xE5	utf8
59639	U	0.67409	85	0x55	ascii
59589	w	0.683091	119	0x77	ascii
59606	$	0.68461	36	0x24	ascii
59623	W	0.686028	87	0x57	ascii
59840	Z	0.686744	90	0x5A	ascii
59627	z	0.688614	122	0x7A	ascii
59733	X	0.690406	88	0x58	ascii
527	<0xDE>	0.69243	222	0xDE	utf8
531	<0xE2>	0.693516	226	0xE2	utf8
59666	<	0.695451	60	0x3C	ascii
59649	J	0.695891	74	0x4A	ascii
59617	j	0.703329	106	0x6A	ascii
59705	|	0.703927	124	0x7C	ascii
59879	@	0.707288	64	0x40	ascii
526	<0xDD>	0.709534	221	0xDD	utf8
59640	&	0.710243	38	0x26	ascii
59848	`	0.714628	96	0x60	ascii
59677	%	0.721202	37	0x25	ascii
433	<0x80>	0.725891	128	0x80	utf8
59619	q	0.73114	113	0x71	ascii
474	<0xA9>	0.732688	169	0xA9	utf8
549	<0xF4>	0.733207	244	0xF4	utf8
532	<0xE3>	0.735934	227	0xE3	utf8
436	<0x83>	0.737435	131	0x83	utf8
59745	Q	0.742661	81	0x51	ascii
529	<0xE0>	0.744935	224	0xE0	utf8
537	<0xE8>	0.745326	232	0xE8	utf8
328	<0x17>	0.749714	23	0x17	ascii
544	<0xEF>	0.753266	239	0xEF	utf8
434	<0x81>	0.753793	129	0x81	utf8
441	<0x88>	0.754141	136	0x88	utf8
143	\r	0.754578	13	0x0D	ascii
528	<0xDF>	0.757404	223	0xDF	utf8
536	<0xE7>	0.758897	231	0xE7	utf8
514	<0xD1>	0.760364	209	0xD1	utf8
461	<0x9C>	0.765463	156	0x9C	utf8
471	<0xA6>	0.768992	166	0xA6	utf8
535	<0xE6>	0.770975	230	0xE6	utf8
59734	~	0.770996	126	0x7E	ascii
445	<0x8C>	0.774031	140	0x8C	utf8
525	<0xDC>	0.774385	220	0xDC	utf8
489	<0xB8>	0.774895	184	0xB8	utf8
435	<0x82>	0.775765	130	0x82	utf8
459	<0x9A>	0.77722	154	0x9A	utf8
538	<0xE9>	0.779507	233	0xE9	utf8
458	<0x99>	0.782753	153	0x99	utf8
454	<0x95>	0.782897	149	0x95	utf8
513	<0xD0>	0.785235	208	0xD0	utf8
477	<0xAC>	0.786045	172	0xAC	utf8
438	<0x85>	0.78645	133	0x85	utf8
439	<0x86>	0.790033	134	0x86	utf8
449	<0x90>	0.790739	144	0x90	utf8
59641	^	0.791393	94	0x5E	ascii
319	<0x0E>	0.792221	14	0x0E	ascii
440	<0x87>	0.793088	135	0x87	utf8
469	<0xA4>	0.793858	164	0xA4	utf8
495	<0xBE>	0.79615	190	0xBE	utf8
468	<0xA3>	0.796315	163	0xA3	utf8
455	<0x96>	0.79881	150	0x96	utf8
335	<0x1E>	0.799777	30	0x1E	ascii
329	<0x18>	0.7998	24	0x18	ascii
323	<0x12>	0.801961	18	0x12	ascii
451	<0x92>	0.80221	146	0x92	utf8
494	<0xBD>	0.802292	189	0xBD	utf8
500	<0xC3>	0.80268	195	0xC3	utf8
457	<0x98>	0.80297	152	0x98	utf8
333	<0x1C>	0.803833	28	0x1C	ascii
327	<0x16>	0.80394	22	0x16	ascii
444	<0x8B>	0.805187	139	0x8B	utf8
464	<0x9F>	0.805376	159	0x9F	utf8
447	<0x8E>	0.806242	142	0x8E	utf8
463	<0x9E>	0.806386	158	0x9E	utf8
481	<0xB0>	0.806694	176	0xB0	utf8
499	<0xC2>	0.807429	194	0xC2	utf8
456	<0x97>	0.809097	151	0x97	utf8
479	<0xAE>	0.810239	174	0xAE	utf8
309	<0x04>	0.810588	4	0x04	ascii
324	<0x13>	0.810985	19	0x13	ascii
496	<0xBF>	0.811174	191	0xBF	utf8
548	<0xF3>	0.811568	243	0xF3	utf8
452	<0x93>	0.81279	147	0x93	utf8
450	<0x91>	0.81291	145	0x91	utf8
326	<0x15>	0.813329	21	0x15	ascii
466	<0xA1>	0.813945	161	0xA1	utf8
491	<0xBA>	0.817005	186	0xBA	utf8
446	<0x8D>	0.817476	141	0x8D	utf8
484	<0xB3>	0.818619	179	0xB3	utf8
487	<0xB6>	0.818636	182	0xB6	utf8
460	<0x9B>	0.818667	155	0x9B	utf8
334	<0x1D>	0.81882	29	0x1D	ascii
493	<0xBC>	0.819513	188	0xBC	utf8
475	<0xAA>	0.819604	170	0xAA	utf8
472	<0xA7>	0.819816	167	0xA7	utf8
336	<0x1F>	0.819821	31	0x1F	ascii
473	<0xA8>	0.819829	168	0xA8	utf8
462	<0x9D>	0.821277	157	0x9D	utf8
530	<0xE1>	0.822505	225	0xE1	utf8
448	<0x8F>	0.823592	143	0x8F	utf8
501	<0xC4>	0.82382	196	0xC4	utf8
483	<0xB2>	0.824086	178	0xB2	utf8
305	<0x00>	0.824226		0x00	ascii
470	<0xA5>	0.826041	165	0xA5	utf8
476	<0xAB>	0.832794	171	0xAB	utf8
437	<0x84>	0.83307	132	0x84	utf8
322	<0x11>	0.83408	17	0x11	ascii
492	<0xBB>	0.836069	187	0xBB	utf8
490	<0xB9>	0.836343	185	0xB9	utf8
482	<0xB1>	0.836849	177	0xB1	utf8
331	<0x1A>	0.837903	26	0x1A	ascii
545	<0xF0>	0.838456	240	0xF0	utf8
486	<0xB5>	0.839525	181	0xB5	utf8
321	<0x10>	0.839854	16	0x10	ascii
465	<0xA0>	0.84131	160	0xA0	utf8
442	<0x89>	0.844234	137	0x89	utf8
488	<0xB7>	0.844564	183	0xB7	utf8
453	<0x94>	0.845005	148	0x94	utf8
480	<0xAF>	0.845483	175	0xAF	utf8
517	<0xD4>	0.84759	212	0xD4	utf8
485	<0xB4>	0.848552	180	0xB4	utf8
320	<0x0F>	0.849728	15	0x0F	ascii
541	<0xEC>	0.849866	236	0xEC	utf8
306	<0x01>	0.850136	1	0x01	ascii
510	<0xCD>	0.852107	205	0xCD	utf8
467	<0xA2>	0.852427	162	0xA2	utf8
511	<0xCE>	0.855196	206	0xCE	utf8
478	<0xAD>	0.856493	173	0xAD	utf8
443	<0x8A>	0.856572	138	0x8A	utf8
516	<0xD3>	0.856794	211	0xD3	utf8
325	<0x14>	0.859763	20	0x14	ascii
330	<0x19>	0.869614	25	0x19	ascii
533	<0xE4>	0.871568	228	0xE4	utf8
518	<0xD5>	0.874385	213	0xD5	utf8
509	<0xCC>	0.876191	204	0xCC	utf8
316	<0x0B>	0.878524	11	0x0B	ascii
502	<0xC5>	0.880253	197	0xC5	utf8
307	<0x02>	0.880965	2	0x02	ascii
432	<0x7F>	0.88208	127	0x7F	ascii
308	<0x03>	0.882248	3	0x03	ascii
540	<0xEB>	0.889554	235	0xEB	utf8
515	<0xD2>	0.89232	210	0xD2	utf8
505	<0xC8>	0.893033	200	0xC8	utf8
543	<0xEE>	0.894053	238	0xEE	utf8
508	<0xCB>	0.90145	203	0xCB	utf8
332	<0x1B>	0.902111	27	0x1B	ascii
519	<0xD6>	0.905941	214	0xD6	utf8
521	<0xD8>	0.906334	216	0xD8	utf8
512	<0xCF>	0.907422	207	0xCF	utf8
507	<0xCA>	0.914556	202	0xCA	utf8
524	<0xDB>	0.915024	219	0xDB	utf8
311	<0x06>	0.915417	6	0x06	ascii
520	<0xD7>	0.917492	215	0xD7	utf8
539	<0xEA>	0.918498	234	0xEA	utf8
317	<0x0C>	0.920217	12	0x0C	ascii
523	<0xDA>	0.924083	218	0xDA	utf8
504	<0xC7>	0.925869	199	0xC7	utf8
310	<0x05>	0.926766	5	0x05	ascii
312	<0x07>	0.928819	7	0x07	ascii
506	<0xC9>	0.930204	201	0xC9	utf8
503	<0xC6>	0.932374	198	0xC6	utf8
542	<0xED>	0.939703	237	0xED	utf8
522	<0xD9>	0.947057	217	0xD9	utf8
142	\x08	0.947346	8	0x08	ascii

Special tokens

175 entries below threshold of 0.168

token_id	token	indicator	reencoded	max_prob
231	<|unused086|>	2.06214e-06	59568: ▁, 231: <|unused086|>	1.1e-05
264	<|unused119|>	2.06355e-06	59568: ▁, 264: <|unused119|>	1.1e-05
156	<|unused011|>	2.07387e-06	59568: ▁, 156: <|unused011|>	1.1e-05
303	<|unused158|>	2.08085e-06	59568: ▁, 303: <|unused158|>	1.1e-05
175	<|unused030|>	2.08087e-06	59568: ▁, 175: <|unused030|>	1.1e-05
3	<|Human|>	2.08177e-06
201	<|unused056|>	2.08644e-06	59568: ▁, 201: <|unused056|>	1.1e-05
157	<|unused012|>	2.08688e-06	59568: ▁, 157: <|unused012|>	1.1e-05
149	<|unused004|>	2.08734e-06	59568: ▁, 149: <|unused004|>	1.1e-05
192	<|unused047|>	2.08973e-06	59568: ▁, 192: <|unused047|>	1.1e-05
224	<|unused079|>	2.09012e-06	59568: ▁, 224: <|unused079|>	1.1e-05
219	<|unused074|>	2.09014e-06	59568: ▁, 219: <|unused074|>	1.1e-05
204	<|unused059|>	2.09244e-06	59568: ▁, 204: <|unused059|>	1.1e-05
218	<|unused073|>	2.0929e-06	59568: ▁, 218: <|unused073|>	1.1e-05
152	<|unused007|>	2.09476e-06	59568: ▁, 152: <|unused007|>	1.1e-05
290	<|unused145|>	2.09752e-06	59568: ▁, 290: <|unused145|>	1.1e-05
164	<|unused019|>	2.10075e-06	59568: ▁, 164: <|unused019|>	1.1e-05
292	<|unused147|>	2.10215e-06	59568: ▁, 292: <|unused147|>	1.1e-05
208	<|unused063|>	2.10261e-06	59568: ▁, 208: <|unused063|>	1.1e-05
185	<|unused040|>	2.10308e-06	59568: ▁, 185: <|unused040|>	1.1e-05

155 additional entries below threshold

token_id	token	indicator	reencoded	max_prob
262	<|unused117|>	2.10399e-06	59568: ▁, 262: <|unused117|>	1.1e-05
242	<|unused097|>	2.104e-06	59568: ▁, 242: <|unused097|>	1.1e-05
301	<|unused156|>	2.10445e-06	59568: ▁, 301: <|unused156|>	1.1e-05
225	<|unused080|>	2.10494e-06	59568: ▁, 225: <|unused080|>	1.1e-05
221	<|unused076|>	2.10535e-06	59568: ▁, 221: <|unused076|>	1.1e-05
191	<|unused046|>	2.10537e-06	59568: ▁, 191: <|unused046|>	1.1e-05
205	<|unused060|>	2.10675e-06	59568: ▁, 205: <|unused060|>	1.1e-05
197	<|unused052|>	2.10719e-06	59568: ▁, 197: <|unused052|>	1.1e-05
190	<|unused045|>	2.10767e-06	59568: ▁, 190: <|unused045|>	1.1e-05
182	<|unused037|>	2.10768e-06	59568: ▁, 182: <|unused037|>	1.1e-05
211	<|unused066|>	2.10811e-06	59568: ▁, 211: <|unused066|>	1.1e-05
210	<|unused065|>	2.10949e-06	59568: ▁, 210: <|unused065|>	1.1e-05
230	<|unused085|>	2.10953e-06	59568: ▁, 230: <|unused085|>	1.1e-05
216	<|unused071|>	2.10996e-06	59568: ▁, 216: <|unused071|>	1.1e-05
155	<|unused010|>	2.10999e-06	59568: ▁, 155: <|unused010|>	1.1e-05
176	<|unused031|>	2.11042e-06	59568: ▁, 176: <|unused031|>	1.1e-05
245	<|unused100|>	2.11132e-06	59568: ▁, 245: <|unused100|>	1.1e-05
195	<|unused050|>	2.11316e-06	59568: ▁, 195: <|unused050|>	1.1e-05
268	<|unused123|>	2.11454e-06	59568: ▁, 268: <|unused123|>	1.1e-05
178	<|unused033|>	2.11639e-06	59568: ▁, 178: <|unused033|>	1.1e-05
171	<|unused026|>	2.11728e-06	59568: ▁, 171: <|unused026|>	1.1e-05
146	<|unused001|>	2.11729e-06	59568: ▁, 146: <|unused001|>	1.1e-05
279	<|unused134|>	2.11729e-06	59568: ▁, 279: <|unused134|>	1.1e-05
159	<|unused014|>	2.11775e-06	59568: ▁, 159: <|unused014|>	1.1e-05
276	<|unused131|>	2.11819e-06	59568: ▁, 276: <|unused131|>	1.1e-05
167	<|unused022|>	2.11866e-06	59568: ▁, 167: <|unused022|>	1.1e-05
263	<|unused118|>	2.11866e-06	59568: ▁, 263: <|unused118|>	1.1e-05
293	<|unused148|>	2.11912e-06	59568: ▁, 293: <|unused148|>	1.1e-05
10	<|reserved004|>	2.11959e-06
271	<|unused126|>	2.12003e-06	59568: ▁, 271: <|unused126|>	1.1e-05
299	<|unused154|>	2.12049e-06	59568: ▁, 299: <|unused154|>	1.1e-05
179	<|unused034|>	2.1205e-06	59568: ▁, 179: <|unused034|>	1.1e-05
209	<|unused064|>	2.1205e-06	59568: ▁, 209: <|unused064|>	1.1e-05
5	<|System|>	2.12093e-06
250	<|unused105|>	2.12186e-06	59568: ▁, 250: <|unused105|>	1.1e-05
220	<|unused075|>	2.12233e-06	59568: ▁, 220: <|unused075|>	1.1e-05
188	<|unused043|>	2.12277e-06	59568: ▁, 188: <|unused043|>	1.1e-05
295	<|unused150|>	2.12321e-06	59568: ▁, 295: <|unused150|>	1.1e-05
234	<|unused089|>	2.12368e-06	59568: ▁, 234: <|unused089|>	1.1e-05
252	<|unused107|>	2.12459e-06	59568: ▁, 252: <|unused107|>	1.1e-05
266	<|unused121|>	2.12504e-06	59568: ▁, 266: <|unused121|>	1.1e-05
163	<|unused018|>	2.12505e-06	59568: ▁, 163: <|unused018|>	1.1e-05
147	<|unused002|>	2.12549e-06	59568: ▁, 147: <|unused002|>	1.1e-05
247	<|unused102|>	2.12549e-06	59568: ▁, 247: <|unused102|>	1.1e-05
248	<|unused103|>	2.12551e-06	59568: ▁, 248: <|unused103|>	1.1e-05
278	<|unused133|>	2.12552e-06	59568: ▁, 278: <|unused133|>	1.1e-05
260	<|unused115|>	2.12595e-06	59568: ▁, 260: <|unused115|>	1.1e-05
261	<|unused116|>	2.12595e-06	59568: ▁, 261: <|unused116|>	1.1e-05
145	<|unused000|>	2.126e-06	59568: ▁, 145: <|unused000|>	1.1e-05
193	<|unused048|>	2.12643e-06	59568: ▁, 193: <|unused048|>	1.1e-05
287	<|unused142|>	2.12686e-06	59568: ▁, 287: <|unused142|>	1.1e-05
11	<|reserved005|>	2.1269e-06
283	<|unused138|>	2.12736e-06	59568: ▁, 283: <|unused138|>	1.1e-05
256	<|unused111|>	2.12824e-06	59568: ▁, 256: <|unused111|>	1.1e-05
239	<|unused094|>	2.12825e-06	59568: ▁, 239: <|unused094|>	1.1e-05
177	<|unused032|>	2.12868e-06	59568: ▁, 177: <|unused032|>	1.1e-05
194	<|unused049|>	2.12869e-06	59568: ▁, 194: <|unused049|>	1.1e-05
233	<|unused088|>	2.12869e-06	59568: ▁, 233: <|unused088|>	1.1e-05
274	<|unused129|>	2.12871e-06	59568: ▁, 274: <|unused129|>	1.1e-05
200	<|unused055|>	2.12913e-06	59568: ▁, 200: <|unused055|>	1.1e-05
238	<|unused093|>	2.12915e-06	59568: ▁, 238: <|unused093|>	1.1e-05
286	<|unused141|>	2.12916e-06	59568: ▁, 286: <|unused141|>	1.1e-05
236	<|unused091|>	2.12959e-06	59568: ▁, 236: <|unused091|>	1.1e-05
269	<|unused124|>	2.12964e-06	59568: ▁, 269: <|unused124|>	1.1e-05
181	<|unused036|>	2.13004e-06	59568: ▁, 181: <|unused036|>	1.1e-05
296	<|unused151|>	2.1305e-06	59568: ▁, 296: <|unused151|>	1.1e-05
9	<|reserved003|>	2.13095e-06
244	<|unused099|>	2.13096e-06	59568: ▁, 244: <|unused099|>	1.1e-05
285	<|unused140|>	2.13096e-06	59568: ▁, 285: <|unused140|>	1.1e-05
169	<|unused024|>	2.13142e-06	59568: ▁, 169: <|unused024|>	1.1e-05
289	<|unused144|>	2.13187e-06	59568: ▁, 289: <|unused144|>	1.1e-05
241	<|unused096|>	2.13233e-06	59568: ▁, 241: <|unused096|>	1.1e-05
282	<|unused137|>	2.13234e-06	59568: ▁, 282: <|unused137|>	1.1e-05
212	<|unused067|>	2.1328e-06	59568: ▁, 212: <|unused067|>	1.1e-05
300	<|unused155|>	2.13324e-06	59568: ▁, 300: <|unused155|>	1.1e-05
12	<|reserved006|>	2.13372e-06
189	<|unused044|>	2.13504e-06	59568: ▁, 189: <|unused044|>	1.1e-05
302	<|unused157|>	2.13506e-06	59568: ▁, 302: <|unused157|>	1.1e-05
222	<|unused077|>	2.13508e-06	59568: ▁, 222: <|unused077|>	1.1e-05
186	<|unused041|>	2.13549e-06	59568: ▁, 186: <|unused041|>	1.1e-05
207	<|unused062|>	2.13641e-06	59568: ▁, 207: <|unused062|>	1.1e-05
253	<|unused108|>	2.13685e-06	59568: ▁, 253: <|unused108|>	1.1e-05
280	<|unused135|>	2.13733e-06	59568: ▁, 280: <|unused135|>	1.1e-05
298	<|unused153|>	2.13735e-06	59568: ▁, 298: <|unused153|>	1.1e-05
162	<|unused017|>	2.13778e-06	59568: ▁, 162: <|unused017|>	1.1e-05
165	<|unused020|>	2.1378e-06	59568: ▁, 165: <|unused020|>	1.1e-05
215	<|unused070|>	2.13824e-06	59568: ▁, 215: <|unused070|>	1.1e-05
158	<|unused013|>	2.13869e-06	59568: ▁, 158: <|unused013|>	1.1e-05
294	<|unused149|>	2.13917e-06	59568: ▁, 294: <|unused149|>	1.1e-05
161	<|unused016|>	2.13958e-06	59568: ▁, 161: <|unused016|>	1.1e-05
265	<|unused120|>	2.14003e-06	59568: ▁, 265: <|unused120|>	1.1e-05
214	<|unused069|>	2.14095e-06	59568: ▁, 214: <|unused069|>	1.1e-05
228	<|unused083|>	2.14095e-06	59568: ▁, 228: <|unused083|>	1.1e-05
240	<|unused095|>	2.14095e-06	59568: ▁, 240: <|unused095|>	1.1e-05
281	<|unused136|>	2.14139e-06	59568: ▁, 281: <|unused136|>	1.1e-05
243	<|unused098|>	2.14184e-06	59568: ▁, 243: <|unused098|>	1.1e-05
235	<|unused090|>	2.14234e-06	59568: ▁, 235: <|unused090|>	1.1e-05
180	<|unused035|>	2.14318e-06	59568: ▁, 180: <|unused035|>	1.1e-05
291	<|unused146|>	2.14318e-06	59568: ▁, 291: <|unused146|>	1.1e-05
229	<|unused084|>	2.14363e-06	59568: ▁, 229: <|unused084|>	1.1e-05
172	<|unused027|>	2.14365e-06	59568: ▁, 172: <|unused027|>	1.1e-05
237	<|unused092|>	2.14409e-06	59568: ▁, 237: <|unused092|>	1.1e-05
183	<|unused038|>	2.14454e-06	59568: ▁, 183: <|unused038|>	1.1e-05
199	<|unused054|>	2.14547e-06	59568: ▁, 199: <|unused054|>	1.1e-05
257	<|unused112|>	2.14547e-06	59568: ▁, 257: <|unused112|>	1.1e-05
153	<|unused008|>	2.14636e-06	59568: ▁, 153: <|unused008|>	1.1e-05
184	<|unused039|>	2.14636e-06	59568: ▁, 184: <|unused039|>	1.1e-05
251	<|unused106|>	2.14679e-06	59568: ▁, 251: <|unused106|>	1.1e-05
259	<|unused114|>	2.14679e-06	59568: ▁, 259: <|unused114|>	1.1e-05
255	<|unused110|>	2.14729e-06	59568: ▁, 255: <|unused110|>	1.1e-05
284	<|unused139|>	2.1477e-06	59568: ▁, 284: <|unused139|>	1.1e-05
275	<|unused130|>	2.14863e-06	59568: ▁, 275: <|unused130|>	1.1e-05
227	<|unused082|>	2.14906e-06	59568: ▁, 227: <|unused082|>	1.1e-05
13	<|reserved007|>	2.14999e-06
206	<|unused061|>	2.15176e-06	59568: ▁, 206: <|unused061|>	1.1e-05
166	<|unused021|>	2.15269e-06	59568: ▁, 166: <|unused021|>	1.1e-05
213	<|unused068|>	2.15271e-06	59568: ▁, 213: <|unused068|>	1.1e-05
297	<|unused152|>	2.15313e-06	59568: ▁, 297: <|unused152|>	1.1e-05
154	<|unused009|>	2.15446e-06	59568: ▁, 154: <|unused009|>	1.1e-05
304	<|unused159|>	2.15446e-06	59568: ▁, 304: <|unused159|>	1.1e-05
1	<|startoftext|>	2.15448e-06		1.1e-05
273	<|unused128|>	2.1549e-06	59568: ▁, 273: <|unused128|>	1.1e-05
168	<|unused023|>	2.15493e-06	59568: ▁, 168: <|unused023|>	1.1e-05
277	<|unused132|>	2.15716e-06	59568: ▁, 277: <|unused132|>	1.1e-05
267	<|unused122|>	2.15761e-06	59568: ▁, 267: <|unused122|>	1.1e-05
198	<|unused053|>	2.1585e-06	59568: ▁, 198: <|unused053|>	1.1e-05
249	<|unused104|>	2.1585e-06	59568: ▁, 249: <|unused104|>	1.1e-05
226	<|unused081|>	2.15856e-06	59568: ▁, 226: <|unused081|>	1.1e-05
150	<|unused005|>	2.15895e-06	59568: ▁, 150: <|unused005|>	1.1e-05
0	<unk>	2.16031e-06		1e-09
170	<|unused025|>	2.16031e-06	59568: ▁, 170: <|unused025|>	1.1e-05
160	<|unused015|>	2.1621e-06	59568: ▁, 160: <|unused015|>	1.1e-05
187	<|unused042|>	2.1621e-06	59568: ▁, 187: <|unused042|>	1.1e-05
173	<|unused028|>	2.16298e-06	59568: ▁, 173: <|unused028|>	1.1e-05
203	<|unused058|>	2.16346e-06	59568: ▁, 203: <|unused058|>	1.1e-05
174	<|unused029|>	2.16523e-06	59568: ▁, 174: <|unused029|>	1.1e-05
217	<|unused072|>	2.16613e-06	59568: ▁, 217: <|unused072|>	1.1e-05
254	<|unused109|>	2.16747e-06	59568: ▁, 254: <|unused109|>	1.1e-05
272	<|unused127|>	2.1679e-06	59568: ▁, 272: <|unused127|>	1.1e-05
270	<|unused125|>	2.16972e-06	59568: ▁, 270: <|unused125|>	1.1e-05
151	<|unused006|>	2.17502e-06	59568: ▁, 151: <|unused006|>	1.1e-05
223	<|unused078|>	2.17552e-06	59568: ▁, 223: <|unused078|>	1.1e-05
202	<|unused057|>	2.17639e-06	59568: ▁, 202: <|unused057|>	1.1e-05
246	<|unused101|>	2.17773e-06	59568: ▁, 246: <|unused101|>	1.1e-05
148	<|unused003|>	2.18129e-06	59568: ▁, 148: <|unused003|>	1.1e-05
258	<|unused113|>	2.18615e-06	59568: ▁, 258: <|unused113|>	1.1e-05
196	<|unused051|>	2.18657e-06	59568: ▁, 196: <|unused051|>	1.1e-05
288	<|unused143|>	2.1963e-06	59568: ▁, 288: <|unused143|>	1.1e-05
232	<|unused087|>	2.19675e-06	59568: ▁, 232: <|unused087|>	1.1e-05
4	<|Assistant|>	2.19853e-06
17	<fim_pad>	0.0422809	59568: ▁, 17: <fim_pad>	0.00029
8	<|im_sep|>	0.051727	59568: ▁, 8: <|im_sep|>	0.0031
15	<fim_middle>	0.0537974	59568: ▁, 15: <fim_middle>	0.015
16	<fim_suffix>	0.0688603	59568: ▁, 16: <fim_suffix>	0.045
14	<fim_prefix>	0.0725533	59568: ▁, 14: <fim_prefix>	0.0099

63 additional entries above threshold

token_id	token	indicator	reencoded	max_prob
45	<h5/>	0.181411	59568: ▁, 45: <h5/>	0.99
7	<|im_end|>	0.185331	59568: ▁, 7: <|im_end|>	0.98
6	<|im_start|>	0.188965	59568: ▁, 6: <|im_start|>	0.95
42	<h4/>	0.197393	59568: ▁, 42: <h4/>	0.98
51	<strong/>	0.227094	59568: ▁, 51: <strong/>	1
36	<h2/>	0.244843	59568: ▁, 36: <h2/>	0.98
33	<h1/>	0.295666	59568: ▁, 33: <h1/>	0.99
66	<tbody/>	0.307798	59568: ▁, 66: <tbody/>	0.99
39	<h3/>	0.319283	59568: ▁, 39: <h3/>	0.98
57	<table/>	0.321673	59568: ▁, 57: <table/>	1
60	<li/>	0.438306	59568: ▁, 60: <li/>	0.92
63	<tr/>	0.443495	59568: ▁, 63: <tr/>
2	<|endoftext|>	0.450428		0.95
75	<td/>	0.454623	59568: ▁, 75: <td/>
72	<b/>	0.458533	59568: ▁, 72: <b/>
69	<img/>	0.498325	59568: ▁, 69: <img/>
118	<!DOCTYPE>	0.500203	59568: ▁, 118: <!DOCTYPE>
23	<jupyter_start>	0.646752	59568: ▁, 23: <jupyter_start>
27	<empty_output>	0.658748	59568: ▁, 27: <empty_output>
70	</img>	0.68689	59568: ▁, 70: </img>
30	<commit_after>	0.690977	59568: ▁, 30: <commit_after>
20	<issue_start>	0.692612	59568: ▁, 20: <issue_start>
26	<jupyter_output>	0.695867	59568: ▁, 26: <jupyter_output>
28	<commit_before>	0.719605	59568: ▁, 28: <commit_before>
25	<jupyter_code>	0.72009	59568: ▁, 25: <jupyter_code>
29	<commit_msg>	0.724762	59568: ▁, 29: <commit_msg>
21	<issue_comment>	0.725438	59568: ▁, 21: <issue_comment>
19	<gh_stars>	0.725465	59568: ▁, 19: <gh_stars>
24	<jupyter_text>	0.73482	59568: ▁, 24: <jupyter_text>
22	<issue_closed>	0.738146	59568: ▁, 22: <issue_closed>
31	<reponame>	0.741276	59568: ▁, 31: <reponame>
68	<img>	0.753617	59568: ▁, 68: <img>
54	<p/>	0.793543	59568: ▁, 54: <p/>
44	<h5>	0.833578	59568: ▁, 44: <h5>
46	</h5>	0.850287	59568: ▁, 46: </h5>
67	</tbody>	0.86196	59568: ▁, 67: </tbody>
40	</h3>	0.867319	59568: ▁, 40: </h3>
53	<p>	0.868269	59568: ▁, 53: <p>
55	</p>	0.87188	59568: ▁, 55: </p>
65	<tbody>	0.876181	59568: ▁, 65: <tbody>
41	<h4>	0.879224	59568: ▁, 41: <h4>
43	</h4>	0.884272	59568: ▁, 43: </h4>
49	</br>	0.900038	59568: ▁, 49: </br>
37	</h2>	0.907272	59568: ▁, 37: </h2>
38	<h3>	0.911196	59568: ▁, 38: <h3>
47	<br>	0.912066	59568: ▁, 47: <br>
35	<h2>	0.912945	59568: ▁, 35: <h2>
50	<strong>	0.91517	59568: ▁, 50: <strong>
61	</li>	0.917043	59568: ▁, 61: </li>
56	<table>	0.919001	59568: ▁, 56: <table>
34	</h1>	0.919437	59568: ▁, 34: </h1>
32	<h1>	0.920249	59568: ▁, 32: <h1>
18	<filename>	0.926584	59568: ▁, 18: <filename>
74	<td>	0.927441	59568: ▁, 74: <td>
58	</table>	0.927691	59568: ▁, 58: </table>
73	</b>	0.927884	59568: ▁, 73: </b>
76	</td>	0.929205	59568: ▁, 76: </td>
48	<br/>	0.932371	59568: ▁, 48: <br/>
52	</strong>	0.932788	59568: ▁, 52: </strong>
62	<tr>	0.934037	59568: ▁, 62: <tr>
71	<b>	0.935849	59568: ▁, 71: <b>
59	<li>	0.938451	59568: ▁, 59: <li>
64	</tr>	0.943595	59568: ▁, 64: </tr>

Unreachable tokens

3 entries below threshold of 0.168

token_id	token	indicator	reencoded
23924	毛泽东	2.09755e-06	60614: 毛, 61198: 泽, 59953: 东
42021	并按对方当事人的人数	2.10676e-06	30297: 并按, 35972: 对方当事人, 26853: 的人数
41880	判决书送达之日起十五日内	2.14409e-06	22549: 判决书, 36139: 送达之日起, 35659: 十五日内

1 additional entries above threshold

token_id	token	indicator	reencoded
115	<!--	0.862258	59568: ▁, 115: <!--