EleutherAI_gpt_j_6b.md

Report for EleutherAI/gpt-j-6b

Model info

• Model Info:
  • Tied embeddings: False
  • LM head uses bias: True
  • Embeddings shape: [50400, 4096]
• Tokenizer Info:
  • Vocab Size: 50400
  • Tokenizer Class: GPT2Tokenizer
  • Tokenizer Type: BPE
  • Bytes handling: Byte Input
  • Token for verification prompt building: BuyableInstoreAndOnline
  • Token id for verification prompt building: 40242
• Indicator summary:
  • Indicator for under-trained tokens: E_{in} L2 Norm
  • Overall distribution: 1.988 +/- 0.024
• Detected Token Counts:
  • Number of tested under-trained tokens: 1002, 848 non-special, 57 below p = 0.01 threshold, 43 below soft indicator threshold
  • Number of single byte tokens: 256, of which 13 below indicator threshold
  • Number of special tokens: 0, of which 0 below indicator threshold
  • Number of non-single-byte UTF-fragment tokens: 216, of which 0 below soft indicator threshold

Under-trained token indicators plot

Verification plot

Under-trained token verification results

43 entries below threshold of 1.746

token_id	token	indicator	max_prob	in_other_tokens
35207	▁attRot	1.73979	3.5e-07
30212	▁externalToEVA	1.74024	2.6e-07	▁externalToEVAOnly
43177	EStreamFrame	1.74029	1.2e-06
36173	▁RandomRedditor	1.74061	3e-07	▁RandomRedditorWithNo
28666	PsyNetMessage	1.7407	2.8e-07
43453	▁SolidGoldMagikarp	1.74072	4e-07
46600	▁Adinida	1.74076	3.5e-07
36174	▁RandomRedditorWithNo	1.74081	3.3e-07
30899	cloneembedreportprint	1.74082	4.2e-07	rawdownloadcloneembedreportprint
40240	oreAndOnline	1.74089	2.7e-07	BuyableInstoreAndOnline, InstoreAndOnline
40241	InstoreAndOnline	1.74101	2.9e-07	BuyableInstoreAndOnline
23282	▁davidjl	1.7411	2.5e-07
42090	▁TheNitromeFan	1.74112	2.8e-07
42089	▁TheNitrome	1.74114	3.5e-07	▁TheNitromeFan
42586	▁srfN	1.74137	3.1e-07
30898	embedreportprint	1.74152	3.5e-07	rawdownloadcloneembedreportprint, cloneembedreportprint
42202	GoldMagikarp	1.74159	3.1e-07	▁SolidGoldMagikarp
37574	StreamerBot	1.74164	3.1e-07	TPPStreamerBot
39253	▁UCHIJ	1.74174	2.1e-05
47571	▁DevOnline	1.74178	1.6e-07

23 additional entries below threshold

token_id	token	indicator	max_prob	in_other_tokens
30906	rawdownloadcloneembedreportprint	1.74191	2.6e-07
45544	▁サーティ	1.74195	9.9e-07	▁サーティワン
41551	Downloadha	1.74198	1.3e-06
32437	▁Smartstocks	1.74226	7.1e-07
30905	rawdownload	1.74229	3.9e-07	rawdownloadcloneembedreportprint
30213	▁externalToEVAOnly	1.74235	1e-06
29372	▁guiActiveUn	1.74274	6.5e-07	▁guiActiveUnfocused
30209	▁unfocusedRange	1.74293	8.7e-06
30210	▁guiActiveUnfocused	1.74293	0.00011
39752	quickShip	1.74342	0.00091	quickShipAvailable
31666	?????-?????-	1.74351	7.6e-06
42424	DragonMagazine	1.74375	4.3e-08
25992	▁裏覚醒	1.74388	2.9e-05
39821	龍契士	1.74467	0.0031
50009	▁strutConnector	1.74469	0.0035
39755	isSpecialOrderable	1.7447	0.0013
37579	TPPStreamerBot	1.74501	5.5e-05
36938	▁sqor	1.74507	8.5e-07
30897	reportprint	1.74513	6.4e-05	embedreportprint, rawdownloadcloneembedreportprint, cloneembedreportprint
30211	▁guiIcon	1.74551	0.00064
39811	soDeliveryDate	1.74559	1.2e-05
45545	▁サーティワン	1.7457	6.9e-06
39757	channelAvailability	1.74597	0.0021

805 additional entries above threshold

token_id	token	indicator	max_prob	in_other_tokens
40242	BuyableInstoreAndOnline	1.74614	0.005
23090	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ	1.7464	0.66	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ
36935	▁dstg	1.74641	0.5
41383	assetsadobe	1.7465	0.0016
41380	natureconservancy	1.74842	0.013
38370	iHUD	1.74881	0.38
39753	quickShipAvailable	1.74926	8.6e-06
36940	▁istg	1.75034	0.0083
9364	ÃÂÃÂÃÂÃÂ	1.75121	0.33	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ
18472	▁guiActive	1.75175	0.086	▁guiActiveUnfocused, ▁guiActiveUn
39177	ItemThumbnailImage	1.75324	0.041
30208	▁externalTo	1.75368	8.7e-05	▁externalToEVAOnly, ▁externalToEVA
33454	龍喚士	1.75368	0.89
14827	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ	1.75372	0.3	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ
39756	inventoryQuantity	1.7548	0.36
35579	▁Mechdragon	1.75563	0.00024
38250	▁Skydragon	1.75586	0.016
37444	▁petertodd	1.7599	0.0044
35496	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ	1.76041	0.99
24934	ForgeModLoader	1.76041	0.43
47198	ItemTracker	1.76081	0.95
42066	Nitrome	1.76198	0.98	▁TheNitromeFan, ▁TheNitrome
32047	▁"$:/	1.76302	0.2
17900	▁Dragonbound	1.76631	0.37
5815	ÃÂÃÂ	1.76861	0.94	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ
30202	▁guiName	1.76925	0.08
42728	▁largeDownload	1.76962	0.00064
31765	MpServer	1.77077	0.68
37631	FactoryReloaded	1.77536	0.02
31032	SpaceEngineers	1.77781	0.9
31957	cffffcc	1.78075	0.97
36130	▁PsyNet	1.78255	0.84
34448	▁ItemLevel	1.783	0.93
43038	▁Okawaru	1.78335	0.99
12781	wcsstore	1.78653	0.86
49781	EngineDebug	1.78677	0.99
43361	ゼウス	1.78678	0.84
39693	Buyable	1.78704	0.99	BuyableInstoreAndOnline
39446	▁SetFontSize	1.78779	0.91
39906	EStream	1.79042	0.97	EStreamFrame
40219	oreAnd	1.79376	0.39	oreAndOnline, BuyableInstoreAndOnline, InstoreAndOnline
50216	▁Leilan	1.79398	0.44
41297	▁TAMADRA	1.79584	0.56
48396	ÛÛ	1.79727	0.99
30684	▁ⓘ	1.79862	0.96
30439	▁unintention	1.79901	0.031	▁unintentional, ▁unintentionally
43065	▁srfAttach	1.79921	0.00014
34027	▁actionGroup	1.80079	1
33813	=~=~	1.80252	0.99
25658	?????-	1.80417	0.96	?????-?????-
24847	ModLoader	1.80525	0.99	ForgeModLoader
27006	¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯	1.80525	0.87
43569	ÍÍ	1.80555	0.99
15243	¯¯¯¯¯¯¯¯	1.80602	0.95	¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯
40012	uyomi	1.80617	0.51	▁Tsukuyomi
34206	#$#$	1.80637	0.57
39165	catentry	1.80643	0.58
49731	▁EntityItem	1.80859	0.97
44555	▁Archdemon	1.80935	0.9
10298	senal	1.80947	0.96	Arsenal, ▁Arsenal, ▁arsenal
4690	ortunately	1.81268	0.063	▁Unfortunately, ▁Fortunately, ▁fortunately, Fortunately, Unfortunately, ...
36481	ertodd	1.81272	0.31	▁petertodd
25618	▁councill	1.81519	0.98	▁councillor, ▁councillors
8980	¯¯¯¯	1.81606	0.98	¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯, ¯¯¯¯¯¯¯¯
42889	ikuman	1.81735	0.22	▁Kinnikuman
41538	Magikarp	1.81861	0.99	▁SolidGoldMagikarp, GoldMagikarp
13198	▁earthqu	1.82074	0.82	▁earthquake, ▁earthquakes
27013	aditional	1.82149	0.99	▁Traditional, traditional, Traditional
36926	▁attm	1.82196	0.92
43010	▁Kinnikuman	1.82433	0.99
31576	externalActionCode	1.82442	3.5e-05
6438	▁裏	1.82523	0.99	▁裏<0xE8>, ▁裏<0xE7>, ▁裏覚醒
18945	▁teasp	1.82528	0.9	▁teaspoons, ▁teaspoon
12677	▁tradem	1.82533	0.92	▁trademarks, ▁trademark
17629	▁practition	1.8257	0.51	▁practitioner, ▁practitioners
7105	▁volunte	1.82713	0.47	▁volunteers, ▁volunteer, ▁volunteered, ▁volunteering
31886	▁gmaxwell	1.82796	0.78
25193	NetMessage	1.82803	0.95	PsyNetMessage
20554	▁unbeliev	1.82829	0.28	▁unbelievably, ▁unbelievable
13150	▁subur	1.82876	0.98	▁suburban, ▁suburbs, ▁suburb
4060	vertisement	1.82923	0.96	Advertisement, ▁Advertisement, Advertisements, ▁advertisements, ▁advertisement, ...
5808	ÃÂ	1.83042	0.99	ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂ, ÃÂÃÂ, ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ, ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ
31573	ActionCode	1.83091	0.99	externalActionCode
11974	▁Tradable	1.83182	0.93
48193	@#&	1.8321	0.98
37842	▁partName	1.83692	0.98
45003	▁SetTextColor	1.83818	0.4
45392	dayName	1.84113	0.95
22315	▁newcom	1.8423	0.99	▁newcomers, ▁newcomer
24307	▁looph	1.84249	0.85	▁loopholes, ▁loophole
14695	▁eleph	1.84376	0.99	▁elephant, ▁elephants
11273	▁enthusi	1.84405	0.4	▁enthusiastically, ▁enthusiastic, ▁enthusiast, ▁enthusiasts, ▁enthusiasm
39749	DeliveryDate	1.84466	0.98	soDeliveryDate
48416	▁shenan	1.84638	0.94	▁shenanigans
41215	conservancy	1.84877	0.91	natureconservancy
29646	▁gobl	1.84893	1	▁goblin, ▁goblins
8755	▁Awoken	1.85007	1
49997	ahime	1.8504	0.93
47614	▁Nanto	1.85117	0.97
47975	bleacher	1.85181	0.95
33929	shapeshifter	1.85184	0.97
11548	▁entreprene	1.85277	0.79	▁entrepreneurs, ▁entrepreneurship, ▁entrepreneurial, ▁entrepreneur
48366	◼	1.85288	0.99
27293	▁antidepress	1.85373	0.78	▁antidepressant, ▁antidepressants
34604	\\\\\\\\\\\\\\\\	1.85474	1
32917	aution	1.8548	0.97	▁cautioned, ▁precaution
41230	govtrack	1.85486	0.89
48404	ruciating	1.85493	0.26	▁excruciating
34832	Redditor	1.85675	1	▁RandomRedditorWithNo, ▁RandomRedditor
28235	aeper	1.85743	0.99	▁Kaepernick, aepernick
39008	awaru	1.85909	0.97	▁Okawaru
34473	ヘラ	1.8604	0.99
46858	▁Canaver	1.86066	0.97	▁Canaveral
37389	▁��������	1.86135	0.97
40516	▒	1.86194	0.99
43796	▁Tsukuyomi	1.86207	0.99
45563	ⓘ	1.86223	0.91
44392	▁cumbers	1.86227	0.99	▁cumbersome
15040	byss	1.86277	0.94	▁Abyssal, Abyss, ▁abyss, ▁Abyss
48527	76561	1.86324	1
16782	▁misunder	1.86406	0.78	▁misunderstand, ▁misunderstood, ▁misunderstanding
15685	▁Reincarnated	1.86446	0.98
3523	▁citiz	1.86508	1	▁citizenship, ▁citizen, ▁citizens
23711	▁Moroc	1.86516	0.99	▁Moroccan, ▁Morocco
12662	▁Citiz	1.86555	0.97	▁Citizens, ▁Citizenship, ▁Citizen
11689	▁unnecess	1.86671	0.56	▁unnecessary, ▁unnecessarily
39803	soType	1.86678	0.24
39142	ThumbnailImage	1.86685	0.97	ItemThumbnailImage
27674	DonaldTrump	1.86727	0.97	realDonaldTrump
13296	▁Leban	1.86774	0.98	▁Lebanese, ▁Lebanon
33023	hovah	1.86825	0.89	▁Jehovah
47936	20439	1.8694	0.96
12869	▁reluct	1.86978	0.86	▁reluctant, ▁reluctance, ▁reluctantly
13171	VIDIA	1.87024	0.44	▁NVIDIA, NVIDIA
37545	▁Sakuya	1.87049	1
21876	▁showc	1.87086	0.99	▁showcased, ▁showcases, ▁showcasing
6598	▁behavi	1.87088	0.74	▁behavioural, ▁behaviour, ▁behavioral, ▁behaviors, ▁behaving, ...
39655	Orderable	1.87208	0.98	isSpecialOrderable
50113	.''.	1.87263	0.96
49813	▁Flavoring	1.87265	0.96
39714	isSpecial	1.87327	0.9	isSpecialOrderable
35098	ㅋ	1.87446	0.93	ㅋㅋ
16303	▁undermin	1.87448	0.92	▁undermined, ▁undermine, ▁undermining, ▁undermines
26825	▁����	1.8746	0.94	▁��������
42311	arnaev	1.87468	0.84	▁Tsarnaev
20677	▁comr	1.87536	0.98	▁comrades, ▁comrade
11727	▁helicop	1.87542	1	▁helicopter, ▁helicopters
46222	▁UNCLASSIFIED	1.87594	1
9286	▁exha	1.87701	0.99	▁exhaust, ▁exhausting, ▁exhaustive, ▁exhausted, ▁exhaustion
14341	PDATE	1.87706	0.99	PDATED, ▁UPDATE, UPDATE
27534	░░	1.87713	0.99
31881	steamapps	1.87723	0.99
43735	.」	1.87827	0.96
20590	▁Pengu	1.87913	0.99	▁Penguin, ▁Penguins
2941	ccording	1.87914	0.15	▁accordingly, ▁Accordingly, ▁According, according, According
11966	▁Marketable	1.87938	0.94
47182	":""},{"	1.87962	0.7
47021	▁Chocobo	1.8797	0.91
19476	▁carbohyd	1.87978	1	▁carbohydrate, ▁carbohydrates
35818	▁Carbuncle	1.88066	0.94
8994	ailability	1.88085	0.86	availability, ▁Availability, channelAvailability, ▁availability, Availability
40415	GGGGGGGG	1.88109	0.98
40236	FINEST	1.88154	0.98
36929	▁sidx	1.88204	0.97
15272	▁pione	1.88249	0.89	▁pioneering, ▁pioneered, ▁pioneer, ▁pioneers
38653	▁Strongh	1.88278	0.99	▁Stronghold
17473	▁contrace	1.88335	0.98	▁contraceptive, ▁contraceptives, ▁contraception
44546	▁Magicka	1.88339	0.99
36726	Reloaded	1.88345	1	FactoryReloaded
42543	▁Seym	1.88378	0.99	▁Seymour
14560	▁disadvant	1.88413	0.95	▁disadvantages, ▁disadvantage, ▁disadvantaged
8438	everal	1.88427	0.99	Several, ▁Several
38626	▓	1.88439	1
2432	▁weap	1.88442	0.99	▁weapons, ▁weapon, ▁weaponry
12943	▁encount	1.88442	1	▁encountered, ▁encountering, ▁encounters
10269	umbn	1.8851	0.88	ThumbnailImage, ItemThumbnailImage, ▁thumbnail, umbnail, umbnails, ...
32207	▁warr	1.88547	1	▁warranted, ▁warranties
6533	ometimes	1.8856	0.61	Sometimes, sometimes, ▁Sometimes
25502	ItemImage	1.88566	1
7782	▁occas	1.88655	0.96	▁occasional, ▁occasions, ▁occasionally
31727	cffff	1.88658	0.92	cffffcc
10658	taboola	1.8867	0.99
24973	▁exting	1.88679	0.9	▁extinguished, ▁extingu
33937	Vaults	1.88776	0.99
29740	▁Azerb	1.88804	0.97	▁Azerbaijan, ▁Azerbai
27924	▁srf	1.88834	0.99	▁srfN, ▁srfAttach
2887	acebook	1.88845	1	▁Facebook, ▁facebook, Facebook, facebook
45706	▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0	1.88864	0.96
30716	▁cannabin	1.88908	0.99	▁cannabinoids, ▁cannabinoid
47682	,,,,,,,,	1.8893	0.99
47530	▬	1.88984	0.98	▬▬
47981	▁Shinra	1.89107	0.99
42382	Depths	1.89123	1
30856	▁Vaugh	1.89274	1	▁Vaughan, ▁Vaughn
43246	akeru	1.89319	0.99	▁Takeru
41504	farious	1.89417	0.36	▁nefarious
34633	の魔	1.89425	0.31
37642	ocobo	1.89467	0.49	▁Chocobo
30762	▁metic	1.89495	0.99	▁meticulously, ▁meticulous
48080	▁Frieza	1.8951	0.99
16166	▁lineback	1.89583	0.87	▁linebacker, ▁linebackers
22110	░	1.89636	0.99	░░
6336	▁Palestin	1.89638	0.91	▁Palestine, ▁Palestinian, ▁Palestinians
19227	avorite	1.89697	0.94	favorite, ▁Favorite, Favorite
49267	▁Pwr	1.89712	0.99
39890	jriwal	1.89772	0.0096	▁Kejriwal
9065	▁taxp	1.89783	1	▁taxpayers, ▁taxpayer
23614	覚醒	1.89798	0.98	▁裏覚醒
5367	¯¯	1.898	1	¯¯¯¯, ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯, ¯¯¯¯¯¯¯¯
31538	actionDate	1.89822	0.98
22640	itially	1.89827	0.78	▁Initially, Initially
15755	▁millenn	1.89849	0.94	▁millennials, ▁millennial, ▁millennia, ▁millennium
6681	▁withd	1.89878	0.97	▁withdrawn, ▁withdrew, ▁withdrawal, ▁withdrawing, ▁withdrawals, ...
25926	▁Unloaded	1.89932	0.95
36119	querque	1.89939	0.74	buquerque, ▁Albuquerque
21117	▁Jagu	1.8994	0.99	▁Jaguar, ▁Jaguars
45199	▁fixme	1.89943	0.98
43491	paio	1.89974	0.98	▁Arpaio
48908	▁4090	1.90022	0.99
48497	▁Takeru	1.9003	0.98
36406	ONSORED	1.90084	0.0042	SPONSORED
38448	ichick	1.90113	0.67	▁Belichick
45228	uliffe	1.90119	0.044	▁McAuliffe
4010	▁challeng	1.90164	0.97	▁challenger, ▁challenges, ▁challenge, ▁challengers, ▁challenging, ...
18356	▁opio	1.9021	0.98	▁opioids, ▁opioid
20532	▁livest	1.90216	0.96	▁livestream, ▁livestock
35144	▁Izan	1.90218	0.99
36473	luaj	1.90237	0.99
31536	displayText	1.90239	0.96
7601	▁proport	1.90273	0.85	▁proportion, ▁proportional, ▁proportions
48448	iosyn	1.90276	0.7	iosyncr, ▁idiosyncr
20036	▁resil	1.90309	1	▁resilience, ▁resilient
17787	▁cryst	1.90319	1	▁crystals, ▁crystall
36408	iannopoulos	1.9038	0.98	▁Yiannopoulos
42943	?」	1.90381	0.98
5571	▁acknow	1.90383	0.92	▁acknowledgment, ▁acknowledge, ▁acknowledgement, ▁acknowled, ▁acknowledges, ...
22316	▁detrim	1.90454	0.99	▁detrimental, ▁detriment
37068	▁Yanuk	1.90455	0.97	▁Yanukovych
6043	▁newsp	1.90474	0.99	▁newspaper, ▁newspapers
49339	▁Gleaming	1.90479	0.99
50248	…."	1.9053	0.78
9841	irlf	1.9054	0.88	girlfriend, irlfriend, ▁girlfriend, ▁girlfriends
32571	▁Rohing	1.90549	0.96	▁Rohingya
41868	▁Cosponsors	1.90574	0.86
49324	potion	1.90575	1
35913	▁Debor	1.90582	1	▁Deborah
22263	▁mosqu	1.9062	0.98	▁mosques, ▁mosquito, ▁mosquit, ▁mosquitoes
7677	▁ingred	1.90674	1	▁ingredients, ▁ingredient
11910	ngth	1.90677	0.99	▁wavelength, ▁Length, velength, ▁strengthens, strength, ...
10882	▁lapt	1.90683	0.99	▁laptops, ▁laptop
11585	eatures	1.90693	0.99	features, Features, ▁Creatures, ▁Features
39021	HAHAHAHA	1.90781	0.99
5997	sembly	1.90852	0.5	▁Assembly, Assembly, ▁assembly, assembly
22997	ゴン	1.90871	0.98	ドラゴン
41386	Poké	1.90877	0.98	Pokémon
32288	regor	1.90895	0.95	▁McGregor
33717	>>>>>>>>	1.90939	0.99
36581	reddits	1.90946	1	▁subreddits
28268	racuse	1.90956	0.054	▁Syracuse
11833	▁sovere	1.90958	0.98	▁sovereignty, ▁sovereign
2698	▁laun	1.91002	0.99	▁laundry, ▁launchers, ▁launcher, ▁launch, ▁launched, ...
42558	▁Mehran	1.91011	0.98
41100	HHHH	1.91011	0.99
27584	=-=-=-=-	1.91027	0.98	=-=-=-=-=-=-=-=-
13177	▁nodd	1.91035	1	▁nodding, ▁nodded
37991	@@@@@@@@	1.91073	0.97
21807	\\\\\\\\	1.9113	0.94	\\\\\\\\\\\\\\\\
45449	CLASSIFIED	1.91132	1	▁UNCLASSIFIED
9468	▁welf	1.91143	0.99	▁welfare
24710	oldemort	1.91188	0.16	▁Voldemort
24731	ドラゴン	1.91202	0.97
47400	risome	1.91217	0.63	▁worrisome
27097	-+-+	1.91229	0.98	-+-+-+-+
12100	����	1.91234	0.98	▁��������, ▁����
49409	▁Parables	1.91264	0.98
16323	▁glim	1.91271	1	▁glimpse, ▁glimps
9882	▁neighb	1.91293	0.99	▁neighbourhoods, ▁neighborhoods, ▁neighbouring, ▁neighboring, ▁neighbourhood, ...
33725	▁Saiyan	1.91309	0.99
43053	▁+#	1.9136	0.83
38894	▁Metatron	1.91407	1
44051	▁Clicker	1.91424	0.98
45123	▁Abyssal	1.91449	0.99
3569	▁strugg	1.9146	0.98	▁struggle, ▁struggles, ▁struggling, ▁struggled
22686	▁\xa0▁\xa0▁\xa0▁\xa0	1.9146	0.95	▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0
34901	▁Cth	1.91479	0.97	▁Cthulhu
48702	iosyncr	1.91501	0.72	▁idiosyncr
6987	▁therap	1.91504	1	▁therapists, ▁therapeutic, ▁therapist, ▁therapies, ▁therapy, ...
15038	▁seiz	1.91523	0.98	▁seizures, ▁seizure, ▁seize, ▁seizing
27733	▁dracon	1.91542	0.99	▁draconian
40345	ㅋㅋ	1.91568	0.95
26575	▁quir	1.91584	1	▁quirks, ▁quirky
12486	▁suspic	1.9159	0.99	▁suspicions, ▁suspicious, ▁suspicion
3587	atever	1.91594	0.83	▁whatever, ▁Whatever, Whatever, whatever
16080	▁corrid	1.91601	0.98	▁corridors, ▁corridor
38790	jri	1.91609	1	▁Kejriwal, jriwal
28333	aepernick	1.91622	0.13	▁Kaepernick
24794	aaaa	1.91625	0.99
36850	ikarp	1.91645	0.87	▁SolidGoldMagikarp, GoldMagikarp, Magikarp
40235	姫	1.91645	0.99
46939	;;;;;;;;;;;;	1.91661	0.99
42530	estyles	1.91705	0.94	▁lifestyles
23764	▁unpop	1.91726	0.98	▁unpopular
2955	▁behav	1.91728	0.98	▁behavioural, ▁behaves, ▁behaved, ▁behaviour, ▁behavioral, ...
45664	mbuds	1.9174	0.35	mbudsman
15790	mercial	1.91748	1	Commercial, ▁commercials, ▁commercially, commercial, ▁Commercial
19306	▁prosec	1.91748	0.94	▁prosecutions, ▁prosecute, ▁prosecuting, ▁prosecuted
14077	▁artif	1.91788	0.99	▁artifacts, ▁artific, ▁artificially, ▁artifact
48318	▁Swordsman	1.9182	0.99
37156	▁Chero	1.91825	1	▁Cherokee
19331	▁reconc	1.91834	0.96	▁reconciliation, ▁reconcil, ▁reconcile
44912	▁..............	1.91835	0.99
27570	▁dissatisf	1.91849	0.99	▁dissatisfied, ▁dissatisfaction
2549	ournal	1.91866	0.99	Journal, ▁Journalism, ournals, ▁journals, ▁journal, ...
31783	▁BaseType	1.91868	0.99
10864	iverpool	1.91882	0.052	▁Liverpool, Liverpool
39910	▁horrend	1.91884	0.95	▁horrendous
23305	▁notor	1.91906	0.98	▁notoriously, ▁notoriety
24376	XXXX	1.91907	0.99
16822	=-=-	1.91908	0.97	=-=-=-=-=-=-=-=-, =-=-=-=-
26712	▁unden	1.91917	0.65	▁undeniable, ▁undeniably
49135	oooooooooooooooo	1.91917	0.99
23613	▁Crossref	1.91929	0.96
22675	@@@@	1.91935	0.99	@@@@@@@@
41974	accompan	1.91945	0.99	▁accompanies, ▁unaccompanied, accompanied
8360	nesota	1.91949	0.5	Minnesota, ▁Minnesota
11480	iversal	1.91955	0.88	Universal, universal, ▁universally, ▁Universal
30667	▁Learns	1.91956	0.96
31954	▁egreg	1.91965	1	▁egregious
46968	▁convol	1.91969	1	▁convoluted
15020	incinn	1.91975	0.87	▁Cincinnati, incinnati
25348	▁charism	1.91985	0.92	▁charismatic, ▁charisma
42000	▁hemor	1.9199	0.99	▁hemorrh
24466	emort	1.92028	0.75	oldemort, ▁Voldemort
43903	ptives	1.92037	0.48	▁captives, ▁contraceptives
49843	▬▬	1.92049	0.98
16148	▁unlaw	1.92067	0.79	▁unlawfully, ▁unlawful
28394	▁Siber	1.92094	1	▁Siberian, ▁Siberia
15083	▁Reincarn	1.92125	0.99	▁Reincarnated
6976	▁athlet	1.92157	0.95	▁athlete, ▁athletes, ▁athletics, ▁athleticism, ▁athletic
19373	▁adolesc	1.92179	0.95	▁adolescence, ▁adolescents, ▁adolescent
45528	▁Adin	1.92185	0.99	▁Adinida
25549	umbledore	1.92194	0.76	▁Dumbledore
45281	▁Gohan	1.92195	1
39500	osponsors	1.92222	0.057	▁Cosponsors
28924	▁Thumbnails	1.9225	0.99
8485	▁enthus	1.92273	0.88	▁enthusiastically, ▁enthusiastic, ▁enthusiast, ▁enthusiasts, ▁enthusiasm, ...
36296	▁drip	1.9228	1	▁dripping
42565	▁Adamant	1.9228	1
45358	▁GamerGate	1.92313	0.98
12054	▁scrut	1.92316	1	▁scrutiny, ▁scrutin
48505	Ire	1.92343	0.99	Ireland
46654	ukong	1.92344	0.96
37337	▁Gamergate	1.92347	0.99
3786	▁disapp	1.92351	1	▁disapprove, ▁disappeared, ▁disappear, ▁disappointed, ▁disappro, ...
20645	▁dilig	1.92352	1	▁diligent, ▁diligently, ▁diligence
36490	00200000	1.9237	0.99
37380	▁Mahjong	1.92374	0.98
8795	iscons	1.92385	0.97	▁Wisconsin, isconsin, Wisconsin
11039	▁tremend	1.92391	0.91	▁tremendous, ▁tremendously
32310	sbm	1.92416	0.99
39827	enfranch	1.9242	0.96	▁disenfranch
34516	>>\	1.92427	0.99
16892	▁rall	1.92447	1	▁rallied, ▁rallying, ▁rallies
8816	isconsin	1.92453	0.36	▁Wisconsin, Wisconsin
36862	EMOTE	1.92458	0.98
38693	▁Beir	1.9247	1	▁Beirut
19640	▁plag	1.92481	1	▁plagued, ▁plagiar, ▁plague
3207	▁thous	1.92482	0.96	▁thousand, ▁thousands
43233	▁Ambro	1.92485	0.99	▁Ambrose
44326	ーテ	1.925	0.85	▁サーティワン, ーティ, ▁サーティ
28798	▁tsun	1.92518	0.96	▁tsunami
40517	ADRA	1.9252	0.96	▁TAMADRA
28794	qqa	1.92526	1	▁Raqqa
39394	▁Fenrir	1.92527	1
10160	▁trave	1.92533	0.97	▁traveling, ▁travelers, ▁travers, ▁traveled, ▁travels, ...
26911	▁snipp	1.92548	0.99	▁snippets, ▁snippet
18589	▁Roose	1.92557	1	▁Roosevelt
30360	dyl	1.92584	0.99	dylib
12426	▁sophistic	1.92597	0.98	▁sophisticated, ▁sophistication
32021	▁GOODMAN	1.92599	0.99
48995	milo	1.92599	0.99
43394	▁CLSID	1.92601	0.99
45335	aterasu	1.9261	0.32
21477	▁Sorce	1.92619	1	▁Sorcerer, ▁Sorceress
41020	▁Okin	1.92632	0.99	▁Okinawa
48069	*=-	1.92633	0.94
38326	▁0004	1.92643	0.86
45140	▁Gerr	1.9266	0.99	▁Gerrard
12731	▁horr	1.92662	0.99	▁horrendous, ▁horrifying, ▁horrors, ▁horrified, ▁horribly, ...
22077	▁anecd	1.92679	0.99	▁anecdotal, ▁anecdote, ▁anecdotes
48147	▁Luffy	1.92682	0.98
5785	▁veter	1.92684	0.95	▁veterinarian, ▁veterans, ▁veterinary, ▁veterin, ▁veteran
45672	▁Zup	1.9269	0.99
27038	▁dismant	1.92704	0.98	▁dismantled, ▁dismantle, ▁dismantling
29582	▁Pastebin	1.92711	0.99
22621	▁Zot	1.92712	1
33615	▁Notting	1.92713	1	▁Nottingham
18686	▁juven	1.92729	1	▁juveniles, ▁juvenile
28935	▁Volunte	1.92729	1	▁Volunteer, ▁Volunteers
2477	▁agre	1.92745	0.99	▁agreeable, ▁agrees, ▁agreement, ▁agreements, ▁agreeing, ...
40561	apego	1.92752	0.92	▁scapego
8911	anchester	1.92753	0.94	▁Manchester, Manchester
16103	▁oun	1.92758	0.99	▁ounces, ▁ounce
47418	Winged	1.92761	0.99
33219	▁Tuls	1.92764	1	▁Tulsa
20290	▁Antar	1.92771	1	▁Antarctica, ▁Antarctic
13757	▁disg	1.9279	0.99	▁disgust, ▁disguise, ▁disgusted, ▁disguised, ▁disgr, ...
39691	acly	1.92792	0.99	aclysm
21451	▁blat	1.92797	1	▁blatant, ▁blatantly
36828	ulhu	1.92811	0.39	▁Cthulhu
33542	▁Riy	1.92817	1	▁Riyadh
39222	▁Haku	1.92823	1
30929	slaught	1.92828	0.84	▁manslaughter, ▁onslaught, ▁slaughtered
34775	▁Gained	1.92841	0.99
1977	▁toget	1.92842	0.97	▁together
37859	paralleled	1.92851	0.99	▁unparalleled
42239	▁Kardash	1.92857	0.99	▁Kardashian
33784	udicrous	1.92867	0.56	▁ludicrous
49527	████████	1.92871	0.94
5271	▁advoc	1.92874	1	▁advocated, ▁advocating, ▁advocates, ▁advocate, ▁advocacy
46385	▁…"	1.92879	0.93
38010	▁Inquis	1.92879	0.99	▁Inquisition, ▁Inquisitor
32157	▁scrim	1.92881	1	▁scrimmage
43298	userc	1.92882	0.99	usercontent
26642	tnc	1.92892	0.99
15263	aukee	1.92897	0.78	▁Milwaukee, waukee
32846	▁reperc	1.92911	0.99	▁repercussions
20503	████	1.92912	0.98	████████
15041	oldown	1.92921	0.89	Cooldown, ▁Cooldown, ▁cooldown
8809	abama	1.92923	0.83	▁Alabama, Alabama
7450	▁recip	1.92927	1	▁recipients, ▁recipient, ▁reciprocal, ▁reciproc, ▁recipes, ...
9789	▁Eag	1.92933	1	▁Eagle, ▁Eagles
34121	▁Norn	1.92935	0.99
43077	▁Grimoire	1.92951	1
22227	▁hurd	1.92982	1	▁hurdles, ▁hurdle
38271	aucuses	1.92983	0.98	▁caucuses
36607	hhhh	1.92983	0.99
12241	▁horm	1.9299	1	▁hormone, ▁hormones, ▁hormonal
21314	▁Vaults	1.93011	0.99
40262	▁Kirin	1.93016	1
29047	maxwell	1.93018	1	▁gmaxwell
34876	ortmund	1.93021	0.059	▁Dortmund
48447	▁Quadro	1.93022	0.99
39919	▁Incarn	1.93027	0.99	▁Incarnation
47432	▁神	1.93031	0.96
1391	▁{	1.93039	0.99	▁{*, ▁{", ▁{:, ▁{}, ▁{{, ...
44547	▁Ichigo	1.93042	0.99
4840	▁lawy	1.93046	1	▁lawyer, ▁lawyers
33373	▁mosquit	1.93046	0.98	▁mosquito, ▁mosquitoes
36471	▁Unle	1.93054	1	▁Unleashed
6141	▁myster	1.93058	0.99	▁mysterious, ▁mysteriously, ▁mysteries, ▁mystery
2532	▁chall	1.9307	1	▁challenger, ▁challenges, ▁challenge, ▁challengers, ▁challeng, ...
34469	▁kinderg	1.9307	0.98	▁kindergarten
41096	▁reperto	1.93073	0.99	▁repertoire
36670	rongh	1.93077	0.99	▁Strongh, ▁Stronghold
33853	▁filib	1.93091	0.89	▁filibuster
46976	▁Monstrous	1.93091	0.96
9454	▁incent	1.93092	1	▁incentive, ▁incentiv, ▁incentives
16040	ullivan	1.93106	0.99	Sullivan, ▁Sullivan
39967	••••	1.93107	0.98
35709	????????	1.93114	0.98
36278	icter	1.93115	0.98	▁stricter
43782	lyak	1.93122	0.96	▁Kislyak
29250	▁FANT	1.9313	1	▁FANTASY
39147	▁shorth	1.93151	0.99	▁shorthand
48753	dfx	1.93155	0.99
7503	▁defe	1.93169	1	▁defends, ▁defensively, ▁defer, ▁defences, ▁defender, ...
18706	▁Baghd	1.93176	0.99	▁Baghdad
11709	}}	1.93194	0.98	}}}, ▁}}
39724	aturdays	1.93217	0.78	▁Saturdays
17844	▁insurg	1.93231	0.81	▁insurgents, ▁insurgent, ▁insurgency
14060	▁predec	1.93232	1	▁predecessor, ▁predecessors
15838	▁pse	1.93237	1	▁pseudonym, ▁pseud, ▁pseudo
48468	▁Ples	1.93239	1
7180	▁spons	1.93239	0.99	▁sponsors, ▁sponsored, ▁sponsor, ▁sponsorship, ▁sponsoring
27236	▁Nare	1.93241	1	▁Narendra
18401	▁feas	1.93251	1	▁feast, ▁feasibility, ▁feasible
14865	▁Dise	1.93255	0.98	▁Diseases, ▁Disease
12563	▁whis	1.93257	1	▁whistlebl, ▁whisper, ▁whist, ▁whisk, ▁whiskey, ...
47826	hillary	1.93269	0.98
38183	▁Canter	1.9328	0.99	▁Canterbury
34842	▁isEnabled	1.9328	0.97
14763	▁wip	1.93282	0.98	▁wipes, ▁wipe, ▁wiping, ▁wiped
46217	▁Kenobi	1.93284	0.99
28383	skirts	1.93292	1	▁skirts, ▁outskirts
43660	bernatorial	1.93295	0.033	▁gubernatorial
7847	▁murd	1.93298	0.99	▁murderous, ▁murders, ▁murderer, ▁murderers, ▁murdered, ...
38701	▁outp	1.93302	1	▁outpatient
44238	▁Afgh	1.93303	0.99	▁Afghans
30317	▁Osw	1.93306	0.99	▁Oswald
45999	REDACTED	1.93311	1
21974	▁Nept	1.93311	1	▁Neptune
32734	aughtered	1.9333	0.6	▁slaughtered
19563	▁arrog	1.93362	0.97	▁arrogant, ▁arrogance
50092	▁GDDR	1.93365	0.97
45640	uphem	1.93367	0.69	▁euphem
12845	etheless	1.93367	0.038	Nonetheless, ▁nonetheless, ▁Nonetheless
46092	udeb	1.93368	0.98
35952	ospons	1.93372	0.97	▁Cosponsors, osponsors
47120	▁Clockwork	1.93376	0.98
29589	▁Defin	1.93381	1	▁Definitive, ▁Definitely, ▁Definitions, ▁Definition
45890	▁Frie	1.93381	1	▁Friedrich, ▁Frieza
7961	▁obser	1.93394	0.99	▁observation, ▁observations, ▁observe, ▁observers, ▁observer, ...
47486	━	1.93396	0.99
37883	▁hars	1.93398	0.99	▁harsher, ▁harshly
9020	▁arrang	1.93398	0.99	▁arrange, ▁arranged, ▁arrangement, ▁arrangements, ▁arranging
24516	▁whistlebl	1.93404	0.86	▁whistleblowers, ▁whistleblower
12732	▁Mississ	1.93406	1	▁Mississippi
19587	chnology	1.9341	0.81	technology, Technology, otechnology
19785	emetery	1.9341	0.51	▁cemetery, ▁Cemetery
7726	▁embr	1.93411	1	▁embrace, ▁embryos, ▁embroiled, ▁embryo, ▁embracing, ...
45167	▁Berks	1.93423	0.99	▁Berkshire
32197	▁Malf	1.93447	1	▁Malfoy
12630	▁defic	1.93448	0.99	▁deficits, ▁deficiencies, ▁deficiency, ▁deficient
47066	▁Piercing	1.93449	0.99
17773	▁skelet	1.93454	1	▁skeletons, ▁skeletal, ▁skeleton
39737	quished	1.93455	0.1	▁vanquished
26323	▁Scand	1.93474	1	▁Scandinavian, ▁Scandinav
40031	staking	1.93475	0.99	▁painstaking
22774	▁linem	1.93484	0.95	▁lineman, ▁linemen
3343	▁surv	1.93484	0.99	▁survey, ▁survives, ▁survived, ▁surviv, ▁surveys, ...
5484	▁upgr	1.93485	1	▁upgrading, ▁upgraded, ▁upgrades, ▁upgrade
8346	▁condem	1.93505	0.98	▁condemning, ▁condemnation, ▁condemn, ▁condemns, ▁condemned
18115	izoph	1.93511	0.97	▁schizophren, izophren, ▁schizophrenia
37363	▁hairc	1.93519	0.99	▁haircut
6112	▁pregn	1.93521	0.99	▁pregnancies, ▁pregnancy, ▁pregnant
12717	okemon	1.93524	0.23	▁pokemon, ▁Pokemon, Pokemon
24445	▁Cind	1.93528	1	▁Cindy, ▁Cinderella
35763	▁Hirosh	1.93529	1	▁Hiroshima
43023	Uncommon	1.93532	0.96
31724	oother	1.93541	0.95	▁smoother
35992	WithNo	1.93552	0.95	▁RandomRedditorWithNo
40052	▁Mub	1.93553	0.99	▁Mubarak
8029	▁desper	1.9356	0.99	▁desperately, ▁desperation, ▁desperate
10790	▁ancest	1.93563	0.99	▁ancestral, ▁ancestor, ▁ancestry, ▁ancestors
8773	intendo	1.93564	0.97	Nintendo, ▁Nintendo
2468	vironment	1.9357	0.85	▁environment, ▁Environment, ▁environmental, environment, vironments, ...
20213	▁pestic	1.93577	0.96	▁pesticides, ▁pesticide
39070	psey	1.9358	0.99	▁Dempsey
10144	emale	1.93581	0.97	▁females, Female, ▁Female, female, ▁Females
23806	ottesville	1.93586	0.9	▁Charlottesville
46343	untled	1.93591	0.66	▁disgruntled
42867	▁Vegeta	1.93596	1
40444	▁McA	1.93597	0.99	▁McAuliffe
37757	glomer	1.936	0.98	▁conglomerate, ▁conglomer
44177	▁Carnage	1.93601	0.99
46086	hedon	1.93606	0.99	▁Whedon
37510	thinkable	1.93606	0.99	▁unthinkable
33524	anamo	1.93609	0.88	▁Guantanamo
48737	▁Runes	1.93613	0.99
31386	_-_	1.93626	0.99
19237	▁Recomm	1.93628	0.99	▁Recommended, ▁Recommend
19682	ternity	1.93635	0.99	▁paternity, ▁eternity, ▁Eternity, ▁maternity, ▁fraternity
44779	▁DRAG	1.93649	0.96	▁DRAGON
43895	thens	1.93656	0.99	▁strengthens
44033	▀	1.93656	1
44057	▁Demonic	1.93657	1
26176	▁Blaz	1.93662	1	▁Blazing, ▁Blaze, ▁Blazers
39654	▁Pesh	1.93665	1
33123	▁silhou	1.93666	0.99	▁silhouette
36851	▁Sovere	1.93673	0.97	▁Sovereign
47732	OOOOOOOO	1.93674	0.99
18670	thumbnails	1.93679	1
47923	▁swast	1.93693	0.99
44970	▁Recep	1.93695	1
628	\n\n	1.93695	0.99
21535	▁Alz	1.93698	1	▁Alzheimer
19202	ilogy	1.93709	0.95	▁trilogy, ▁Trilogy
18249	▁submar	1.93717	0.97	▁submarines, ▁submarine
21849	▁twent	1.9372	0.99	▁twentieth, ▁twenties
41735	▁Autob	1.93726	0.99
8707	▁unemploy	1.93734	0.97	▁unemployed, ▁unemployment
34926	▁Gors	1.9374	1	▁Gorsuch
38277	iseum	1.93754	0.87	▁Coliseum
39192	berus	1.93763	0.96	▁Cerberus
42915	xtap	1.93763	0.96	▁juxtap, ixtape
17258	▁caut	1.93769	1	▁cautioned, ▁cautiously, ▁cautious
14621	▁endors	1.9377	0.97	▁endorsed, ▁endorsement, ▁endorsing, ▁endorsements
27985	▁Puzz	1.93778	1	▁Puzzles
16648	▁fortun	1.93784	1	▁fortunately, ▁fortunate, ▁fortunes
33468	▁├	1.93792	0.96	▁├──
33114	▁Reloaded	1.93803	1
4026	▁advant	1.93808	0.99	▁advantages, ▁advantage, ▁advantageous
42983	ワン	1.9381	1	▁サーティワン
31052	olkien	1.9382	0.9	▁Tolkien
42165	anooga	1.93821	0.49	▁Chattanooga
39907	galitarian	1.93823	0.036	▁egalitarian
25188	▁handc	1.93825	0.99	▁handcuffs, ▁handcuffed
38122	fml	1.93826	1
4322	▁confir	1.93827	0.99	▁confirms, ▁confirming, ▁confirmation, ▁confirmed, ▁confirm
37957	▁Bulg	1.93829	0.97	▁Bulgarian
11411	▁destro	1.9383	1	▁destroys, ▁destroyer, ▁destroying
49358	▁XCOM	1.93833	1
33842	▁Earthqu	1.93843	1	▁Earthquake
21271	HAHA	1.93845	0.99	HAHAHAHA
47708	▁Haste	1.93845	0.99
12561	▁bicy	1.93847	0.93	▁bicycl, ▁bicycle, ▁bicycles
16458	DD	1.93855	1	▁DD, ▁DDR, ▁GDDR, ▁HDD, ADD, ...
35059	▁condol	1.93858	0.99	▁condolences
44946	▁ALEC	1.93866	0.98
29433	▁landsl	1.93866	0.99	▁landslide
31921	▁upro	1.93869	1	▁uproar
49660	▁¯	1.93869	0.99
23646	▁todd	1.93875	1	▁toddler, ▁toddlers
11592	▁``(	1.93879	0.91
21316	alkyrie	1.93887	0.17	▁Valkyrie
19046	▁adul	1.93887	1	▁adultery, ▁adulthood
31852	▁parach	1.93889	1	▁parachute
24898	Recomm	1.93891	1	▁Recommended, ▁Recommend, Recommended, Recommend
21563	veyard	1.93896	0.56	▁Graveyard, ▁graveyard
37010	▁Pinball	1.93898	0.99
44952	foreseen	1.93899	0.98	▁unforeseen
9981	▁compe	1.93904	1	▁compelling, ▁competitors, ▁competed, ▁competitions, ▁competence, ...
25538	moil	1.93911	0.99	▁turmoil
36148	▁tabl	1.93913	1	▁tabletop, ▁tabloid
40822	ovych	1.93915	0.83	▁Yanukovych
40203	▁Osc	1.93915	1	▁Oscars
19030	▁congr	1.93915	1	▁congreg, ▁congratulated, ▁congratulate, ▁congratulations, ▁congressman, ...
49129	..................	1.93921	0.99
23054	▁ACTIONS	1.93924	0.99
44557	iggurat	1.93927	0.61
32015	yout	1.93931	0.99	Layout, layout, ▁youtube, ▁layouts, ▁payout, ...
48227	▁Occupations	1.93934	0.99
32406	▁<@	1.93936	0.99
45300	▁Wem	1.93945	1	▁Wembley
45492	oğ	1.93948	0.83	oğan
20168	astrous	1.93949	0.83	▁disastrous
29712	▁inval	1.9395	0.98	▁invaluable
41848	▁Rodham	1.93952	0.99
35898	▁Winc	1.93952	1	▁Winchester
13581	▁unve	1.93957	1	▁unveil, ▁unveiling, ▁unveiled
38110	▁disemb	1.93958	1	▁disembark
2155	▁rul	1.93958	1	▁rules, ▁rule, ▁ruled, ▁ruler, ▁ruling, ...
3603	ufact	1.9396	1	▁Manufacturer, Manufact, ▁manufacture, ▁manufactured, ▁manufact, ...
44174	▁Primordial	1.93963	0.99
20253	▁airst	1.93966	1	▁airstrike, ▁airstrikes
9049	▁nomine	1.93969	0.88	▁nominees, ▁nominee
16701	▁scram	1.93973	1	▁scrambled, ▁scrambling, ▁scramble
6166	▁explan	1.93976	1	▁explanatory, ▁explanations, ▁explanation
37912	▁Emin	1.9398	0.99	▁Eminem
16100	retty	1.93982	0.98	▁Pretty, Pretty, pretty
49214	▁Uriel	1.93982	1
7969	▁disag	1.93984	1	▁disagrees, ▁disagreement, ▁disagreements, ▁disagreed, ▁disagree
33113	▁surn	1.93984	1	▁surname
23511	▁paran	1.93986	0.99	▁paranoia, ▁paranoid, ▁paranormal
49073	Abyss	1.93991	0.99
48972	▁captcha	1.93993	0.99
32205	▁ranc	1.93999	0.99
42114	▁Meow	1.94005	1
21364	engeance	1.94005	0.029	▁vengeance, ▁Vengeance
31021	▁Urug	1.94009	0.95	▁Uruguay
42877	70710	1.94014	0.97
25887	;;;;;;;;	1.94015	0.97	;;;;;;;;;;;;
29863	akuya	1.94021	0.99	▁Sakuya
42300	umenthal	1.94022	0.094	▁Blumenthal
26435	▁cla	1.94022	1	▁classmate, ▁classmates, ▁clam, ▁classify, ▁clarified, ...
49882	▁Gork	1.94023	1
38837	▁morp	1.94023	0.98	▁morphed, ▁morphine, ▁morphology
27050	abwe	1.94025	0.96	imbabwe, ▁Zimbabwe
23846	,,,,	1.94025	1	,,,,,,,,
8815	▁tiss	1.94029	1	▁tissue, ▁tissues
27040	▁Hond	1.94029	0.99	▁Honduras
34708	FML	1.94036	1
24029	▁coerc	1.94038	1	▁coercion, ▁coerced, ▁coercive
34271	▁Houth	1.94038	0.99
46279	▁Chaff	1.9404	1
11093	▁fert	1.94041	1	▁fertilizer, ▁fertility, ▁fertil, ▁fertile
29830	▁Azerbai	1.94041	0.92	▁Azerbaijan
35041	▁subdu	1.94042	1	▁subdued
23414	▁tomat	1.94046	1	▁tomato, ▁tomatoes
2103	▁targ	1.94047	1	▁targeting, ▁targets, ▁target, ▁targeted
43531	▁Shinzo	1.94051	0.99
7678	▁overwhel	1.9406	0.96	▁overwhelm, ▁overwhelmingly, ▁overwhelming, ▁overwhelmed
23977	▁masc	1.94061	1	▁masculine, ▁mascot, ▁mascara, ▁masculinity
27772	▁Guant	1.94063	1	▁Guantanamo
22496	▁intrins	1.94065	1	▁intrinsically, ▁intrinsic
25554	▁Yug	1.94066	1	▁Yugoslav, ▁Yugoslavia
3422	▁neigh	1.94068	1	▁neighb, ▁neighbourhoods, ▁neighborhood, ▁neighbor, ▁neighborhoods, ...
46649	▁Asuka	1.94071	0.99
46467	▁Kislyak	1.94072	0.99
13233	▁cous	1.94072	1	▁cousins, ▁cousin
48653	▁Jinn	1.94082	1
24394	▁Manit	1.94083	0.99	▁Manitoba
8983	▁satell	1.94083	0.96	▁satellite, ▁satellites
32155	▁Doct	1.94083	0.99	▁Doctrine
4052	▁encour	1.94091	0.99	▁encourages, ▁encouragement, ▁encouraged, ▁encourage, ▁encouraging
13736	▁horizont	1.94092	0.99	▁horizontal, ▁horizontally
3880	--------------------------------	1.94099	0.99	--------------------------------------------------------, ▁----------------------------------------------------------------, ▁--------------------------------, ----------------------------------------------------------------, ------------------------------------------------
10063	▁contrad	1.94102	0.97	▁contradictory, ▁contradiction, ▁contradictions, ▁contradicted, ▁contradicts, ...
30167	ratulations	1.94102	0.002	▁Congratulations, Congratulations, ▁congratulations
13525	▁Veter	1.94106	0.98	▁Veteran, ▁Veterinary, ▁Veterans
34148	htaking	1.94108	0.0028	▁breathtaking
33614	▁sidel	1.94117	1	▁sidelined
9169	▁Poké	1.94117	0.94	▁Pokémon
49071	▁Miko	1.94118	1
49632	▁Scion	1.94119	1
14472	▁entert	1.94127	0.96	▁entertaining, ▁entertained
45430	▁Metroid	1.94132	0.99
45321	pmwiki	1.94135	0.95
23314	uterte	1.94142	0.64	▁Duterte
23587	▁Aval	1.94143	1	▁Avalanche, ▁Avalon
41964	▁thw	1.94144	1	▁thwarted
34804	▁unavoid	1.94151	1	▁unavoidable
42507	▁Peb	1.94151	0.99	▁Pebble
40672	▁Sorceress	1.94153	0.99
21903	▁Depths	1.94165	0.99
45227	▁Scythe	1.94171	0.99
33044	emonium	1.94174	0.63	▁pandemonium
43549	mobi	1.94175	1	▁immobil, ▁mobilization, ▁automobiles, ▁mobilized
46386	▁subreddits	1.94178	1
32797	▁Ragnar	1.94179	1	▁Ragnarok
49205	▁Holo	1.94181	0.98
45786	▄	1.94181	0.99
46402	=-=-=-=-=-=-=-=-	1.94188	0.99
40145	▁JPM	1.94188	0.98	▁JPMorgan
40816	earable	1.94189	0.71	▁unbearable
46315	▁Ultron	1.94197	0.99
19540	▁coff	1.94198	0.99	▁coffers, ▁coffin
24015	chedel	1.94202	0.66	▁psychedelic, ▁psychedel
33135	▁gimm	1.94206	1	▁gimmick
35861	oké	1.94206	0.99	Poké, Pokémon
49116	▁Forsaken	1.9421	1
24515	afort	1.94218	0.97	▁Manafort
38281	aredevil	1.94221	0.69	▁Daredevil
43488	AAAAAAAA	1.94223	0.99
42310	▁Jiu	1.94225	1
41940	ichita	1.94225	0.94	▁Wichita
13600	▁Hispan	1.9423	0.99	▁Hispanic, ▁Hispanics
38417	▁derog	1.94239	0.99	▁derogatory
37656	▁unimagin	1.94239	0.97	▁unimaginable
39214	▁Yiannopoulos	1.94243	0.97
31830	▁inexper	1.94243	0.75	▁inexperienced
35347	hement	1.94248	0.62	▁vehement, ▁vehemently
28600	▁Gujar	1.94253	0.99	▁Gujarat
41333	™:	1.94259	0.87
36886	STDOUT	1.94264	1
36977	netflix	1.94264	0.99
46979	Haunted	1.94265	1
11388	▁rhet	1.94267	0.99	▁rhetorical, ▁rhetoric
47951	▁Grenade	1.94267	0.99
30049	hesda	1.94267	0.97	▁Bethesda
33288	▁Nicarag	1.94273	0.77	▁Nicaragua
45626	landish	1.94275	0.92	▁outlandish
36346	tackle	1.94276	1
32360	negie	1.94278	0.56	▁Carnegie
13486	apons	1.9428	0.96	▁Weapons, Weapons, weapons
35887	andestine	1.94281	0.33	▁clandestine
35791	▁Trog	1.94282	1
4109	▁Rober	1.94287	1	▁Robert, ▁Roberto, ▁Robertson, ▁Roberts
30366	▁omin	1.94292	1	▁ominous
40160	▁Boko	1.94292	1
34032	renheit	1.94293	0.35	▁Fahrenheit
7453	▁elig	1.94301	1	▁eligibility, ▁eligible
19820	▁psychiat	1.94307	1	▁psychiatrist, ▁psychiatry, ▁psychiatric, ▁psychiatrists
2459	▁Democr	1.94307	1	▁Democrats, ▁Democracy, ▁Democrat, ▁Democratic
17845	swer	1.94311	0.96	▁unanswered, Answer, ▁answering, ▁Answer, answer, ...
8417	▁Zeal	1.94313	1	▁Zealand
46478	▁Loll	1.94319	1
48469	▁Bleach	1.94324	0.99
47890	▁Razer	1.94326	1
9924	izabeth	1.94328	0.8	Elizabeth, ▁Elizabeth
39296	▁Jugg	1.94333	1
27552	▁surrog	1.94334	0.99	▁surrogate
36461	buquerque	1.94336	0.1	▁Albuquerque
2212	▁meas	1.94339	0.99	▁measuring, ▁measurable, ▁measles, ▁measurements, ▁measures, ...
42496	▁<+	1.94344	0.99
11568	▁resemb	1.94345	0.99	▁resemblance, ▁resembling, ▁resembled, ▁resembles, ▁resemble
39157	▁Malfoy	1.94346	0.99
10353	repre	1.94347	1	▁repressive, reprene, ▁entrepreneurs, ▁representation, ▁misrepresent, ...
19510	((	1.94349	0.99
9778	▁Kurd	1.9435	1	▁Kurdistan, ▁Kurds, ▁Kurdish
8273	adelphia	1.94356	0.99	▁Philadelphia, Philadelphia
41239	▁Hots	1.94357	0.99
28122	orget	1.94359	0.99	▁Forget, ▁unforgettable, ▁forgetting, orgetown, ▁Georgetown
38218	▁Bahá	1.94372	0.99
45662	raltar	1.94373	0.047	▁Gibraltar
42030	foundland	1.94379	0.91	▁Newfoundland
44405	▁dexter	1.9438	1	▁dexterity
37527	▁Sasuke	1.94384	1
36390	▁Appalach	1.94387	1	▁Appalachian
49329	▁Bagg	1.94392	1
43034	endiary	1.94393	0.69	▁incendiary
30715	comings	1.94393	0.99	▁shortcomings
22314	▁nostalg	1.94394	1	▁nostalgia, ▁nostalgic
45724	▁Qiao	1.944	0.96
35246	▁hect	1.944	1	▁hectares
39275	▁Chaser	1.94401	0.98
38401	▁Tyrann	1.94404	1
25255	Atl	1.94407	1	Atlantic, ▁Atlantis, Atlanta
29966	ormons	1.94411	0.9	▁Mormons
19320	▁scra	1.94418	1	▁scrape, ▁scratched, ▁scrambled, ▁scraps, ▁scrapped, ...
48738	▁Ballistic	1.94419	0.99
49167	▁Summoner	1.9442	0.98
23230	▁Ethiop	1.9442	0.93	▁Ethiopian, ▁Ethiopia
20722	▁Wrest	1.94421	1	▁Wrestle, ▁Wrestling
4209	▁somew	1.94422	1	▁somewhere, ▁somewhat
29554	apeshifter	1.94424	0.032	shapeshifter
49969	▁Mercenary	1.94426	1
33033	▁rever	1.94427	0.99	▁reversible, ▁revert, ▁reverted, ▁reverber, ▁reverence, ...
33316	▁resurg	1.94428	1	▁resurgence
12895	▁intimid	1.94432	0.98	▁intimidation, ▁intimidated, ▁intimidating, ▁intimidate
40097	▁uphe	1.94434	0.99	▁upheaval
49892	▁Shant	1.94434	0.99
38746	▁Aad	1.94435	1	▁Aadhaar
9898	▁Scient	1.94435	0.99	▁Scientific, ▁Scientology, ▁Scientists, ▁Scientist

Tokens with partial UTF-8 sequences

0 entries below threshold of 1.746

216 additional entries above threshold

token_id	token	indicator	in_other_tokens
34504	▁裏<0xE8>	1.74911
33434	<0x96><0x9A>士	1.75036	龍喚士
20174	▁裏<0xE7>	1.75594
39820	龍<0xE5><0xA5>	1.76379	龍契士
22757	<0x9A>醒	1.8065	覚醒, ▁裏覚醒
39374	<0x91>士	1.85673	龍契士
47703	<0xA9><0xB6>極	1.87332
19049	龍<0xE5>	1.89822	龍<0xE5><0xA5>, 龍喚士, 龍契士
23596	<0x93><0x98>	1.90515	▁ⓘ, ⓘ
31204	<0x96><0x9A>	1.91613	<0x96><0x9A>士, 龍喚士
47490	<0xA9><0xB6><0xE6>	1.92526	<0xA9><0xB6>極
29773	<0xEE><0x80>	1.92609
41340	<0xE0><0xBC>	1.93201
39611	<0xE1><0xB5>	1.93227
13945	<0xA5><0x9E>	1.93257	▁神, 神
35266	<0xEF><0xB8>	1.94124	️
36596	<0xBB><0x92>	1.94357	黒
45433	<0x81><0x96>	1.94676
43897	<0xE6><0xA9>	1.9473	機
8008	<0x84><0xA2>	1.94889	™, ™:
50169	▁<0xF0><0x9F><0x91>	1.95007
19021	<0xE7><0x9A>	1.95303	的
43074	▁<0xE2><0x9D>	1.95398
43518	<0x82><0x8E>	1.95572
11737	<0xE9><0xBE>	1.95666	龍, 龍<0xE5><0xA5>, 龍<0xE5>, 龍喚士, 龍契士
8582	<0xF0><0x9F>	1.95737	▁<0xF0><0x9F><0x91>, <0xF0><0x9F><0x91>, <0xF0><0x9F><0x98>, ▁<0xF0><0x9F>, ▁<0xF0><0x9F><0x98>, ...
41840	<0xF0><0x9F><0x91>	1.95757	▁<0xF0><0x9F><0x91>
14519	▁<0xE2><0x9C>	1.95922	▁✔, ▁✓
47249	<0xF0><0x9F><0x98>	1.95925
35069	<0xA5><0xB5>	1.95952	<0xA9><0xB6>極
43636	<0xE5><0x82>	1.96062
47728	<0xF0><0x9D>	1.96173
6408	<0xA3><0x8F>	1.96211	▁裏<0xE8>, ▁裏, ▁裏<0xE7>, ▁裏覚醒
34719	▁<0xE2><0x98>	1.96219
24583	<0xE2><0x98>	1.96295	▁<0xE2><0x98>, ★★, ☆
45379	<0xE7><0x8B>	1.96314
32391	<0xE2><0x9D>	1.96358	▁<0xE2><0x9D>
10253	<0x86><0x92>	1.96454	覚醒, <0x9A>醒, ▁→, →, ▁裏覚醒
42527	▁<0xE2><0x87>	1.96509
42314	▁<0xE0><0xA8>	1.96604
32518	<0xE8><0xA3>	1.96653	▁裏<0xE8>, 装
12520	▁<0xF0><0x9F>	1.96661	▁<0xF0><0x9F><0x91>, ▁<0xF0><0x9F><0x98>, ▁🙂
24966	▁<0xE2><0x97>	1.96667	▁●
47078	<0xE7><0x84>	1.96872
34650	<0xE5><0xA7>	1.96882	姫
23329	<0x8E><0x8B>	1.96935	王
49149	の<0xE5><0xAE>	1.96998
11019	▁<0xE2><0x96>	1.97	▁█, ▁■, ▁►
48958	<0xE8><0x88>	1.9706
49426	<0xE7><0x90>	1.97128
18004	<0xE5><0xA3>	1.9716	<0x91>士, 士, <0x96><0x9A>士, 龍喚士, 龍契士
48953	<0xAD><0xB7>	1.97169
28225	▁<0xE0><0xA4>	1.97223
447	<0xE2><0x80>	1.97269	\u200b, ▁\u200e, †, ″, ••, ...
36469	▁<0xE5><0xA4>	1.9727
30325	▁<0xF0><0x9F><0x98>	1.97293
43297	<0xE0><0xA9>	1.97312
15926	<0xE2><0x97>	1.97333	▁●, ▁<0xE2><0x97>, ◼, ●
43769	<0x81><0xAB>	1.97335
45911	<0xE7><0x95>	1.97353
45784	<0xE7><0xB7>	1.97402
41365	<0x82><0xAA>	1.97429
4204	<0xBF><0xBD>	1.9744	▁��������, ▁����, ���, .�, ��, ...
49694	<0xE9><0x9A>	1.97462
45539	<0xAC><0xBC>	1.97568
11805	<0x98><0x85>	1.9762	★★, ▁★, ★
43102	<0xE8><0xBB>	1.97627
44165	<0xE7><0xAB>	1.97643
36685	<0xE5><0xA6>	1.97737
42164	▁<0xE6><0x9C>	1.97763
41678	<0xB6><0x85>	1.97774
45617	<0xE9><0xA3>	1.97798
26534	<0x85><0x8B>	1.978	ㅋㅋ, ㅋ
29785	<0xE9><0x97>	1.97852	闘
32003	<0xE8><0x80>	1.97925	者
7134	<0x88><0x92>	1.97944	▁(−, ▁−, −
46788	<0x8A><0xB1>	1.98003
13305	▁<0xE2><0x94>	1.98118	▁├──, ▁│, ▁├
26486	<0xE2><0x9C>	1.98127	▁✔
43718	<0xE6><0xA0>	1.98129
40367	<0xE7><0x9C>	1.98138
5008	<0xE2><0x96>	1.98152	▁█, ▁<0xE2><0x96>, ▁■, ▀, █, ...
47797	<0xE8><0x83>	1.98172
22880	<0xE2><0x95>	1.98172	══, ═
46349	<0xE6><0x83>	1.98202
30585	<0xE5><0xB8>	1.98221
20046	<0xE4><0xB9>	1.98267	之
43889	<0xE5><0x8E>	1.98281
46479	<0xE4><0xBF>	1.98286
37772	<0xE5><0x91>	1.98319
38184	<0xE6><0xB5>	1.98359
25001	<0xE5><0xA5>	1.98363	女, 龍<0xE5><0xA5>, 龍契士
37863	<0xE5><0x86>	1.98366
34932	<0xE9><0x87>	1.9838
37345	<0xE6><0xB3>	1.98394
29705	<0xE2><0x86>	1.98443	→, ↑
32432	<0xE5><0xB7>	1.98502
39333	<0xB2><0xBE>	1.98519
46695	<0xEB><0x8B>	1.98552
18433	<0xAD><0x94>	1.98559	魔, の魔
43380	<0xE5><0xAF>	1.98573
30266	<0xE6><0x9D>	1.9858
44293	<0xE5><0x8C>	1.98581
27764	<0xE5><0xAD>	1.98597	子
33232	<0xE5><0xBF>	1.98632
17358	<0xE8><0xA6>	1.98643	覚醒, ▁裏覚醒
41585	<0xE1><0xB8>	1.98657
47947	<0xE5><0x8B>	1.98674
17992	<0xE2><0x99>	1.98683	▁<0xE2><0x99>, ♦, ♥
29826	<0xE6><0xAD>	1.987	武
37239	<0xE9><0x9B>	1.98727
31965	<0xE7><0x89>	1.98734	版
30298	<0xE5><0x89>	1.98753
15139	▁<0xE2><0x89>	1.98758	▁≡, ▁≤, ▁≥
23626	<0xE6><0x98>	1.9876	是
38461	<0xE9><0x96>	1.98781
6552	<0xE2><0x94>	1.98795	━, ▁<0xE2><0x94>, ────────, ▁├──, ▁│, ...
12466	▁<0xD0>	1.98805
23821	▁<0xEC>	1.98833
28156	<0xE5><0xBC>	1.98854
33426	の<0xE9>	1.98865	の魔
45250	<0xE6><0x80>	1.98871
14524	▁<0xE3><0x83>	1.98909
45865	<0xAB><0x98>	1.98924
32849	<0xE9><0x83>	1.98955
22755	<0xE6><0x88>	1.98974	戦
31619	▁<0xEB>	1.9902
17804	▁<0xE2><0x86>	1.99036	▁↑
26193	<0xE8><0xA1>	1.99056
46256	<0xE2><0x81>	1.99067
19526	<0xE4><0xBD>	1.99072	作, 使
50159	<0x99><0xBD>	1.99076
39355	<0xE5><0x8D>	1.99101
36181	<0xE5><0xBE>	1.99105
37605	<0xE5><0xBD>	1.99115
35707	<0xE6><0x84>	1.99116
18872	▁<0xE2><0x88>	1.99122	▁∼
16268	▁<0xE9>	1.99123
41753	<0xE5><0xBA>	1.99126
27670	<0xE4><0xBC>	1.99164
36365	<0xE6><0xB0>	1.99165
49035	<0xE5><0x87>	1.99184
33566	<0xE7><0x9B>	1.99222
11976	<0xE0><0xA4>	1.99236	▁<0xE0><0xA4>, ा
17433	▁<0xE3><0x82>	1.99245	▁サ, ▁サーティワン, ▁サーティ
34402	<0xE9><0x81>	1.99258
23877	<0xE6><0x96>	1.99258	方
1209	<0xE3><0x83>	1.99264	シャ, イト, ドラゴン, バ, メ, ...
33176	<0xE5><0xB9>	1.99339
45739	<0xE8><0xAA>	1.9937
22887	<0xE5><0xB0>	1.99373	将
8955	<0x82><0xAC>	1.99373	▁€, €, ガ
13328	▁<0xE7>	1.9938	▁神
33699	<0xE6><0x89>	1.99381
33768	<0xE6><0x97>	1.99382
12859	<0xE4><0xBA>	1.99386	五, 人
17683	の<0xE7>	1.99408
20724	▁<0xE2><0x99>	1.99421
28839	<0xE5><0x9C>	1.99427
14360	▁<0xD7>	1.99428
19567	<0xE0><0xB8>	1.99436
46763	<0xE6><0x95>	1.99437
34460	<0xE9><0x80>	1.99438
24861	<0xE2><0x88>	1.99448	▁(−, ▁∼
32368	<0xE5><0x9B>	1.99466
20015	<0xE4><0xBB>	1.99467	代
5099	<0xE3><0x80>	1.99475	?」, 」, 『, 、, 】, ...
17550	▁<0xD8>	1.99512	▁ال
31479	<0xE0><0xB9>	1.99522
27032	の<0xE6>	1.99524
27950	<0xE5><0x8A>	1.99537
18796	<0xE7><0x94>	1.99588	生, 田
10545	▁<0xE6>	1.99641	▁<0xE6><0x9C>
13783	<0xE5><0xA4>	1.99658	天, 大, ▁<0xE5><0xA4>
10263	▁<0xE5>	1.99672	▁<0xE5><0xA4>
19469	<0xE0><0xA8>	1.99686	▁<0xE0><0xA8>
17312	<0xE6><0x9C>	1.99755	▁<0xE6><0x9C>
10310	<0xE4><0xB8>	1.9978	不, 上, 一, 中, 三
12045	ー<0xE3><0x83>	1.99787	ーン, ▁サーティワン, ーティ, ール, ▁サーティ, ...
15474	の<0xE5>	1.99808	の<0xE5><0xAE>
1587	▁<0xC2>	1.99808	▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0▁\xa0, ▁£, ▁µ, ▁®, ▁©, ...
33951	י<0xD7>	1.9982
23294	▁<0xE3><0x81>	1.99831
47991	<0xED><0x95>	1.99844
26344	<0xE5><0x88>	1.99895
20998	<0xE5><0x8F>	1.99919
32573	<0xE8><0xBF>	1.9996
28938	<0xE5><0x90>	1.99972
45495	<0xE1><0xBD>	1.99984
46237	<0xE8><0xAF>	2.00058
18923	▁<0xD9>	2.00065	▁م, ▁و
35705	<0xE2><0x89>	2.00136	▁≡, ▁≤
17739	<0xE5><0x85>	2.00246	光
35975	<0xEC><0x9D>	2.0027
22522	<0xE5><0xAE>	2.00322	の<0xE5><0xAE>
5525	▁<0xE8>	2.00323	▁裏<0xE8>, ▁裏, ▁裏<0xE7>, ▁裏覚醒
34754	▁<0xC4>	2.00339
564	▁<0xE2><0x80>	2.00389	▁\u200e, ▁–, ▁…, ▁―, ▁•, ...
28053	▁<0xE1>	2.00391
25081	<0x99><0x82>	2.00392	▁🙂
48071	<0xE0><0xA6>	2.00405
27332	▁<0xEF>	2.00472	▁��������
26292	<0xE1><0xB9>	2.00506
25370	▁<0xC5>	2.00508
18074	▁<0xCF>	2.00584	▁τ
1792	<0xE3><0x82>	2.006	▁サ, シャ, イト, ▁<0xE3><0x82>, ス, ...
34247	ا<0xD8>	2.00619
7377	▁<0xCE>	2.00666	▁μg, ▁Δ, ▁β, ▁α, ▁μ
24231	<0xE0><0xA5>	2.00689
2343	▁<0xE2>	2.00704	▁\u200e, ▁█, ▁<0xE2><0x96>, ▁<0xE2><0x99>, ▁■, ...
2515	<0xE3><0x81>	2.00779	の<0xE7>, ▁<0xE3><0x81>, は, あ, の<0xE5><0xAE>, ...
6184	▁<0xC3>	2.0109	▁à, ▁é, ▁Ü, ▁þ, ▁É, ...
21253	<0x9A><0xE9>	2.01175	覚醒, <0x9A>醒, ▁裏覚醒
42062	<0x88><0xE8>	2.01189
35050	<0xB6><0xE6>	2.0137	<0xA9><0xB6><0xE6>, <0xA9><0xB6>極
25443	о<0xD0>	2.01388

Byte tokens

13 entries below threshold of 1.743

token_id	token	indicator	ord	hex	byte_type
186	<0xFE>	1.74022	254	0xFE	unused_utf8
181	<0xF9>	1.74036	249	0xF9	unused_utf8
185	<0xFD>	1.74045	253	0xFD	unused_utf8
182	<0xFA>	1.74072	250	0xFA	unused_utf8
187	<0xFF>	1.74081	255	0xFF	unused_utf8
124	<0xC0>	1.74082	192	0xC0	unused_utf8
180	<0xF8>	1.74086	248	0xF8	unused_utf8
179	<0xF7>	1.7413	247	0xF7	unused_utf8
177	<0xF5>	1.74131	245	0xF5	unused_utf8
125	<0xC1>	1.74135	193	0xC1	unused_utf8
184	<0xFC>	1.74173	252	0xFC	unused_utf8
178	<0xF6>	1.74199	246	0xF6	unused_utf8
183	<0xFB>	1.74236	251	0xFB	unused_utf8

243 additional entries above threshold

token_id	token	indicator	ord	hex	byte_type
174	<0xF2>	1.79639	242	0xF2	utf8
173	<0xF1>	1.79748	241	0xF1	utf8
153	<0xDD>	1.86842	221	0xDD	utf8
154	<0xDE>	1.87104	222	0xDE	utf8
219	\x1f	1.87285	31	0x1F	ascii
188	\x00	1.87424		0x00	ascii
220	▁	1.89205	32	0x20	ascii
194	\x06	1.89932	6	0x06	ascii
175	<0xF3>	1.90538	243	0xF3	utf8
176	<0xF4>	1.90984	244	0xF4	utf8
202	\x0e	1.91031	14	0x0E	ascii
152	<0xDC>	1.91096	220	0xDC	utf8
221	\x7f	1.91298	127	0x7F	ascii
155	<0xDF>	1.91889	223	0xDF	utf8
172	<0xF0>	1.9192	240	0xF0	utf8
192	\x04	1.9224	4	0x04	ascii
193	\x05	1.9239	5	0x05	ascii
190	\x02	1.92713	2	0x02	ascii
195	\x07	1.93032	7	0x07	ascii
206	\x12	1.93547	18	0x12	ascii
196	\x08	1.94587	8	0x08	ascii
217	\x1d	1.95302	29	0x1D	ascii
170	<0xEE>	1.9585	238	0xEE	utf8
200	\x0c	1.9591	12	0x0C	ascii
218	\x1e	1.96027	30	0x1E	ascii
197	\t	1.96032	9	0x09	ascii
159	<0xE3>	1.96168	227	0xE3	utf8
214	\x1a	1.96696	26	0x1A	ascii
7	(	1.96916	40	0x28	ascii
20	5	1.96948	53	0x35	ascii
21	6	1.96968	54	0x36	ascii
23	8	1.97006	56	0x38	ascii
210	\x16	1.97115	22	0x16	ascii
19	4	1.97142	52	0x34	ascii
22	7	1.97234	55	0x37	ascii
24	9	1.97475	57	0x39	ascii
198	\n	1.97551	10	0x0A	ascii
246	<0x98>	1.97703	152	0x98	utf8
234	<0x8C>	1.97731	140	0x8C	utf8
15	0	1.97733	48	0x30	ascii
160	<0xE4>	1.97744	228	0xE4	utf8
213	\x19	1.97781	25	0x19	ascii
189	\x01	1.97801	1	0x01	ascii
250	<0x9C>	1.97839	156	0x9C	utf8
53	V	1.97892	86	0x56	ascii
18	3	1.97915	51	0x33	ascii
9	*	1.9799	42	0x2A	ascii
0	!	1.98003	33	0x21	ascii
212	\x18	1.98175	24	0x18	ascii
144	<0xD4>	1.98238	212	0xD4	utf8
10	+	1.98248	43	0x2B	ascii
209	\x15	1.98281	21	0x15	ascii
203	\x0f	1.98381	15	0x0F	ascii
211	\x17	1.98439	23	0x17	ascii
91	|	1.98456	124	0x7C	ascii
191	\x03	1.9846	3	0x03	ascii
90	{	1.98501	123	0x7B	ascii
199	\x0b	1.98584	11	0x0B	ascii
108	<0xB0>	1.98617	176	0xB0	utf8
240	<0x92>	1.98662	146	0x92	utf8
237	<0x8F>	1.98688	143	0x8F	utf8
87	x	1.98753	120	0x78	ascii
222	<0x80>	1.98754	128	0x80	utf8
229	<0x87>	1.9876	135	0x87	utf8
207	\x13	1.98769	19	0x13	ascii
110	<0xB2>	1.98814	178	0xB2	utf8
101	<0xA8>	1.98844	168	0xA8	utf8
134	<0xCA>	1.98884	202	0xCA	utf8
254	<0xA0>	1.98906	160	0xA0	utf8
135	<0xCB>	1.98918	203	0xCB	utf8
103	<0xAA>	1.98933	170	0xAA	utf8
143	<0xD3>	1.98949	211	0xD3	utf8
223	<0x81>	1.98961	129	0x81	utf8
117	<0xB9>	1.9901	185	0xB9	utf8
248	<0x9A>	1.99029	154	0x9A	utf8
5	&	1.99073	38	0x26	ascii
80	q	1.99074	113	0x71	ascii
114	<0xB6>	1.99098	182	0xB6	utf8
235	<0x8D>	1.99123	141	0x8D	utf8
99	<0xA6>	1.99136	166	0xA6	utf8
131	<0xC7>	1.99142	199	0xC7	utf8
16	1	1.99156	49	0x31	ascii
77	n	1.99158	110	0x6E	ascii
216	\x1c	1.99181	28	0x1C	ascii
242	<0x94>	1.99181	148	0x94	utf8
228	<0x86>	1.99205	134	0x86	utf8
241	<0x93>	1.99248	147	0x93	utf8
215	\x1b	1.99267	27	0x1B	ascii
112	<0xB4>	1.99277	180	0xB4	utf8
61	^	1.9928	94	0x5E	ascii
253	<0x9F>	1.99295	159	0x9F	utf8
73	j	1.99303	106	0x6A	ascii
109	<0xB1>	1.99323	177	0xB1	utf8
2	#	1.99328	35	0x23	ascii
252	<0x9E>	1.99329	158	0x9E	utf8
123	<0xBF>	1.99335	191	0xBF	utf8
130	<0xC6>	1.99341	198	0xC6	utf8
116	<0xB8>	1.99367	184	0xB8	utf8
105	<0xAC>	1.9939	172	0xAC	utf8
69	f	1.99391	102	0x66	ascii
236	<0x8E>	1.99404	142	0x8E	utf8
224	<0x82>	1.99406	130	0x82	utf8
115	<0xB7>	1.9942	183	0xB7	utf8
66	c	1.99437	99	0x63	ascii
94	<0xA1>	1.99439	161	0xA1	utf8
41	J	1.99465	74	0x4A	ascii
230	<0x88>	1.99484	136	0x88	utf8
28	=	1.99485	61	0x3D	ascii
58	[	1.99518	91	0x5B	ascii
75	l	1.9952	108	0x6C	ascii
52	U	1.99538	85	0x55	ascii
67	d	1.99541	100	0x64	ascii
167	<0xEB>	1.9955	235	0xEB	utf8
231	<0x89>	1.99553	137	0x89	utf8
233	<0x8B>	1.99563	139	0x8B	utf8
107	<0xAF>	1.99572	175	0xAF	utf8
56	Y	1.9958	89	0x59	ascii
27	<	1.99589	60	0x3C	ascii
65	b	1.99599	98	0x62	ascii
169	<0xED>	1.99613	237	0xED	utf8
43	L	1.9962	76	0x4C	ascii
226	<0x84>	1.99639	132	0x84	utf8
57	Z	1.99644	90	0x5A	ascii
162	<0xE6>	1.99649	230	0xE6	utf8
30	?	1.99657	63	0x3F	ascii
118	<0xBA>	1.99667	186	0xBA	utf8
96	<0xA3>	1.99668	163	0xA3	utf8
244	<0x96>	1.99678	150	0x96	utf8
249	<0x9B>	1.99686	155	0x9B	utf8
126	<0xC2>	1.99689	194	0xC2	utf8
208	\x14	1.99693	20	0x14	ascii
225	<0x83>	1.99726	131	0x83	utf8
255	<0xAD>	1.99747	173	0xAD	utf8
86	w	1.99769	119	0x77	ascii
106	<0xAE>	1.99825	174	0xAE	utf8
88	y	1.99834	121	0x79	ascii
55	X	1.9984	88	0x58	ascii
98	<0xA5>	1.99914	165	0xA5	utf8
36	E	1.99916	69	0x45	ascii
137	<0xCD>	1.99919	205	0xCD	utf8
164	<0xE8>	1.99929	232	0xE8	utf8
89	z	1.99952	122	0x7A	ascii
113	<0xB5>	1.99981	181	0xB5	utf8
60	]	1.99982	93	0x5D	ascii
243	<0x95>	1.99985	149	0x95	utf8
111	<0xB3>	1.99988	179	0xB3	utf8
93	~	1.99997	126	0x7E	ascii
4	%	2.00016	37	0x25	ascii
204	\x10	2.0005	16	0x10	ascii
46	O	2.00051	79	0x4F	ascii
63	`	2.00057	96	0x60	ascii
151	<0xDB>	2.00061	219	0xDB	utf8
97	<0xA4>	2.00065	164	0xA4	utf8
245	<0x97>	2.00073	151	0x97	utf8
239	<0x91>	2.00089	145	0x91	utf8
157	<0xE1>	2.00094	225	0xE1	utf8
74	k	2.00094	107	0x6B	ascii
92	}	2.00105	125	0x7D	ascii
139	<0xCF>	2.0012	207	0xCF	utf8
95	<0xA2>	2.00128	162	0xA2	utf8
54	W	2.00138	87	0x57	ascii
32	A	2.00146	65	0x41	ascii
102	<0xA9>	2.00154	169	0xA9	utf8
161	<0xE5>	2.00155	229	0xE5	utf8
104	<0xAB>	2.00183	171	0xAB	utf8
70	g	2.00193	103	0x67	ascii
81	r	2.00276	114	0x72	ascii
122	<0xBE>	2.00289	190	0xBE	utf8
121	<0xBD>	2.00293	189	0xBD	utf8
251	<0x9D>	2.0031	157	0x9D	utf8
168	<0xEC>	2.00332	236	0xEC	utf8
163	<0xE7>	2.0034	231	0xE7	utf8
84	u	2.0034	117	0x75	ascii
76	m	2.00352	109	0x6D	ascii
17	2	2.00378	50	0x32	ascii
127	<0xC3>	2.00418	195	0xC3	utf8
1	"	2.00484	34	0x22	ascii
6	'	2.00487	39	0x27	ascii
100	<0xA7>	2.00499	167	0xA7	utf8
79	p	2.00514	112	0x70	ascii
148	<0xD8>	2.00527	216	0xD8	utf8
171	<0xEF>	2.00528	239	0xEF	utf8
150	<0xDA>	2.00546	218	0xDA	utf8
165	<0xE9>	2.00551	233	0xE9	utf8
85	v	2.00583	118	0x76	ascii
119	<0xBB>	2.00596	187	0xBB	utf8
142	<0xD2>	2.00612	210	0xD2	utf8
227	<0x85>	2.00619	133	0x85	utf8
166	<0xEA>	2.00635	234	0xEA	utf8
132	<0xC8>	2.00679	200	0xC8	utf8
37	F	2.00708	70	0x46	ascii
120	<0xBC>	2.00725	188	0xBC	utf8
205	\x11	2.00743	17	0x11	ascii
48	Q	2.00745	81	0x51	ascii
42	K	2.00778	75	0x4B	ascii
71	h	2.00785	104	0x68	ascii
147	<0xD7>	2.00801	215	0xD7	utf8
232	<0x8A>	2.00859	138	0x8A	utf8
140	<0xD0>	2.00865	208	0xD0	utf8
45	N	2.00889	78	0x4E	ascii
158	<0xE2>	2.00951	226	0xE2	utf8
34	C	2.00961	67	0x43	ascii
59	\	2.00971	92	0x5C	ascii
238	<0x90>	2.00997	144	0x90	utf8
49	R	2.01023	82	0x52	ascii
39	H	2.011	72	0x48	ascii
68	e	2.01119	101	0x65	ascii
149	<0xD9>	2.0114	217	0xD9	utf8
138	<0xCE>	2.01334	206	0xCE	utf8
35	D	2.01338	68	0x44	ascii
83	t	2.01339	116	0x74	ascii
33	B	2.01351	66	0x42	ascii
78	o	2.01376	111	0x6F	ascii
31	@	2.0138	64	0x40	ascii
38	G	2.01385	71	0x47	ascii
51	T	2.01526	84	0x54	ascii
29	>	2.01545	62	0x3E	ascii
47	P	2.01575	80	0x50	ascii
156	<0xE0>	2.01601	224	0xE0	utf8
8	)	2.01637	41	0x29	ascii
201	\r	2.01644	13	0x0D	ascii
44	M	2.01699	77	0x4D	ascii
50	S	2.01705	83	0x53	ascii
26	;	2.01736	59	0x3B	ascii
129	<0xC5>	2.01951	197	0xC5	utf8
133	<0xC9>	2.01971	201	0xC9	utf8
14	/	2.01975	47	0x2F	ascii
128	<0xC4>	2.02015	196	0xC4	utf8
64	a	2.02047	97	0x61	ascii
146	<0xD6>	2.02384	214	0xD6	utf8
247	<0x99>	2.02463	153	0x99	utf8
82	s	2.02532	115	0x73	ascii
141	<0xD1>	2.02586	209	0xD1	utf8
145	<0xD5>	2.0271	213	0xD5	utf8
72	i	2.02806	105	0x69	ascii
40	I	2.03632	73	0x49	ascii
3	$	2.03825	36	0x24	ascii
136	<0xCC>	2.03923	204	0xCC	utf8
62	_	2.05084	95	0x5F	ascii
25	:	2.05409	58	0x3A	ascii
12	-	2.08477	45	0x2D	ascii
13	.	2.09442	46	0x2E	ascii
11	,	2.14694	44	0x2C	ascii

Special tokens

143 entries below threshold of 1.743

token_id	token	indicator	max_prob
50392	<|extratoken_136|>	1.73971	3.7e-07
50386	<|extratoken_130|>	1.73983	4.2e-07
50391	<|extratoken_135|>	1.73999	3.5e-07
50280	<|extratoken_24|>	1.74003	4.6e-07
50369	<|extratoken_113|>	1.74006	3.3e-07
50299	<|extratoken_43|>	1.74008	4e-07
50265	<|extratoken_9|>	1.74009	3.7e-07
50261	<|extratoken_5|>	1.74016	3.2e-07
50340	<|extratoken_84|>	1.74019	3.4e-07
50313	<|extratoken_57|>	1.74019	3.7e-07
50324	<|extratoken_68|>	1.74025	3.1e-07
50376	<|extratoken_120|>	1.74025	2.7e-07
50277	<|extratoken_21|>	1.74027	3.8e-07
50305	<|extratoken_49|>	1.74028	3.5e-07
50275	<|extratoken_19|>	1.74034	3.1e-07
50397	<|extratoken_141|>	1.74034	3.4e-07
50317	<|extratoken_61|>	1.74037	3.4e-07
50290	<|extratoken_34|>	1.74037	3.8e-07
50323	<|extratoken_67|>	1.74037	2.1e-07
50348	<|extratoken_92|>	1.74038	5e-07

123 additional entries below threshold

token_id	token	indicator	max_prob
50356	<|extratoken_100|>	1.74039	2.6e-07
50264	<|extratoken_8|>	1.74043	3.5e-07
50268	<|extratoken_12|>	1.74044	2.8e-07
50266	<|extratoken_10|>	1.74045	3e-07
50269	<|extratoken_13|>	1.74045	3.7e-07
50388	<|extratoken_132|>	1.74045	2.2e-07
50335	<|extratoken_79|>	1.74045	3.4e-07
50371	<|extratoken_115|>	1.74047	4.2e-07
50365	<|extratoken_109|>	1.74047	3.8e-07
50322	<|extratoken_66|>	1.74049	3.4e-07
50385	<|extratoken_129|>	1.74049	3.5e-07
50307	<|extratoken_51|>	1.7405	3.6e-07
50308	<|extratoken_52|>	1.74053	3.8e-07
50349	<|extratoken_93|>	1.74055	3.9e-07
50331	<|extratoken_75|>	1.74057	3.5e-07
50390	<|extratoken_134|>	1.7406	2.5e-07
50318	<|extratoken_62|>	1.7406	3.5e-07
50332	<|extratoken_76|>	1.74061	4.2e-07
50295	<|extratoken_39|>	1.74062	3.1e-07
50368	<|extratoken_112|>	1.74063	5.4e-07
50389	<|extratoken_133|>	1.74063	3.1e-07
50328	<|extratoken_72|>	1.74063	4.5e-07
50350	<|extratoken_94|>	1.74063	3.3e-07
50316	<|extratoken_60|>	1.74063	3.7e-07
50366	<|extratoken_110|>	1.74063	3.7e-07
50333	<|extratoken_77|>	1.74063	2.4e-07
50352	<|extratoken_96|>	1.74065	2.9e-07
50381	<|extratoken_125|>	1.74065	4.2e-07
50378	<|extratoken_122|>	1.74066	3.1e-07
50258	<|extratoken_2|>	1.74068	3.4e-07
50380	<|extratoken_124|>	1.74069	2.5e-07
50341	<|extratoken_85|>	1.7407	3.2e-07
50287	<|extratoken_31|>	1.74071	3.6e-07
50279	<|extratoken_23|>	1.74073	2.5e-07
50373	<|extratoken_117|>	1.74074	2.9e-07
50271	<|extratoken_15|>	1.74075	4.1e-07
50358	<|extratoken_102|>	1.74077	2.6e-07
50343	<|extratoken_87|>	1.74078	4.5e-07
50359	<|extratoken_103|>	1.74078	3.8e-07
50288	<|extratoken_32|>	1.7408	3.2e-07
50278	<|extratoken_22|>	1.7408	3.4e-07
50329	<|extratoken_73|>	1.7408	3.4e-07
50260	<|extratoken_4|>	1.7408	4.1e-07
50303	<|extratoken_47|>	1.74081	3.1e-07
50281	<|extratoken_25|>	1.74083	2.7e-07
50273	<|extratoken_17|>	1.74083	3.7e-07
50361	<|extratoken_105|>	1.74083	3e-07
50394	<|extratoken_138|>	1.74083	4e-07
50360	<|extratoken_104|>	1.74084	2.6e-07
50375	<|extratoken_119|>	1.74085	4e-07
50315	<|extratoken_59|>	1.74086	3.1e-07
50363	<|extratoken_107|>	1.74087	3.6e-07
50382	<|extratoken_126|>	1.74088	3.3e-07
50296	<|extratoken_40|>	1.74088	2.5e-07
50309	<|extratoken_53|>	1.74089	3.9e-07
50384	<|extratoken_128|>	1.7409	4.2e-07
50312	<|extratoken_56|>	1.7409	3.6e-07
50297	<|extratoken_41|>	1.74092	3e-07
50292	<|extratoken_36|>	1.74093	2.7e-07
50291	<|extratoken_35|>	1.74094	2.6e-07
50396	<|extratoken_140|>	1.74096	3.5e-07
50354	<|extratoken_98|>	1.74097	3e-07
50257	<|extratoken_1|>	1.74097	3.5e-07
50304	<|extratoken_48|>	1.74098	2.7e-07
50306	<|extratoken_50|>	1.74099	3.5e-07
50325	<|extratoken_69|>	1.741	3e-07
50300	<|extratoken_44|>	1.74101	4.1e-07
50272	<|extratoken_16|>	1.74101	3e-07
50274	<|extratoken_18|>	1.74104	3.6e-07
50345	<|extratoken_89|>	1.74104	4e-07
50282	<|extratoken_26|>	1.74107	2.9e-07
50367	<|extratoken_111|>	1.74108	3.9e-07
50321	<|extratoken_65|>	1.74108	3.5e-07
50383	<|extratoken_127|>	1.74109	2.9e-07
50355	<|extratoken_99|>	1.74109	3.2e-07
50347	<|extratoken_91|>	1.7411	2e-07
50294	<|extratoken_38|>	1.74111	2.8e-07
50283	<|extratoken_27|>	1.74112	2.8e-07
50370	<|extratoken_114|>	1.74112	3.3e-07
50263	<|extratoken_7|>	1.74113	4e-07
50387	<|extratoken_131|>	1.74116	2.9e-07
50351	<|extratoken_95|>	1.74117	3.5e-07
50319	<|extratoken_63|>	1.7412	2.3e-07
50379	<|extratoken_123|>	1.7412	3.1e-07
50342	<|extratoken_86|>	1.74122	3.9e-07
50302	<|extratoken_46|>	1.74124	2.8e-07
50284	<|extratoken_28|>	1.74124	4.7e-07
50289	<|extratoken_33|>	1.74125	3.1e-07
50311	<|extratoken_55|>	1.74125	3.2e-07
50276	<|extratoken_20|>	1.74126	2.8e-07
50374	<|extratoken_118|>	1.74129	2.9e-07
50320	<|extratoken_64|>	1.74129	3.6e-07
50285	<|extratoken_29|>	1.74132	3.9e-07
50326	<|extratoken_70|>	1.74133	2.3e-07
50362	<|extratoken_106|>	1.74134	3.3e-07
50270	<|extratoken_14|>	1.74134	3.1e-07
50267	<|extratoken_11|>	1.74137	3.5e-07
50339	<|extratoken_83|>	1.74142	3.1e-07
50346	<|extratoken_90|>	1.74143	3.2e-07
50314	<|extratoken_58|>	1.74143	2.8e-07
50338	<|extratoken_82|>	1.74145	3.1e-07
50344	<|extratoken_88|>	1.74146	3.2e-07
50259	<|extratoken_3|>	1.74146	3.7e-07
50395	<|extratoken_139|>	1.74151	4.2e-07
50334	<|extratoken_78|>	1.74151	2.8e-07
50298	<|extratoken_42|>	1.74152	2.9e-07
50336	<|extratoken_80|>	1.74157	2.9e-07
50372	<|extratoken_116|>	1.7416	3.6e-07
50286	<|extratoken_30|>	1.74162	3.5e-07
50393	<|extratoken_137|>	1.74163	3.3e-07
50327	<|extratoken_71|>	1.74164	4.8e-07
50301	<|extratoken_45|>	1.74166	4e-07
50330	<|extratoken_74|>	1.74168	3.1e-07
50353	<|extratoken_97|>	1.74168	2.9e-07
50364	<|extratoken_108|>	1.74172	2.6e-07
50310	<|extratoken_54|>	1.74174	3e-07
50377	<|extratoken_121|>	1.74175	3.4e-07
50357	<|extratoken_101|>	1.74178	3.7e-07
50399	<|extratoken_143|>	1.74184	3.9e-07
50398	<|extratoken_142|>	1.74186	2.3e-07
50293	<|extratoken_37|>	1.74191	4.1e-07
50337	<|extratoken_81|>	1.74197	3.6e-07
50262	<|extratoken_6|>	1.74198	3.2e-07

1 additional entries above threshold

token_id	token	indicator
50256	<|endoftext|>	2.03757