TokSuite Model Collection - a r-three Collection

r-three 's Collections

CSC-413-Mystery-Models

moose

toksuite-training-data-detokenized

TokSuite Model Collection

TokSuite Tokenization Robustness Benchmark

TokSuite Model Collection

updated Oct 28, 2025

toksuite/google-gemma-2-2b

Text Generation • 2B • Updated Dec 25, 2025 • 162
toksuite/common-pile-comma-v0.1

Text Generation • 2B • Updated Dec 25, 2025 • 236
toksuite/meta-llama-Llama-3.2-1B

Text Generation • 2B • Updated Dec 25, 2025 • 171
toksuite/microsoft-Phi-3-mini-4k-instruct

Text Generation • 1B • Updated Dec 25, 2025 • 124
toksuite/gpt2

Text Generation • 1B • Updated Dec 25, 2025 • 162
toksuite/bigscience-bloom

Text Generation • 2B • Updated Dec 25, 2025 • 299
toksuite/facebook-xglm-564M

Text Generation • 2B • Updated Dec 25, 2025 • 174
toksuite/google-byt5-small

Text Generation • 1B • Updated Dec 25, 2025 • 238
toksuite/mistralai-tekken

Text Generation • 2B • Updated Dec 25, 2025 • 296
toksuite/tokenmonster-englishcode-32000-consistent-v1

Text Generation • 1B • Updated Dec 25, 2025 • 145
toksuite/google-bert-bert-base-multilingual-cased

Text Generation • 2B • Updated Dec 25, 2025 • 213
toksuite/Qwen-Qwen3-8B

Text Generation • 2B • Updated Dec 25, 2025 • 107
toksuite/tiktoken-gpt-4o

Text Generation • 2B • Updated Dec 25, 2025 • 664
toksuite/CohereLabs-aya-expanse-8b

Text Generation • 2B • Updated Dec 25, 2025 • 129