Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
stefan-it
/
nanochat-german-tokenizer
like
0
stefan-it/nanochat-german-data
German
nanochat
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
nanochat-german-tokenizer
9.83 MB
1 contributor
History:
12 commits
stefan-it
feat: add model config
0049e29
verified
2 months ago
.gitattributes
1.52 kB
initial commit
2 months ago
README.md
2.28 kB
docs: add new section with tokenizer stats
2 months ago
config.json
736 Bytes
feat: add model config
2 months ago
token_bytes.pt
264 kB
xet
feat: add newly trained tokenizer (final one)
2 months ago
tokenizer.json
8.68 MB
feat: add HF tokenizer version
2 months ago
tokenizer.pkl
889 kB
xet
feat: add newly trained tokenizer (final one)
2 months ago
tokenizer_config.json
510 Bytes
feat: add tokenizer config
2 months ago
