Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

gsaltintas
/
supertokenizer-tiktoken-gpt-4o

Model card Files Files and versions
xet
Community
supertokenizer-tiktoken-gpt-4o
8.43 GB
  • 1 contributor
History: 6 commits
gsaltintas's picture
gsaltintas
Upload checkpoint for tiktoken/gpt-4o
4ea4ade verified 3 months ago
  • .gitattributes
    1.52 kB
    initial commit 3 months ago
  • model.pth

    Detected Pickle imports (3)

    • "torch._utils._rebuild_tensor_v2",
    • "torch.FloatStorage",
    • "collections.OrderedDict"

    What is a pickle import?

    8.42 GB
    xet
    Upload checkpoint for tiktoken/gpt-4o 3 months ago
  • tiktoken--gpt-4o.yaml
    55 Bytes
    Upload tiktoken--gpt-4o.yaml with huggingface_hub 3 months ago
  • tiktoken--gpt-4o_info.json
    63 Bytes
    Upload tiktoken--gpt-4o_info.json with huggingface_hub 3 months ago
  • tiktoken--gpt-4o_super_mapping.json
    3.46 MB
    Upload tiktoken--gpt-4o_super_mapping.json with huggingface_hub 3 months ago
  • tiktoken--gpt-4o_vocab.json
    6.62 MB
    Upload tiktoken--gpt-4o_vocab.json with huggingface_hub 3 months ago