Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
flexitok 's Collections
flexitok-mod-tokenizers-zero-padded
flexitok/mod-tokenizers
flexitok/fineweb2-hq-superset-tokenizers
Fineweb2-HQ-Tokenizers
merging-toksuite
baselines

flexitok/mod-tokenizers

updated 6 days ago
Upvote
-

  • flexitok/mod-tokenizers-individual

    3.42M • Updated 4 days ago • 36

  • flexitok/mod-tokenizers-ltr_3digit

    3.93M • Updated 4 days ago • 79

  • flexitok/mod-tokenizers-ltr_2digit

    3.46M • Updated 4 days ago • 72

  • flexitok/mod-tokenizers-ltr_4digit

    8.53M • Updated 4 days ago • 51

  • flexitok/mod-tokenizers-ltr_5digit

    54.6M • Updated 4 days ago • 25

  • flexitok/mod-tokenizers-rtl_2digit

    3.46M • Updated 4 days ago • 71

  • flexitok/mod-tokenizers-rtl_3digit

    3.93M • Updated 4 days ago • 73

  • flexitok/mod-tokenizers-rtl_4digit

    8.53M • Updated 4 days ago • 66

  • flexitok/mod-tokenizers-rtl_5digit

    54.6M • Updated 4 days ago • 29

  • flexitok/mod-arithmetic

    Viewer • Updated 3 days ago • 2.73M • 148

  • flexitok/supertokenizer-mod_tokenizers

    54.6M • Updated 4 days ago • 132
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs