3 comments

  • Hugada7 minutes ago
    I think you need to know a lot to understand this, so perhaps it should mention what you should already know in order for it to be comprehensible.
  • lionel-messi19 minutes ago
    this doesnt help at all
  • laurentiurad2 hours ago
    You can paste text and immediately see how it&#x27;s split into tokens, along with token IDs, counts, and other details. It&#x27;s useful for understanding why prompts cost what they do, why context limits behave the way they do, and why models sometimes split words in unexpected places.<p>I made it because I kept explaining tokenization to friends and realized there wasn&#x27;t a simple, interactive tool that focused on learning rather than documentation.<p>I&#x27;d love feedback on:<p>Features that would make it more useful UI improvements Bugs or edge cases you&#x27;ve found<p>Hope it&#x27;s useful!