mandeal303 / tiktokenizer
An interactive playground for comparing how different language models tokenize the same text.
Why this job: matched by what the repo talks about: text, model, language, same
What it does
Online playground for openai/tiktoken, calculating the correct number of tokens for a given prompt.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 7 days ago
- Stars
- 50
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.0.0
- Released 7 days ago
- Built with
- TypeScript
- 92% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- None
- No issues filed
- Pull requests
- 0 merged
- 0 waiting
- Releases
- 1
- 1 in the last year
- No contributing guide
- No security policy
- No code of conduct
More: languages, topics and project record
Languages
- TypeScript 92%
- JavaScript 8%
- CSS <1%
Topics
- ai
- llm
- nextjs
- react
- tiktoken
- tokenizer
- visualization
Project record
- JobSpeech and audio
- StatusNew to our list
- Commits1
- Forks0
- Watching0
- CreatedNov 5, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026