mandeal303/tiktokenizer
An interactive playground for comparing how different language models tokenize the same text.
GitHub repository with 50 stars and 0 forks.
Language: TypeScript
Topics: ai, llm, nextjs, react, tiktoken, tokenizer, visualization