Tokenizer Visualization
Choose a Tokenizer:
gpt-4o / gpt-4o-mini (o200k_base)
gpt-4-turbo / gpt-4 (cl100k_base)
Gemma / Gemma 2
Gemma 3
Sarvam AI
krutrim-ai
Enter Text:
Visualize