Gear Up: Tokenizer Explorer

Type anything in the box below — a sentence, a poem, some code, or even text in another language. Watch how it gets sliced into tokens, and see what that would cost at scale across different AI models.

A few things to try:

• Type a common English sentence vs. a technical term
• Try a word in Spanish, French, or Japanese — notice how token counts change
• Paste a paragraph and see the cost to process 1,000 such requests
• Try emoji 🏔️ — how many tokens is that?

What you're seeing

Each colored block is one token. The alternating colors just make it easier to see where one token ends and the next begins — they don't mean anything on their own.

The cost table uses the token count from the GPT tokenizer (exact) for GPT models, and an approximation for Claude (~4 characters per token). Real Claude counts may vary slightly — but it's close enough to understand the economics.