Prompt Engineering

Tokens are the unit of currency for language models — every API bill, context window, and rate limit is measured in them. But what is a token? Type a sentence and watch it shatter into the pieces an LLM actually sees.