Token
AI & TechnologyDefinition
The basic unit of text that AI language models process. Roughly equivalent to a word or part of a word — for example, 'unbelievable' might be split into two tokens. Token limits determine how much text a model can handle in a single conversation.
Example in context
When a user hits a 'context limit' error in an AI chat tool, it means they have reached the maximum number of tokens the model can process in one session — typically 100,000 to 200,000 for modern models.
More AI & Technology terms
Artificial Intelligence (AI)algorithmic tradingAPI (Application Programming Interface)AutomationFine-tuning
View all terms →Missing a term?
Help us build the best financial dictionary for investors.