Token
A small piece of text, about three quarters of a word, that an AI model reads or writes.
AI companies count and charge by tokens. A longer question or a longer answer uses more tokens and costs more.
Stories using this word
NVIDIA NeMo Switchyard and LiteLLM route coding AI models to cut dev costs
Developers can now route AI coding agent requests between high-capability and lower-cost models on Amazon Bedrock to lower the overall cost per solved task.
Meta Opens AI Phone Calling Feature to Paying Muse Users
Meta's Muse assistant can now make phone calls to businesses for paying subscribers, helping users avoid tedious hold times.
Cut Amazon Bedrock AI Bills With Four Request Choices
Learn how request-level settings in Amazon Bedrock can change token processing rates and lower your cloud bills without changing models.