A token is a numerical representation that lets a neural network process text. Its size can range from an individual letter to a whole word.
Authority Links
Related Terms
Ready to deploy AI and LLM workflows in production?
From generative AI strategy to custom agent development and retrieval architectures, we help you scale AI responsibly.
Discuss your AI project