Responsible AI for Developers Blog: Gemma

Analyzing the next token probabilities in large language models

March 26, 2024

Posted by Oscar Wahltinez, Developer Programs Engineer

With the recent launch of Gemma and the Responsible Generative AI Toolkit, developers now have access to a new family of state-of-the-art large language models and tools to responsibly integrate them into real-world applications. In this blog post, we'll learn more about how to measure the token prediction probability, and to perform our own analysis to understand what it tells us about the model's understanding of a piece of text.

Responsible AI for Developers Blog

Featured Post

Developer's Guide to Responsible AI

Analyzing the next token probabilities in large language models

More Information