Responsible AI for Developers Blog

Analyzing the next token probabilities in large language models

March 26, 2024

Posted by Oscar Wahltinez, Developer Programs Engineer

With the recent launch of Gemma and the Responsible Generative AI Toolkit, developers now have access to a new family of state-of-the-art large language models and tools to responsibly integrate them into real-world applications. In this blog post, we'll learn more about how to measure the token prediction probability, and to perform our own analysis to understand what it tells us about the model's understanding of a piece of text.

A Comprehensive Guide to Producing Text Embeddings Using TensorFlow and PaLM 2

August 21, 2023

Posted by Oscar Wahltinez, Developer Programs Engineer

How text embeddings are used

Text embeddings have been shown to be very effective for a variety of machine learning tasks. They are a powerful tool that can be used to represent the meaning of text in a way that can be understood by machines.

Developer's Guide to Responsible AI

June 29, 2023

Posted by Oscar Wahltinez, Developer Programs Engineer

In this blog post, we’ll focus on the key Responsible AI concepts that developers, specifically, need to know when deploying AI.