User Guide

Response Alignment

On this page you'll find the following:

Get Started

Response alignment uses the LLM-as-judge technique to determine how well AI responses align with the intent and expectations of the prompt, use case, project brief (if applicable), and the user query.

To get started, go to the version's Chat tab. Use the input box to enter at least 1 query or question to generate an AI response or series of responses.

Tip: Response alignment will analyze all AI responses in the chat session.

New prompt chat
New prompt chat
The chat session
The chat session

Analyze Responses

To analyze responses for alignment, click the purple Analyze responses button in the right sidebar. This will bring up the Analyzing Responses modal box.

Analyze responses button
Analyze responses button
Analyzing responses modal
Analyzing responses modal

After a few moments, the overall alignment score will populate in the right sidebar, along with the alignment scores for each of the AI responses in the chat session.

Response alignment scores
Response alignment scores

Clicking the alignment score for each response will bring up a modal box with detailed analysis that includes a summary and list of pros and cons for how well (or not) the response aligns with the prompt, use case, project brief (if applicable), and the user query.

Response alignment analysis modal
Response alignment analysis modal