User Guide

Prompt Balance

On this page you'll find the following:

Get Started

The prompt balance tool analyzes the structure of a prompt to determine the distribution of phrases and sentences in 4 different categories: Instructions, Entities, Concepts, and Details. This gives you insight into whether certain categories are overused, underused, or just right. Using the prompt balance helps reduce overly verbose responses and helps responses stay focused.

To get started, go to the version's Balance tab and click the purple Analyze balance button.

New prompt balance
New prompt balance

This will bring up the Analyzing Balance modal box. After a few moments the modal box will go away and the balance results will be displayed.

Prompt balance modal
Prompt balance modal

The balance results shows the overall distribution of the 4 categories, with a list of each prompt phrase, its category, and the reason it was assigned to that category. You'll also see how many tokens were used and how long it took to analyze the balance (at the bottom of the page).

The goal of the prompt balance isn't necessarily to get greens across the board. The point is to give you an at-a-glance view of the prompt structure to see if any category is dominating the others.

Prompt balance results
Prompt balance results

Categories and Distribution

Below are the balance categories and their ideal distribution ranges:

Category Ideal Range
Instructions 20 - 35%
Entities 20 - 35%
Concepts 15 - 30%
Details 15 - 30%

Balance Report

With the prompt balance results, a green View report button will appear next to the purple Analyze balance button. Clicking View report will open a flyout panel with detailed analysis of the prompt structure. Here you will find a summary and recommendations, along with feeback for each of the categories.

Prompt balance report
Prompt balance report

Highlight Category Phrases

You can highlight the phrases of a category by clicking its toggle link in the Highlight options above the list of phrases. You can also highlight phrases from multiple categories at the same time.

Highlight options
Highlight options
Highlighted rows
Highlighted rows

Analyze Balance with Different Models

To change which AI model is used to analyze the prompt balance, click the Settings link near the top-right of the page.

Prompt balance settings
The settings option

This will open a side panel where you can select different models and include the prompt's examples as part of the analysis. Make your model selection, click the green Apply button, then analyze the prompt balance.

Including the prompt's examples can greatly increase the time it takes to analzye the prompt structure. It also does not guarantee the AI model will include the examples in its analysis. This is because some AI models deem examples as tertiary information and not part of the main content.

Prompt balance settings
The settings panel