Search metrics and analytics for AI Search Tuning evaluations

  • Freigeben Version: Australia
  • Aktualisiert 12. März 2026
  • 2 Minuten Lesedauer

    • Search metrics and analytics provide an overview of search relevance quality for evaluated search applications. An evaluation's metrics and analytics are derived from search result ratings assigned by evaluation reviewers.

    Search administrators can access an evaluation's search quality graph and overall progress meter by navigating to All > AI Search Tuning > Admin Homepage. To view the evaluation's full analytics page with all metrics, select View full analytics.
    Hinweis:
    AI Search Tuning only populates the search quality graph and analytics page metrics for evaluations with 20 or more reviewed search terms. The overall progress meter is always populated.

    Search quality graph

    This metric appears on the AI Search Tuning administrator homepage and on the full analytics page. The Score comparison by search terms link only appears in the card on the full analytics page.

    Abbildung : 1. Search quality card
    Search quality card showing graphs with percentage quality scores for an evaluation's baseline and comparator search applications.
    The Search quality card shows overall search relevance quality for the baseline and comparator search applications specified in an evaluation. An application's search quality score indicates how well its top five search results for reviewed search terms align with evaluation reviewers' search result ratings for those terms. Higher quality scores indicate more relevant search results and better overall search relevancy.
    • In San Diego and previous releases, search quality scores are displayed as numbers between 0 and 100 inclusive.
    • Starting in the Tokyo release, search quality scores are displayed as percentages.

    To view score comparisons for individual search terms from the evaluation, select Score comparison by search terms. This link only appears in the search quality card on the full analytics page. Select Back to return to the full analytics page.

    Overall progress graph

    This metric appears on the AI Search Tuning administrator homepage and on the full analytics page.

    Abbildung : 2. Overall progress card
    Overall progress card showing graph with counts of reviewed and available search terms for the evaluation.

    The Overall progress graph shows the count of search terms reviewed and the total number of search terms available for review in an evaluation.

    Exact result in top 5 graph

    This metric only appears on the full analytics page.

    Abbildung : 3. Exact result in top 5 card
    Exact result in top 5 card showing graphs with percentage scores for an evaluation's baseline and comparator search applications.

    The Exact result in top 5 card shows the percentage of reviewed search terms for which a reviewer rated at least one of the top five search results as an exact match. Higher scores indicate more relevant results appearing first for evaluated searches.

    AI Search Catalog Item Genius Results

    This metric only appears on the full analytics page.

    Abbildung : 4. AI Search Catalog Item Genius Results card
    AI Search Catalog Item Genius Results card showing correct, incorrect, and miss percentage scores for an evaluation's baseline and comparator search applications.
    The AI Search Catalog Item Genius Results card shows correct, incorrect, and miss percentages for Catalog Item Genius Results in the two evaluated search applications. These category percentages are defined as follows.
    Category Description
    Correct The sum of the following percentages:
    • The percentage of reviewed search terms that returned a Catalog Item Genius Result rated as an exact or useful match.
    • The percentage of reviewed search terms that returned no Catalog Item Genius Result and that had no Catalog Item search results rated as exact or useful matches.
    Incorrect The percentage of reviewed search terms that returned a Catalog Item Genius Result rated as irrelevant.
    Miss The percentage of reviewed search terms that returned no Catalog Item Genius Result and that had no Catalog Item search results rated as exact or useful matches.

    To view a search application's Catalog Item Genius Results details for individual search terms, select View results of each search term for the desired application. Select Back to return to the full analytics page.