View Task Intelligence Analytics
Summarize
Summarized using AI
This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.
Summary of View Task Intelligence Analytics
The Task Intelligence Analytics dashboard in ServiceNow Customer Service Management (CSM) enables you to monitor the performance and business impact of your Task Intelligence models over time. It provides visual insights into how your trained models are performing, how agents are utilizing predictions, and the overall effect on case resolution efficiency.
Show less
Key Features
- Model Performance Monitoring: Visual graphs display the number of predictions accepted by agents, including categorization, sentiment, and language models if enabled. This helps track model learning progress.
- Mean Time to Resolve (MTTR): A line graph shows average case resolution time to assess if model predictions are helping reduce time to resolve cases.
- Prediction Usage Tracking: Widgets show the number of correct predictions accepted, incorrect predictions replaced, and predictions skipped by the model, with trends indicating when retraining might be needed.
- Performance Overview Table: Displays mean percentages of correct, incorrect, and skipped predictions per model and output field combination for detailed analysis.
- Field-Level Usage Charts: Bar charts track accepted, replaced, and skipped predictions for individual fields over time, with options to view counts or percentages and compare against training data baselines.
- Multi-Model Comparison: Supports multi-select for models and output fields, allowing comparison of how different models’ predictions are used by agents.
- Persistent Configuration: Dashboard selections such as models, fields, and view options are retained upon page refresh for user convenience.
Using Task Intelligence Analytics
Access the dashboard via All > Task Intelligence for Customer Service > Monitoring. You can view analytics for all models collectively or select individual models created through the Task Intelligence Admin Console. Use the model selector to filter analytics and apply or clear selections as needed.
Why This Matters
This dashboard empowers your organization to:
- Gain clear visibility into the effectiveness and adoption of Task Intelligence models.
- Identify when model retraining is necessary based on agent interaction trends.
- Measure the impact of AI-driven predictions on reducing case resolution times.
- Make data-driven decisions to optimize your customer service workflows and improve agent productivity.
View the Task Intelligence for CSM Analytics dashboard to monitor the model performance over time, track the business value, and see what predictions your agents did or didn't use.
The dashboard uses visual representations to provide you with an overview of how each model is performing. You can see the number of predictions from each model and the overall mean time that it takes to resolve the cases in your organization.
The following example shows the Get an overview and See how your trained model is doing sections within the dashboard.
Get an overview
The dashboard contains visual representations that provide you with the business value of the model.- Number of predictions
- The line graph shows the number of correct predictions that agents have accepted over time for all the categorization models combined. If the sentiment and language models are activated, the correct predictions for those models are shown as well. As the model continues to learn, it can increase the number of predictions that agents accept.
- Mean time to resolve (MTTR)
- The line graph shows the average amount of time that it takes to resolve cases over time. As the model makes more predictions, the MTTR should decrease as the predictions help your agents.
The Task Intelligence Analytics page includes the following data about the predicted fields and how they impact your business:
- The number of predicted fields.
- The number of predictions that agents used.
- The number of predictions that agents changed.
See how your trained model is doing
The dashboard uses visual representations to help you monitor the utilization of predictions by the model over time. By selecting a specific model and output field, you can view the number of predictions that were accepted or
replaced by the agent and compare them to the baseline.
- Predictions agents accepted
- The widget shows the correct predictions that your agents used during case management over time. If this number is trending downward, you can look to retrain your model.
- Predictions agents replaced
- The widget shows the incorrect predictions that your agents removed during case management over time. If this number is trending upward, you can look to retrain your model.
- Predictions the model skipped
- The widget shows the number of predictions that were skipped by the model based on the model, output field, and date range selection.
- Performance overview
- The performance overview table shows the mean percentage values for correct, incorrect, and skipped data for each combination of model and output field.
- Track usage of individual field predictions over time
- The bar chart tracks the usage of the individual field predictions over time. Each bar in the chart shows three components, which are the predictions accepted, the predictions replaced, and the predictions that were skipped by the model. A red outline around each bar represents the total number of records for each day. To compare specific components, navigate to the legends and deselect the ones that you don't want to include so that you can have a more customized and focused comparison based on user preferences. By default, the view displays the number of predictions. However, you have the option to switch to the percentage view by toggling the Show Percentage option. In the percentage view, you can also access the information about the baseline that was replaced and accepted, which is derived from the training data. This option enables you to gain insights into the performance of the model with the baseline.
- Track usage of model predictions over time
- The bar chart monitors the usage of the model over time and is similar to the bar chart in the “Track usage of individual field predictions over time” data. The field selections enable users to compare predictions over time across a maximum of three fields.
Note:
- When you refresh the page, the configurations, model selection, fields, usage type, and Show percentage toggle selection are retained.
- The Model and Output field options support multi-select functionality so that you can compare the average number of training records and analyze how your agents use the predictions of different models. When multiple models are selected, the Compare how agents used models' predictions section enables your agents to compare the selected models across different usage types. The chart also supports toggling between the count and percentage. It also displays the baselines for accepted and replaced predictions when you’re using the percentage model.
Using Task Intelligence analytics
Navigate to to access the Task Intelligence Analytics page.
You can view the analytics for all of your models or each individual model. To select a model, do the following actions:
- Select Model to access analytics for an individual model.
- Select a model from the list of models that have been created from the Task Intelligence Admin Console.
- Select Apply.