Migrating from Classic Assessment Engine to Smart Assessment Engine
Summarize
Summary of Migrating from Classic Assessment Engine to Smart Assessment Engine
Starting with version 21.0.x of the Third-party Risk Management (TPRM) application, ServiceNow customers can migrate from the Classic Assessment Engine to the Smart Assessment Engine (SAE) by enabling theSmart Assessment Engine enabled (snvdrriskasmt.saeenabled)property. This change makes SAE the default engine and replaces the legacy experience permanently. It is critical to test this change in non-production environments thoroughly before applying it to production to avoid unexpected issues.
Show less
Key Changes and Limitations
- All new assessments must use SAE questionnaire templates; classic templates cannot be used for new assessments after enabling SAE.
- Third-party risk assessors lose the ability to create issues directly from the View responses page; instead, issue generation rules must be used for automatic issue creation.
- Commenting on individual questions is disabled; comments can only be added at the questionnaire level.
- The signature feature is not supported in SAE.
- Automatic attachment of questionnaires to external assessments based on IRQ responses or risk tiers is currently unsupported.
- Unsupported question types in SAE include percentage, ranking, image scale, and custom metric; these must be converted to supported types or recreated after migration.
- Empty sections in migrated templates (due to unsupported questions) must be either populated with supported questions or deleted before publishing, as templates with empty sections cannot be published.
- TPRM scoring migration only proceeds if template migration has no errors.
- Event-driven management rules replace the older Repeating assessments method for scheduling assessments.
Plugin and Application Dependencies
Enabling SAE automatically installs several related applications and plugins, including:
- Vendor Risk Management Workspace application for accessing SAE features.
- Smart Assessment Engine core and supporting plugins such as Designer, Connected, Migration Tools, Dependencies, Post-assessment Actions, Response Automation, and Scoring plugins.
These components enable the full suite of SAE capabilities for assessment creation, management, automation, and scoring.
Migration Process and Workflow
- Templates can be migrated individually or in bulk; migrated templates default to Draft status.
- Each migrated template must be reviewed for accuracy and completeness before publishing.
- Publishing a SAE questionnaire template updates related assessment templates and automation rules to support SAE automatically.
- Issue generation rules require at least one question with the "Enable preferred response" option enabled to function correctly.
- After migration, in-flight assessments can continue using classic templates, but new assessments must use SAE templates.
- Assessment templates and automation rules must be reviewed to confirm they are marked as "Supports smart assessment" to ensure compatibility.
Feature Comparison with Classic Assessment Engine
The Smart Assessment Engine supports a comprehensive set of features equivalent to the Classic engine, including metric types, categories, sections, questions, scoring, response automation, and domain separation. However, some features like question dependency and signature support have changed or are limited in SAE. Automations now leverage tier-based, provider-based, and event-driven management rules, which work only with SAE-supported assessments.
Practical Guidance for ServiceNow Customers
- Plan migration carefully, starting with non-production environments and comprehensive testing.
- Review all existing questionnaires to identify unsupported question types and convert them before migration.
- Ensure all migrated templates are published and related assessment templates are updated to support SAE.
- Update automation rules and issue generation rules to align with SAE capabilities and requirements.
- Leverage the Vendor Risk Management Workspace for improved access and management of SAE assessments.
Additional Resources
For detailed procedures and further configuration, customers should refer to related tasks such as migrating templates, creating SAE questionnaires, and configuring scoring and normalization within assessments.
Learn what changes when you migrate from the Classic Assessment Engine to the Smart Assessment Engine, including feature differences, limitations, and setup requirements. This overview can help you and your team evaluate the impact before enabling the new engine.
Enabling SAE in TPRM
Starting with version 21.0.x of the Third-party Risk Management application, you can enable the Smart Assessment Engine (SAE) by setting the Smart Assessment Engine enabled (sn_vdr_risk_asmt.sae_enabled) property. After setting this property, SAE becomes the default assessment engine and replaces the legacy experience. The transition isn’t reversible.
Set this property in your non-production instances and conduct thorough testing before changing your production instances. Failure to do so may result in unexpected issues.
Smart Assessment Engine limitations
- All new assessments must use SAE questionnaire templates.
- Third-party risk assessors can no longer create issues from the View responses page. Issues generation rules can be used to create issues automatically.
- Third-party risk assessors can no longer create comments on individual questions. They can only use the comment section at the questionnaire level.
- The signature feature isn’t supported.
- Automatic attachment of questionnaires to external assessments based on inherent risk questionnaire (IRQ) responses or IRQ-calculated risk tiers is currently not supported in Smart Assessment Engine.
- The following question types aren’t supported: percentage, ranking, image scale, and custom metric. You must either convert these question types to supported formats before migration or create new questions in the template designer
after migration.Note:For the percentage and image scale question types, customers can use the Number type and Radio button type, respectively. Ranking and custom metric question types aren't supported. You must either convert these question types to supported formats before migration or create new questions in the template designer after migration.
- If a section in the classic template contains only unsupported questions, an empty section is created in the TPRM
SAE template. TPRM
SAE templates with empty sections can’t be published; therefore, you must either add replacement questions to these sections or delete the empty sections before publishing.
For more information on migration results, migration limitations, and creating TPRM SAE questionnaires, see Results of migrating a template to a TPRM SAE template and Create a TPRM SAE questionnaire or document request template.
- The TPRM scoring migration proceeds only if there were no errors during the template migration. If there were errors, the TPRM scoring migration doesn’t occur.
For more information, see Configure scoring for an assessment and Normalization in assessment.
- Event-driven management rules are the default option for scheduling assessments and replaces Repeating assessments.
Plugin dependencies
- The Vendor Risk Management Workspace application [sn_vrm_ws] is automatically installed so you can use the Vendor Risk Management workspace where you can access SAE questionnaires and features.
- The Smart Assessment Engine application and plugins are automatically installed enabling you to use the features of the Smart Assessment Engine for your assessments.
Smart Assessment Engine application package that includes the following:
- Smart Assessment Core plugin [com.sn_smart_asmt]
- Smart Assessment Designer plugin [com.sn_smart_asmt_desg]
- Smart Assessment Connected plugin [com.sn_smart_asmt_conn]
- Smart Assessment Migration Tools plugin [com.sn_smart_asmt_mig]
- Smart Assessment Dependencies plugin [com.sn_smart_asmt_dep]
- Smart Assessment Post-assessment Actions plugin [com.sn_impact_fwk] and [com.sn_smart_imp_auto]
- Smart Assessment Response Automation plugin [com.sn_smart_resp_auto]
- Smart Assessment Scoring plugin [com.sn_smart_scoring]
Migration Overview
After setting the Smart Assessment Engine enabled (sn_vdr_risk_asmt.sae_enabled) property, all TPRM assessments will automatically use SAE templates and automation rules (tier-based rules, provider-based rules, event-driven rules and issue generation rules) that support SAE only. You will be able to continue any in-flight assessment until they are completed. You will not be able to create any new assessments with classic questionnaire templates.
The following diagram shows the questionnaire to TPRM SAE template migration workflow.
- Migrate templates either one by one or in bulk. After migration, all templates are in the Draft state by default.
- Review each migrated questionnaire template individually to confirm that they’re accurate and complete.
- Publish TPRM
SAE questionnaire templates. After publishing, the following actions occur automatically:
- All the related assessment templates are updated to use the migrated questionnaire template. If all the questionnaire templates in an assessment template are published, the assessment template is automatically marked as Support smart assessment.
- All issue generation rules are automatically marked as Support smart assessment if their related questionnaire template is published.
- All automation rules (tier-based rules, provider-based rules, event-driven rules and issue generation rules) are automatically marked as Support smart assessment after their related assessment template is marked as Support smart assessment.
Note:For Issue-generation rules to work as expected when applied to an TPRM SAE questionnaire template, at least one question must have the option, Enable preferred response, set to true. - Review each assessment template to confirm it’s marked as Supports smart assessment. If an assessment template isn’t marked as Supports smart assessment, manually adding a new TPRM SAE questionnaire template to it updates its status.
For more information, see Migrate a template to an SAE template, Create a TPRM SAE questionnaire or document request template, Create an external assessment template, and Create an issue generation rule.
Classic assessment engine to Smart Assessment Engine comparison
The following table shows the comparable features between the Classic assessment engine and Smart Assessment Engine.
| Classic assessment engine features | Smart assessment engine features |
|---|---|
| Metric Type | Template |
| Metric Category | Section |
| Metrics | Questions |
| Additional Information | Justification |
| Assessable Record | Scope |
| Multiple Assessable Records in one Assessment | Combined Assessments |
| Schedule and Trigger Assessments | Trigger Assessment Flow Action |
| Domain Separation | Domain Separation |
| Question Dependency | Conditional Visibility |
| Correct Answer | Preferred Answer |
| Scoring | Scoring |
| Automated response | Response Automation |
The following diagram shows the relationship between assessment templates and questionnaires after enabling SAE.
- Before setting the Smart Assessment Engine enabled (sn_vdr_risk_asmt.sae_enabled) property, the following are used by default.
- Existing questionnaire templates
- Existing assessments
- After setting the Smart Assessment Engine enabled (sn_vdr_risk_asmt.sae_enabled) property, the following are used by default.
- SAE questionnaire templates (New or migrated).
- Assessments marked as Supports smart assessment.
- Tier-based, Provider-based, and Event-driven management rules only work with assessments marked as Supports smart assessment.