Digital Product Release policies
Summarize
Summary of Digital Product Release Policies
The Digital Product Release Policy Content Pack provides a framework for automating phase gate verification and continuous evaluation of software artifacts. ServiceNow customers can utilize or customize these policies to ensure their configuration data content is compliant and manage the full lifecycle of Policy as Code Engine (PaCE) policies. Note that base system policies cannot be modified, but copies can be created for customization.
Show less
Key Features
- Policy Validation: Policies ensure that all completed stories have associated commits and that all planned stories are completed, contributing to a non-compliant status if criteria are not met.
- Code Coverage and Testing: Policies monitor code coverage, integration tests, load tests, regression tests, smoke tests, system tests, and user acceptance tests, all requiring a minimum pass percentage to ensure release quality.
- Vulnerability Checks: A policy checks for critical vulnerabilities, flagging any release that contains vulnerabilities categorized as blocker, critical, high, or major.
- Change Request Validation: Ensures all change requests are in specified states throughout the release phases, helping maintain control over changes.
Key Outcomes
By implementing these policies, ServiceNow customers can:
- Automate compliance checks throughout the software release process.
- Ensure high-quality standards are met before product and service releases.
- Quickly identify and address potential issues within the release lifecycle.
- Maintain oversight on change requests and their statuses across different phases.
It is important to note that certain policies are not applicable to service releases, including those related to integration tests, regression tests, and code coverage. Understanding these limitations will help streamline compliance processes effectively.
The Digital Product Release Policy Content Pack contains a set of policies to automate phase gate verification and continuous evaluation of software artifacts.
These policies are for both product and service releases. However, a few don't apply to service releases. For more information about those policies, see Policies not applicable to service releases.
All Completed Stories Have Associated Commits (all_completed_stories_have_associated_commits)
This policy checks whether all the completed stories of a release have associated commits.
The policy results into a non-compliant status when a completed story of a release has no associated commits.
All Planned Stories Are Completed (all_planned_stories_are_completed)
This policy checks whether all the planned stories of a release are completed. This policy also checks if the product version is associated with plan version. If it’s associated with plan version, it checks all stories associated with plan version in addition to the stories associated with epics in features or enhancements.
The policy results into a non-compliant status when the completion percentage of stories planned for a release isn’t 100%. The completion percentage of planned stories is calculated as (Total completed
stories/Total planned stories) * 100.
Code Coverage Exceeds Threshold (code_coverage_threshold)
This policy checks whether the percentage of code coverage exceeds the threshold value.
- Input arguments
- minCodeCoverageThreshold
- The minimum accepted value for the code coverage for a release.
- Default value:
100 - Type: Integer
- Usage: Mandatory
Integration Test Pass Exceeds Threshold (integration_test_pass_threshold)
This policy checks whether the percentage of passed integration tests is not less than the threshold value.
The policy results into a non-compliant status when the percentage of passed integration tests is less than the specified threshold value. The passed integration tests percentage is calculated as (Total passed integration
tests for all artifact versions/Total integration tests for all artifact versions) * 100.
- Input arguments
- minTestPassThreshold
- The minimum accepted value for the percentage of passed integration tests.
- Default value:
100 - Type: Integer
- Usage: Mandatory
Load Test Pass Exceeds Threshold (load_test_pass_threshold)
This policy checks whether the percentage of passed load tests is not less than the threshold value.
The policy results into a non-compliant status when the percentage of passed load tests is less than the specified threshold value. The passed load tests percentage is calculated as (Total passed load tests for all artifact
versions/Total load tests for all artifact versions) * 100.
- Input arguments
- minTestPassThreshold
- The minimum accepted value for the percentage of passed load tests.
- Default value:
100 - Type: Integer
- Usage: Mandatory
No Critical Vulnerabilities Found (no_critical_vulnerabilities)
This policy checks whether there are no critical vulnerabilities found in a release.
The policy results into a non-compliant status when the total number of vulnerabilities categorized as blocker, critical, high, or major is greater than zero.
Regression Test Pass Exceeds Threshold (regression_test_pass_threshold)
This policy checks whether the percentage of passed regression tests isn’t less than the threshold value.
The policy results into a non-compliant status when the percentage of passed regression tests is less than the specified threshold value. The passed regression tests percentage is calculated as (Total passed regression
tests for all artifact versions/Total regression tests for all artifact versions) * 100.
- Input arguments
- minTestPassThreshold
- The minimum accepted value for the percentage of passed regression tests.
- Default value:
100 - Type: Integer
- Usage: Mandatory
Smoke Test Pass Exceeds Threshold (smoke_test_pass_threshold)
This policy checks whether the percentage of passed smoke tests is not less than the threshold value.
The policy results into a non-compliant status when the percentage of passed smoke tests is less than the specified threshold value. The passed smoke tests percentage is calculated as (Total passed smoke tests for all
artifact versions/Total smoke tests for all artifact versions) * 100.
- Input arguments
- minTestPassThreshold
- The minimum accepted value for the percentage of passed smoke tests.
- Default value:
100 - Type: Integer
- Usage: Mandatory
System Test Pass Exceeds Threshold (system_test_pass_threshold)
This policy checks whether the percentage of passed system tests is not less than the threshold value.
The policy results into a non-compliant status when the percentage of passed system tests is less than the specified threshold value. The passed system tests percentage is calculated as (Total passed system tests for all
artifact versions/Total system tests for all artifact versions) * 100.
- Input arguments
- minTestPassThreshold
- The minimum accepted value for the percentage of passed system tests.
- Default value:
100 - Type: Integer
- Usage: Mandatory
User Acceptance Test Pass Exceeds Threshold (user_acceptance_test_pass_threshold)
This policy checks whether the percentage of passed user acceptance tests is not lower than the threshold value.
The policy results into a non-compliant status when the percentage of passed user acceptance tests is less than the specified threshold value. The passed user acceptance tests percentage is calculated as (Total passed user
acceptance tests for all artifact versions/Total user acceptance tests for all artifact versions) * 100.
- Input arguments
- minTestPassThreshold
- The minimum accepted value for the percentage of passed user acceptance tests.
- Default value:
100 - Type: Integer
- Usage: Mandatory
Validate change requests (validate_change_requests)
This policy checks whether all change requests are in the given states, across all phases or a single phase of a release.
The policy results into a non-compliant status when at least one change request is not in any of the given states.
- Input arguments
- Validate all phases: Determines whether to check the state of change requests in all phases or in a single phase of a release.
- Default value:
False - Type: Boolean
- Usage: Mandatory
- Default value:
Policies not applicable to service releases
- all_completed_stories_have_associated_commits
- integration_test_pass_threshold
- regression_test_pass_threshold
- system_test_pass_threshold
- code_coverage_threshold
- no_critical_vulnerabilities
- load_test_pass_threshold
- smoke_test_pass_threshold
- user_acceptance_test_pass_threshold