Normalization and transformation data jobs

  • Release version: Yokohama
  • Updated January 30, 2025
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Normalization and transformation data jobs

    Normalization and transformation data jobs in ServiceNow enable administrators to modify field values during data normalization and transformation processes. These jobs must be manually initiated by administrators to apply changes. By default, transformation records are set to Test mode, preventing manual job execution until this mode is disabled. Most data jobs include a rollback option to undo changes after completion.

    Show full answer Show less

    The system offers several predefined data jobs for different normalization and transformation tasks. When the Field Normalization plugin is active, normalization runs automatically on record insertion based on defined rules. Without this plugin, data jobs are responsible for normalization, preserving previous field values to support rollback.

    Key Features

    • Pending value collection: Collects field values for upcoming normalization runs without applying changes, so no rollback is needed.
    • Normal value change: Updates field values when normal values change, with rollback capability to revert to previous values.
    • Alias application: Normalizes fields matching an alias, supporting rollback to prior values.
    • Rule application: Normalizes fields matching a rule, also supporting rollback.
    • Coalesce too normal: Consolidates duplicate reference records into a single normalized record, with rollback restoring duplicates but not previous references.
    • Transform application: Applies field transformations based on transformation records (must not be in Test mode), with rollback to prior values.

    Practical Implications for ServiceNow Customers

    Administrators should be aware that transformation records default to Test mode, which must be disabled before running transformation data jobs. Rollback options provide safety by allowing reversion of applied changes. Activating the Field Normalization plugin streamlines normalization by automating it on record inserts, reducing reliance on manual data jobs.

    Understanding and properly managing these data jobs ensures accurate, consistent field normalization and transformation, supporting data integrity and operational efficiency in ServiceNow environments.

    The system uses data jobs to change field values during normalization and transformation.

    Administrators must manually start data jobs that apply field changes. All transformation records open in Test mode by default, which blocks administrators from running manual data jobs that apply changes to existing data. Most data jobs have a roll back option to revert changes after the job completes. By default, the system provides these data jobs.

    Note:

    If the Field Normalization plugin is active, the normalization engine executes on insert of records into a table according to normalization rules. To learn more about this plugin, see Activate Field Normalization.

    If the Field Normalization plugin is not active, a data job runs to normalize the values. The data job saves the previous values in the rolled back fields to revert them if necessary.

    Name Used for Description
    Pending value collection Normalization The system runs this job to collect field values that will change during the next field normalization run. The system runs this job whenever you insert or update a field normalization record. Since this data job does not change any field values, there is no roll back option.
    Normal value change Normalization Run this job to rerun field normalization and update field values when you change a normal value. The system creates this job whenever you change a normal value. Roll back the data job to revert the normalized fields to the previous normal value.
    Alias application Normalization Run this job to normalize all field values that match an alias. The system creates this job whenever you create or update an alias. Roll back the data job to revert normalized fields to their previous values.
    Rule application Normalization Run this job to normalize all field values that match a rule. The system creates this job whenever you create or update a rule. Roll back the data job to revert normalized fields to their previous values.
    Coalesce too normal Normalization Run this job to normalize the reference field values by replacing references to multiple duplicate records with one reference to a normalized record. The system creates this job whenever you change a normal value that applies to a reference field. Roll back the data job to restore the duplicate records as valid options. The rollback does not restore references to the previous records.
    Transform application Transformation Run this job to transform all field values that match the transformation conditions. You cannot start this job while the Transformation record is in Test mode. The system creates this job whenever you create or update a transformation record. Roll back the data job to revert transformed fields to their previous values.