Inbound event table data archiving and cleanup
Summarize
Summary of Inbound event table data archiving and cleanup
This feature in the Yokohama release enables ServiceNow customers to efficiently manage inbound event data by archiving and purging records older than a specified retention period. It helps control table size growth and maintain instance performance by using automated table rotation and cleanup processes.
Show less
Key Features
- Retention Policy and Table Rotation: Configure retention policies with table rotation on the auto-flush form to retain up to eight weeks of event data, segmented into eight preconfigured shards representing weekly data.
- Processed Inbound Events Table Management: The DevOps processed inbound events table stores copies of events in the states "processed" and "ignored." Table rotation is automatically activated after 56 days of data accumulation to archive and clean up old data.
- Scheduled Jobs and Table Cleaners: Two weeks after upgrading, a scheduled job is auto-enabled to run every seven days, activating table cleaners that purge inbound event records exceeding the age limit. Table cleaners target events in different states such as "new," "retry," "in-progress," "deferred," "processed," and "ignored," based on the age specified in seconds.
- Auto-update Frequency: Table cleaners for "processed" and "ignored" events automatically update to run every 30 minutes when event data older than seven weeks exists and the scheduled job has been active for two weeks.
Practical Benefits
- Maintains optimal database performance by controlling inbound event table size.
- Ensures compliance with data retention policies by automating archival and cleanup of outdated event data.
- Reduces manual intervention through automated scheduled jobs and cleaners.
- Provides flexibility to modify table rotation settings via System Definitions if customization is needed.
Use table cleaners on the inbound events table to purge event data records beyond a specified period. Configure a retention policy with table rotation on the auto-flush form to manage table size growth and archiving data beyond the specified duration.
Data management
The data management feature allows you to enable archiving and purging of inbound event data. Database rotation and table cleanup configurations are enabled to ensure that eight weeks of event data is retained. Instance performance is preserved using ServiceNow AI Platform features such as Database rotation, table rotation, and table cleanup. A scheduled job is auto-enabled two weeks after you upgrade.
Table rotation on processed inbound events table
The DevOps processed inbound events [sn_devops_processed_inbound_event_list.do] table contains copies of event data from the DevOps inbound events [sn_devops_inbound_list.do] table, that is in state 'processed' and 'ignored'.
Scheduled jobs and Table cleaners
- A week after you upgrade, and the processed inbound table has records older than seven weeks.
- Two weeks after you upgrade.
- Table cleaners are activated and run on the inbound events [sn_devops_inbound_table_list.do] for events in the following states.
- Processed
- Ignored
sys_created_onfield. - Table cleaners are activated and run on the inbound events table [sn_devops_inbound_table_list] for events in the following states.
- New
- Retry
- In-progress
- Deferred
sys_created_onfield.
Auto-updates to table cleaner frequency
- Two weeks have passed since the scheduled job is active.
- The processed inbound event table has event data older than 7 weeks.