Amazon EMR Cluster pattern-based discovery
Summarize
Summary of Amazon EMR Cluster pattern-based discovery
The Amazon EMR Cluster pattern-based discovery enables ServiceNow customers to identify and map Amazon EMR Clusters running on EC2 within their AWS cloud environments. This functionality is part of the Discovery and Service Mapping Patterns application, which requires adherence to AWS discovery prerequisites and proper configuration to avoid duplicate discovery and ensure accurate data collection.
Show less
Key Features
- Pattern Activation: The EMR Cluster discovery pattern is disabled by default. From Visibility Content version 6.28.0 onward, activating or deactivating patterns does not count as customization, and updates continue to apply. Patterns reset to their latest predefined versions after upgrades while preserving activation status.
- Data Population: The discovery runs the Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern, which populates data in both CMDB and non-CMDB tables:
- Non-CMDB Data: Found under AWS-specific tables accessible via the ServiceNow navigation, including cluster name, ARN, cluster ID, and state (e.g., RUNNING, WAITING, TERMINATING).
- CMDB Data: Stores comprehensive resource information such as resource type (AWS::EMR::Cluster), install and operational statuses, and references to related configuration items.
- CI Relationships and References: The pattern establishes relationships such as "Hosted on::Hosts" linking EMR clusters to AWS datacenters. It also creates references between EMR Cluster records and their corresponding Cloud Resource entries to maintain data integrity and support service mapping.
- AWS Tag Discovery: The pattern collects AWS tags associated with EMR clusters and stores them in the Key Value [cmdbkeyvalue] table, enabling tag-based filtering and management.
Practical Considerations for ServiceNow Customers
- Prerequisites: Ensure AWS discovery prerequisites are met and verify that EMR Cluster resources are not listed in the Resource Inclusion List to prevent duplication.
- Pattern Management: Activate the EMR Cluster pattern following ServiceNow guidelines to enable discovery and keep patterns updated through application upgrades.
- Data Usage: Use the populated CMDB and non-CMDB data to enhance visibility into your AWS EMR environment, support service mapping, and leverage tag information for operational insights.
Discovery and Service Mapping Patterns finds Amazon EMR Clusters on your cloud environment running on EC2. Discovering some of these resources may require updating to the latest version of the Discovery and Service Mapping Patterns application from the ServiceNow Store.
Pattern-based discovery and mapping requirements
- Verify the AWS discovery prerequisites
- For more information, see the prerequisites section in Amazon AWS Cloud components discovery using patterns.
- Remove resources from the Resource Inclusion List table
- Verify that the relevant resource isn't listed in the Resource Inclusion List [sa_cloud_inventory_resource_whitelist] table to avoid duplicate discovery. For more information on removing resources from the Resource Inclusion List, see Amazon Web Services (AWS) Resource Inventory.
- Enable the relevant pattern
- The pattern for this service is disabled by default. Starting with Visibility Content version 6.28.0, activating or deactivating a pattern won't be considered a customization, and it will continue to receive updates. Patterns that were previously activated or deactivated will reset to the latest predefined version after upgrading while retaining the last active field value. For more information on enabling patterns, see Activate a disabled pattern.
Discovery and Service Mapping Patterns application populates data in both CMDB and non-CMDB tables.
Data stored in non-CMDB tables
Discovery and Service Mapping Patterns application populates data in the non-CMDB table when running the Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern.
You can review the non-CMDB AWS tables by navigating to . You can also search the navigation filter for the specific pattern name.
| Field | Description |
|---|---|
| Name [name] | Name of the EMR cluster. |
| Object ID [object_id] | The Amazon Resource Name (ARN) of the EMR cluster. |
| Cluster ID [cluster_id] | The unique identifier of the EMR cluster. |
| State [state] | Current state of the EMR cluster.
For example: RUNNING, WAITING, or TERMINATING. |
| Configuration Item [configuration_item] | References the Cloud Resource [cmdb_ci_cmp_resource] table. |
Data stored in CMDB tables
Discovery and Service Mapping Patterns application populates data in the CMDB when running the Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern.
| Field | Description |
|---|---|
| Name [name] | Name of the EMR cluster. |
| Object ID [object_id] | The ARN of the EMR cluster. |
| Resource type [resource_type] | Type of resource. The value is set to AWS::EMR::Cluster. |
| Install Status [install_status] | Install status of the resource. Default value is Installed. |
| Operational status [operational_status] | Operational status of the resource. Default value is Operational. |
CI relationships
The Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern creates the following relationships and references to support Amazon EMR Cluster discovery. References link to records in other tables and don't appear in the CI Relationship [cmdb_rel_ci] table.
| CI | Relationship | CI |
|---|---|---|
| Cloud Resource [cmdb_ci_cmp_resource] | Hosted on::Hosts | AWS Datacenter [cmdb_ci_aws_datacenter] |
| CI | Field | Referenced CI |
|---|---|---|
| AWS EMR Cluster [cmdb_aws_emr_cluster] | Configuration Item [configuration_item] | Cloud Resource [cmdb_ci_cmp_resource] |
| Key Value [cmdb_key_value] | Configuration item [configuration_item] | Cloud Resource [cmdb_ci_cmp_resource] |
AWS Tag discovery
The Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern collects tags and populates them in the Key Value [cmdb_key_value] table.
| Field | Description |
|---|---|
| Key [key] | Tag name. |
| Value [value] | Tag value. |
| Configuration item [configuration_item] | References the Cloud Resource [cmdb_ci_cmp_resource] table. |