Amazon EMR Cluster pattern-based discovery
Summarize
Summary of Amazon EMR Cluster pattern-based discovery
The Amazon EMR Cluster pattern-based discovery enables ServiceNow customers to detect and map Amazon EMR Clusters running on EC2 instances within their cloud environments. This discovery is performed using the Discovery and Service Mapping Patterns application, which requires adherence to AWS discovery prerequisites and proper pattern activation.
Show less
Key Features
- Pattern Activation: The EMR Cluster discovery pattern is disabled by default and must be enabled. From Visibility Content version 6.28.0 onward, enabling or disabling patterns is not considered a customization and patterns receive continuous updates.
- Resource Inclusion List Management: To avoid duplicate discovery, ensure that EMR Cluster resources are not listed in the Resource Inclusion List table [sacloudinventoryresourcewhitelist].
- Data Population: The discovery populates data into both CMDB and non-CMDB tables using the Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern.
- Non-CMDB Data: Non-CMDB data can be reviewed under Configuration > AWS or by searching the specific pattern name. This includes details such as cluster name, ARN, cluster ID, and state.
- CMDB Data: CMDB tables, specifically the Cloud Resource [cmdbcicmpresource], are populated with key details such as resource type (AWS::EMR::Cluster), install and operational status, and linkage to the EMR cluster name and ARN.
- CI Relationships and References: The pattern establishes relationships such as "Hosted on" linking AWS EMR Clusters to AWS Datacenters, supporting accurate mapping in the CMDB.
- AWS Tag Discovery: Tags associated with EMR Clusters are collected and stored in the Key Value [cmdbkeyvalue] table, linking tags to their respective cloud resources.
Practical Implications for ServiceNow Customers
By enabling and properly configuring the Amazon EMR Cluster discovery pattern, customers can maintain an accurate, up-to-date inventory of EMR clusters within their AWS environment. This supports improved cloud resource visibility, configuration management, and service mapping efforts. The structured data in both CMDB and non-CMDB tables allows for detailed reporting and relationship mapping essential for operational management and compliance.
Discovery and Service Mapping Patterns finds Amazon EMR Clusters on your cloud environment running on EC2. Discovering some of these resources may require updating to the latest version of the Discovery and Service Mapping Patterns application from the ServiceNow Store.
Pattern-based discovery and mapping requirements
- Verify the AWS discovery prerequisites
- For more information, see the prerequisites section in AWS discovery using patterns.
- Remove resources from the Resource Inclusion List table
- Verify that the relevant resource isn't listed in the Resource Inclusion List [sa_cloud_inventory_resource_whitelist] table to avoid duplicate discovery. For more information on removing resources from the Resource Inclusion List, see AWS Resource Inventory discovery with Patterns.
- Enable the relevant pattern
- The pattern for this service is disabled by default. Starting with Visibility Content version 6.28.0, activating or deactivating a pattern won't be considered a customization, and it will continue to receive updates. Patterns that were previously activated or deactivated will reset to the latest predefined version after upgrading while retaining the last active field value. For more information on enabling patterns, see Activate a disabled pattern.
Discovery and Service Mapping Patterns application populates data in both CMDB and non-CMDB tables.
Data stored in non-CMDB tables
Discovery and Service Mapping Patterns application populates data in the non-CMDB table when running the Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern.
You can review the non-CMDB AWS tables by navigating to . You can also search the navigation filter for the specific pattern name.
| Field | Description |
|---|---|
| Name [name] | Name of the EMR cluster. |
| Object ID [object_id] | The Amazon Resource Name (ARN) of the EMR cluster. |
| Cluster ID [cluster_id] | The unique identifier of the EMR cluster. |
| State [state] | Current state of the EMR cluster.
For example: RUNNING, WAITING, or TERMINATING. |
| Configuration Item [configuration_item] | References the Cloud Resource [cmdb_ci_cmp_resource] table. |
Data stored in CMDB tables
Discovery and Service Mapping Patterns application populates data in the CMDB when running the Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern.
| Field | Description |
|---|---|
| Name [name] | Name of the EMR cluster. |
| Object ID [object_id] | The ARN of the EMR cluster. |
| Resource type [resource_type] | Type of resource. The value is set to AWS::EMR::Cluster. |
| Install Status [install_status] | Install status of the resource. Default value is Installed. |
| Operational status [operational_status] | Operational status of the resource. Default value is Operational. |
CI relationships
The Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern creates the following relationships and references to support Amazon EMR Cluster discovery. References link to records in other tables and don't appear in the CI Relationship [cmdb_rel_ci] table.
| CI | Relationship | CI |
|---|---|---|
| Cloud Resource [cmdb_ci_cmp_resource] | Hosted on::Hosts | AWS Datacenter [cmdb_ci_aws_datacenter] |
| CI | Field | Referenced CI |
|---|---|---|
| AWS EMR Cluster [cmdb_aws_emr_cluster] | Configuration Item [configuration_item] | Cloud Resource [cmdb_ci_cmp_resource] |
| Key Value [cmdb_key_value] | Configuration item [configuration_item] | Cloud Resource [cmdb_ci_cmp_resource] |
AWS Tag discovery
The Amazon AWS - EMR Cluster - Extended Inventory (LP) pattern collects tags and populates them in the Key Value [cmdb_key_value] table.
| Field | Description |
|---|---|
| Key [key] | Tag name. |
| Value [value] | Tag value. |
| Configuration item [configuration_item] | References the Cloud Resource [cmdb_ci_cmp_resource] table. |