GCP BigQuery pattern-based discovery

  • Release version: Yokohama
  • Updated January 5, 2025
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of GCP BigQuery pattern-based discovery

    The GCP BigQuery pattern-based discovery enables ServiceNow customers to automatically find and map BigQuery datasets and tables within their Google Cloud Platform (GCP) environment. This discovery populates essential configuration data into the CMDB, helping maintain an accurate and up-to-date view of cloud data resources.

    Show full answer Show less

    To use this feature effectively, customers should ensure they meet the GCP discovery prerequisites and have the latest version of the Discovery and Service Mapping Patterns application installed from the ServiceNow Store.

    Key Features

    • Discovery of Cloud Service Accounts: Captures project account details including account ID, object ID, and datacenter type.
    • Availability Zones: Identifies availability zones with details like name, description, and state (Available or Terminated).
    • Google Datacenters: Discovers regions/datacenters with unique GCP identifiers, names, regions, and descriptions.
    • Cloud Databases: Finds BigQuery datasets and public datasets, capturing dataset names, unique object IDs, installation and operational status, state, and fully qualified domain names (FQDN).
    • Databases (Tables): Identifies BigQuery tables, their names, database type (bigquery), and install status.
    • CI Relationships: Automatically creates relationships between datacenters, availability zones, cloud service accounts, databases, and datasets to represent hosting, usage, containment, and replication.
    • Tag Discovery: Collects GCP tags from datasets and stores them in the Key Value table linked to the Cloud Database CI, enabling enhanced categorization and filtering.

    What Customers Can Expect

    • An automated and comprehensive mapping of GCP BigQuery resources into the ServiceNow CMDB, supporting operational visibility and service mapping.
    • Accurate relationships between cloud infrastructure components, improving impact analysis and change management processes.
    • Tag data integrated into the CMDB to support governance, reporting, and policy enforcement on BigQuery datasets.
    • Support for both private and public BigQuery datasets, ensuring a complete representation of cloud data assets.

    Discovery and Service Mapping Patterns finds GCP BigQuery datasets and tables on your cloud environment. Discovering some of these resources may require updating to the latest version of the Discovery and Service Mapping Patterns application from the ServiceNow Store.

    Pattern-based discovery and mapping requirements

    Verify the GCP discovery prerequisites section in Google Cloud Platform (GCP) Cloud components discovery using Patterns.

    Data collected by Discovery during horizontal discovery

    Discovery populates the data in the CMDB when running the Google Cloud Platform (GCP) - BigQuery DB pattern.

    Table 1. Cloud Service Account [cmdb_ci_cloud_service_account]
    Field Description
    Account Id [account_id] Name of the project used for the discovery.
    Object ID [object_id] Name of the project used for the discovery.
    Datacenter Type [datacenter_type] Datacenter type: Google Datacenter [cmdb_ci_google_datacenter].
    Table 2. Availability Zone [cmdb_ci_availability_zone]
    Field Description
    Name [name] Name of the availability zone.
    Description [short_description] Description of the availability zone.
    State [state] State of the Availability Zone. Possible values are Available or Terminated.
    Table 3. Google Datacenter [cmdb_ci_google_datacenter]
    Field Description
    Name [name] Datacenter or region name.
    Region [region] Datacenter or region name.
    Object ID [object_id] Unique identifier allocated by GCP for this resource.
    Description [short_description] Datacenter or region description.
    Table 4. Cloud DataBase [cmdb_ci_cloud_database]
    Field Description
    Name [name] Name of the BigQuery dataset.
    Object ID [object_id] The fully qualified unique identifier of the dataset in the format projectId:datasetId.
    Install Status [install_status] Install status of the resource. Default value is Installed.
    Operational status [operational_status] Operational status of the resource. Default value is Operational.
    State [state] State of the dataset.
    Fully qualified domain name [fqdn] Fully qualified domain name (FQDN) for accessing the dataset.
    Table 5. Cloud Public DataBase [cmdb_ci_cloud_public_database]
    Field Description
    Name [name] Name of the public BigQuery dataset.
    Object ID [object_id] The fully qualified unique identifier of the dataset in the format projectId:datasetId.
    Vendor [vendor] Cloud vendor. Value is set to GCP.
    Install Status [install_status] Install status of the resource. Default value is Installed.
    Operational status [operational_status] Operational status of the resource. Default value is Operational.
    State [state] State of the public dataset.
    Fully qualified domain name [fqdn] FQDN for accessing the public dataset.
    Table 6. Database [cmdb_ci_database]
    Field Description
    Name [name] Name of the BigQuery table.
    Type [type] Database type. Value is set to bigquery.
    Install Status [install_status] Install status of the resource. Default value is Installed.

    CI relationships

    The Google Cloud Platform (GCP) - BigQuery DB pattern creates these relationships to support GCP BigQuery discovery.

    CI Relationship CI
    Google Datacenter [cmdb_ci_google_datacenter] Hosted on::Hosts Cloud Service Account [cmdb_ci_cloud_service_account]
    Google Datacenter [cmdb_ci_google_datacenter] Contains::Contained by Availability Zone [cmdb_ci_availability_zone]
    Cloud DataBase [cmdb_ci_cloud_database] Hosted on::Hosts Cloud Service Account [cmdb_ci_cloud_service_account]
    Cloud Service Account [cmdb_ci_cloud_service_account] Uses::Used by Cloud Public DataBase [cmdb_ci_cloud_public_database]
    Cloud DataBase [cmdb_ci_cloud_database] Hosted on::Hosts Google Datacenter [cmdb_ci_google_datacenter]
    Cloud DataBase [cmdb_ci_cloud_database] Replicates to::Replicated by Google Datacenter [cmdb_ci_google_datacenter]
    Cloud Public DataBase [cmdb_ci_cloud_public_database] Replicates to::Replicated by Google Datacenter [cmdb_ci_google_datacenter]
    Cloud DataBase [cmdb_ci_cloud_database] Contains::Contained by Database [cmdb_ci_database]
    Key Value [cmdb_key_value] References Cloud DataBase [cmdb_ci_cloud_database]

    GCP Tag discovery

    The Google Cloud Platform (GCP) - BigQuery DB pattern collects tags and populates them in the Key Value [cmdb_key_value] table.

    Table 7. Key Value [cmdb_key_value]
    Field Description
    Key [key] Tag name.
    Value [value] Tag value.
    Configuration item [configuration_item] References the Cloud DataBase [cmdb_ci_cloud_database] table.