Viewing producer statistics

  • Release version: Yokohama
  • Updated January 30, 2025
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Viewing producer statistics

    ServiceNow enables customers to view detailed information and performance statistics about Stream Connect producers that publish messages to Kafka topics. This includes producers using the Kafka Producer step and the ProducerV2 API. Understanding producer details and their message throughput helps monitor and manage data integration pipelines effectively.

    Show full answer Show less

    Key Features

    • Kafka Producers Table [syskafkaproducer]: Stores records per topic about each producer, including producer type, ID, source table, and associated Kafka topic. It provides identification and context about how and where messages are produced.
    • Kafka Producer Statistics Table [syskafkaproducerstatistics]: Contains hourly collected performance data for each producer, such as the number of bytes and messages produced during that period, along with the domain and topic references.
    • Access Control: Both tables require the Kafka Admin [kafkaadmin] role to view and are read-only. Records cannot be manually created, modified, or deleted, ensuring data integrity.
    • Navigation: Customers can access the Kafka Producers table via All > Integration Hub > Stream Connect > Producers, and drill down into individual producer records to see detailed statistics.

    Key Outcomes

    • Gain visibility into each Kafka producer’s identity, type, and source within ServiceNow.
    • Monitor producer performance hourly, tracking message and byte throughput to Kafka topics.
    • Use this data to troubleshoot, optimize, and ensure reliable message production from ServiceNow to Kafka.

    View detailed information about a Stream Connect producer and its performance, including the producer type and ID, and the total number of bytes and messages produced to a topic.

    Stream Connect producers, including the Kafka Producer step and the ProducerV2 API, publish messages from ServiceNow to a Kafka topic. You can view detailed information and statistics for each producer.

    Each producer has a record that stores information about that producer, such as its type and ID. A producer might also have an associated statistics record with information about the producer's performance, including the number of bytes and messages it's produced to a topic.

    Producer details and statistics are covered in two tables.
    • Kafka Producers [sys_kafka_producer] table
    • Kafka Producer Statistics [sys_kafka_producer_statistics] table

    Both tables require the Kafka Admin [kafka_admin] role to view. These tables are read only and the records in them can't be manually created, updated, or deleted.

    Kafka Producers table

    The Kafka Producers [sys_kafka_producer] table captures producer information per topic. You can view the Kafka Producers table by navigating to All > Integration Hub > Stream Connect > Producers.

    Table 1. Kafka Producers table fields
    Field Description
    Number Unique identifier for the producer. Links to the producer record.
    Producer Type

    Type and version number for the producer.

    Each producer type is followed by the version number of the producer. For example, if the producer is the ProducerV2 API, the type listed is SCRIPT_V2.

    Options are:
    • ACTION: Kafka Producer step.
    • SCRIPT_ACTION: A producer called from within a scripted step in Workflow Studio.
    • SCRIPT: Producer API or ProducerV2 API.
    • SYSTEM: Any server-side execution in the ServiceNow Platform where the system can't identify any record associated with the execution.
    Producer Table

    Name of the table producing the record.

    For example, if the record is produced by a business rule, the table is Business Rule [sys_script]. If it's produced by the Kafka Producer step, it's Action Type [sys_hub_action_type_definition].
    Producer ID Reference to the record that produces the messages.
    Topic Reference to the Kafka topic record for the producer.
    Domain Name of the domain for the record producing the event.

    Kafka Producer Statistics

    The Kafka Producer Statistics [sys_kafka_producer_statistics] table captures producer statistics for each producer. Statistics are collected once per hour.

    Table 2. Kafka Producer Statistics table
    Field Description
    Topic Reference to the topic record for the producer.
    Collection Time Time the producer statistics were collected. Statistics are collected and reported every hour.
    Produced bytes Total number of bytes produced during the collection period.
    Produced messages Total number of messages produced during the collection period.
    Domain Name of the domain for the producer.
    You can also view the statistics for a specific producer by selecting the producer's record from the table.
    Figure 1. Sample producer record with statistics
    A producer record showing producer statistics at the bottom.