Bring your own key for third-party AI provider integration

  • Release version: Yokohama
  • Updated January 12, 2026
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Bring your own key for third-party AI provider integration

    The Bring Your Own Key (BYOK) feature allows ServiceNow customers to integrate their own API credentials from supported cloud AI providers—such as Azure OpenAI, Amazon Bedrock (Anthropic Claude), and Google Gemini—to run Now Assist skills and AI agents. This integration routes AI model requests through the customer’s cloud AI account instead of the ServiceNow AI Platform, enabling customers to maintain control over AI configuration, security, and data processing environments while leveraging Now Assist capabilities.

    Show full answer Show less

    BYOK supports the same AI models as the default ServiceNow AI Platform, but uses the customer’s cloud resources to process AI requests. This approach keeps API keys under customer control and ensures AI workloads operate within their cloud environment. Customers should be aware that using their own cloud AI accounts might incur additional charges from those providers, so reviewing pricing and terms before enabling BYOK is important.

    Key Features

    • Supported cloud AI providers: Azure OpenAI, Anthropic Claude on AWS (via Amazon Bedrock), and Google Gemini.
    • Configuration workflow: Establish API connection and credentials (e.g., endpoint, API key, region), enable BYOK in Now Assist Admin, map ServiceNow model aliases to provider model versions, optionally customize skill variants, and validate outbound requests.
    • Provider-specific setup: For Azure OpenAI, configure API credentials, specify model and deployment names in Generative AI Controller, customize prompts, and switch to BYOK processing.
    • Control and security: Customers keep ownership of API keys and control their AI data environment.

    Practical Application for ServiceNow Customers

    Enabling BYOK allows customers to leverage their existing cloud AI investments and security policies while integrating Now Assist’s AI capabilities. It provides flexibility in managing AI workloads, compliance, and cost controls by routing processing through their chosen cloud provider. Customers can customize model versions and prompts to better fit their organizational needs.

    Before implementation, customers should:

    • Review detailed configuration instructions specific to each cloud provider available in the Now Support Knowledge Base.
    • Validate outbound HTTPS logs to confirm AI requests use their own cloud AI provider.
    • Monitor cloud provider costs and policies related to AI usage.

    The bring your own key (BYOK) feature enables you to use your own API credentials from supported cloud AI providers, such as Azure OpenAI, Amazon Bedrock, and Google Gemini, to run Now Assist skills and AI agents.

    When BYOK is enabled, Now Assist sends model requests through your cloud AI provider account instead of ServiceNow AI Platform infrastructure. This approach lets you maintain ownership of your AI configuration, security controls, and data processing environment while continuing to use Now Assist capabilities.

    BYOK supports the same AI models that the ServiceNow AI Platform supports. After you configure your API credentials, Now Assist uses your provider resources to process requests instead of using the default ServiceNow AI provider. BYOK keeps your keys under your control and AI workloads running within your cloud environment.
    Note:
    Using your organization’s cloud AI provider account might result in additional charges from that provider. Review the provider’s pricing and terms of service before enabling BYOK.

    ServiceNow integrated model providers

    BYOK supports the following cloud AI providers:
    • Azure OpenAI
    • Anthropic Claude on AWS, which is accessible through Amazon Bedrock
    • Google Gemini

    Configuring a BYOK connection with a cloud AI provider

    To use your cloud AI provider resources within your ServiceNow instance, configure a connection between ServiceNow and your provider. Configuration steps vary by provider, but follow a similar high-level configuration workflow as the following steps:
    1. Create connection and credentials for the provider, such as endpoint, API key, and region.
    2. Enable BYOK for the provider in Now Assist Admin.
    3. Map ServiceNow model aliases to provider model versions. For example, map gemini_large → 2.5 Pro.
    4. Optionally, override variants in each skill in Version Management.
    5. Validate that requests are using your AI provider account by reviewing outbound HTTPS logs.

    For step-by-step instructions for each supported cloud AI provider, see Configure Bring Your Own Key (BYOK) for Now Assist and AI Agents [KB2666298] article in the Now Support Knowledge Base.

    High-level BYOK configuration for Azure OpenAI

    1. Set up Azure OpenAI connection with your own key to use Azure OpenAI within your ServiceNow instance.

      For more information, see Configure API credentials for Azure OpenAI.

    2. Configure your Azure OpenAI model and deployment name in Generative AI Controller so your ServiceNow instance can recognize and use it.

      For more information, see Create a custom embedding model.

    3. Modify the prompt configuration to write your own prompts to send to the Azure OpenAI LLMs.

      For more information, see Configure a generic large language model (LLM) connector.

    4. Switch providers to use BYOK for AI processing.

      For more information, see .