Select the LLM for AI agents and agentic workflows

  • Release version: Yokohama
  • Updated July 31, 2025
  • 1 minute to read
  • Choose the large language model (LLM) service provider for Now Assist AI agents in AI Agent Studio.

    Before you begin

    Role required: sn_aia.admin

    About this task

    LLMs are part of the foundation of agentic AI. Different LLMs can provide slightly different performance and responses. You can select which LLM to use at a global level for agentic AI from the AI Agent Studio to help adjust the response quality to best fit your agentic workflows.
    Note:
    If you already have agents built and you change the global LLM, then you must test the agents after making the change.

    Depending on your region, you may have to consent to using a different service provider.

    Procedure

    1. Navigate to All > AI Agent Studio > Settings.
    2. Navigate to the Model provider tab.
    3. Select Configure to be redirected to Now Assist Admin.
    4. In the Choose a default model provider field, select

      Your choices are the following:

      • Now LLM Service
      • AWS Claude
      • Azure OpenAI
      • Google Gemini
    5. Review the impacted AI agents.

      Certain AI agents may require specific model providers. Select the AI agents tab in the Impact overview section to see which AI agents are affected by any changes to the model provider.

    6. Select Save.

    Result

    Your chosen LLM is used globally for all AI agents and agentic workflows.