Switch to another large language model (LLM) provider for the RPA bot generation skill

  • Release version: Xanadu
  • Updated January 30, 2025
  • 1 minute to read

    • Switch to another large language model (LLM) provider when you're using the Robotic Process Automation bot generation skill. That way, you can still get good results and accessibility if Azure isn’t available in your region. In addition to using Now LLM Service (LLM generic), you can also use the gpt4o LLM.

    Before you begin

    Perform these steps in your ServiceNow instance.

    Role required: sn_skill_builder.admin

    About this task

    The assists for custom LLMs are charged separately.

    To switch an LLM provider for the RPA bot generation skill, create a connection record and add its associated credential record. Later, clone the RPA bot generation skill.

    Procedure

    1. Create a connection record and add its associated credential record before you switch the provider.
      1. Navigate to All > Connections & Credentials > Connections & Credential Aliases.
      2. Select the RPA Custom LLM Credentials record.
      3. On the Connections tab, select New.
      4. Enter a name for the new connection record.
      5. In the Credential field, select the search icon (Search icon), select New, and then select Custom Header API Key Credential.
      6. On the form, fill in the fields.
        Table 1. Custom Header API Key Credential record form
        Field Description
        Name Human-readable name for this credential.
        Header Name Name of the header to send the API key in.

        For example, api-key.
        API Key API key to be used.
      7. Select Submit.
      8. In the Connection URL field, enter the API endpoint that you must add to use your gpt4o model.
        For Azure OpenAI, your Connection URL is in the form https://{your-resource-name}.openai.azure.com. For more information, see the Azure OpenAI documentation.
        Note:
        Only the gpt4o LLM is supported.
      9. Select Submit.
    2. Clone the RPA bot generation skill.
      1. Navigate to All > Now Assist Admin > Now Assist Skills.
      2. In the workflow list, select Creator.
      3. On the RPA bot generation card, select the three dots icon (Vertical three-dots icon.) and select Make a copy.
        Figure 1. Clone RPA bot generation skill
        RPA bot generation card shows the procedure of cloning the RPA bot generation skill by selecting the three dots next to the skill and selecting the Make a copy option.
    3. Switch your provider.
      1. Navigate to All > Now Assist Skill Kit > Home.
      2. On the ServiceNow skills tab, select a cloned copy of the RPA bot generation skill.
      3. On the Skill settings tab, in the Providers (Provider API) section, toggle the Custom LLM switch to make it the default provider.
        Figure 2. Toggle the Custom LLM switch
        Providers section that shows the Custom LLM provider and the Make default toggle is selected to make it the default provider.

    Result

    You can start using the Now Assist for RPA Hub feature with the gpt4o LLM.