Exploring External Content Connectors
Using External Content Connectors, AI Search applications can search content and metadata from external content repositories such as Atlassian Confluence Cloud and Microsoft SharePoint Online. Expanding search recall to include external content makes it easier and faster for search users to locate the information they need.
External Content Connectors overview
The External Content Connectors application adds support for indexing content and metadata from external source systems to make those systems searchable in AI Search applications. Indexing preserves the content's original user access permissions from the source system using AI Search's content security model.
- Atlassian Confluence Cloud external content connector
- Atlassian Jira Cloud external content connector
- Google Drive external content connector
- Microsoft SharePoint Online external content connector
- Microsoft Teams external content connector
- Predefined web sources external content connectorNote:For the list of predefined web sources you can crawl using this external connector, see Available sources for the predefined web sources external content connector.
- Slack external content connector
- ServiceNow documentation external content connector
Each external content connector has its own indexed source for crawled content. You can configure search sources for an external content connector's indexed source and include those search sources in your search profiles, just as you would for any other indexed source. To learn more about indexed sources, see Indexed sources in AI Search.
All external content connectors support semantic vector indexing of content retrieved from crawled source systems. Only features which use semantic vector search with the Now LLM Service can take advantage of this support. For details on semantic vector indexing and search, see Semantic vector search in AI Search.
External Content Connectors workflow
In this infographic, see a sample workflow of how different users in an organization interact with External Content Connectors to enable indexing and search of content and metadata from supported external sources.
- Search administrators configure connection settings for external content connectors, configure crawl start points and inclusion/exclusion filters to define the scope of connector crawls, and define schedules that specify when crawls run.
- The system runs connectors at their scheduled times or when administrators start one-time crawls. When crawling, connectors retrieve searchable content and security principals from their source systems and feed them to AI Search for indexing.
- Search users are presented with content and metadata from external content source systems when interacting with AI Search applications. AI Search's content security model retains user and group access permissions set in the source system, so users can only view content that they have permission to access.
- Administrators review and analyze crawl metrics, crawl histories, and user mapping data to understand how external data is crawled and indexed, allowing for more effective tuning of External Content Connectors settings.
By default, an external content connector can index up to one million (1,000,000) documents from its source system. When a connector exceeds this limit, it continues to crawl the source system, but only sends document deletions and updates to AI Search for indexing, ignoring new documents. The connector logs an error message for every 10,000 documents it crawls beyond the indexing limit.
When a connector's indexed document count exceeds 800,000, a warning message appears in the connector's UI to indicate that it's approaching the indexing limit. If the connector reaches the indexing limit, an error message appears in its UI.
If one of your connectors reaches the indexing limit, you can update its crawl settings and file inclusion/exclusion filters to reduce the number of documents it retrieves. Alternately, if you need to index more than 1,000,000 documents, you can create a Customer Service and Support case at https://support.servicenow.com/now to request a limit increase for the connector.
External Content Connectors benefits
| Benefit | Feature | Users |
|---|---|---|
| Configure source systems for external content indexing | Configuring source systems for external content indexing | Source system administrators |
| Create connectors to retrieve searchable content and security principals from supported external data source systems | Creating external content connectors | Administrators |
| Control the scope of external content connector crawls by specifying source system locations to crawl and content types to feed to AI Search for indexing | Configuring crawl settings for external content connectors | Search administrators |
| Update searchable content and metadata from source systems on demand or on a scheduled recurring basis | Run a one-time full or partial document crawl for an external content connector | Search administrators |
| Update user security principals from source systems on demand or on a scheduled recurring basis | Run a one-time user mapping crawl for an external content connector | Search administrators |
| Review metrics for source system items retrieved by content crawls | Review crawl history and analytics for an external content connector | Search administrators |
| Review user and group access permissions retrieved by user mapping crawls | Review user mappings for an external content connector | Search high security administrators |
| Search content and metadata indexed from external data source systems | Searching in AI Search | AI Search users |
Interaction with Now Assist Genius Results
If you have the Now Assist in AI Search and Now Assist in Virtual Agent ServiceNow Store applications installed, external content search results are eligible for inclusion in Genius Result answers generated for Now Assist in Virtual Agent.
External content search results are ignored when generating Now Assist Q&A or Now Assist Actions Genius Result answers.