Additional options for application screens and elements in Universal App Connector

  • Release version: Yokohama
  • Updated January 30, 2025
  • 3 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Additional options for application screens and elements in Universal App Connector

    This content explains the additional operations available for managing application screens and their elements within the Universal App Connector, specifically in the Yokohama release version. These options help ServiceNow customers validate, update, and interact with application screens and elements to ensure accurate automation and integration.

    Show full answer Show less

    Additional Options for Application Screens

    In the Screens and elements pane, right-clicking an application screen reveals options that vary depending on the application type (Java, Windows, Chrome, or Edge). These options include:

    • Refresh screen: Updates the screen match based on predefined rules or locators.
    • Refresh screen and elements: Updates both the screen and its child elements.
    • Focus: Brings the targeted screen into focus for interaction.
    • Capture element: Allows capturing new elements from the screen.
    • Add custom element: (For Chrome and Edge) Enables adding hidden or non-capturable elements manually.
    • Show elements: (For Windows) Displays a dialog with all existing elements in UI Automation or Active Accessibility modes, aiding in element selection.
    • Delete: Removes the application screen.

    Additional Options for Application Elements

    Right-clicking individual application elements provides further actions to manage and interact with these elements effectively:

    • Refresh: Updates the element match based on defined attributes or locators.
    • Highlight: Visually highlights the element on the screen for easy identification.
    • Re-capture: Recaptures the element while retaining its original name.
    • Delete: Removes the element from the application screen.
    • Do Default Action: Executes the element’s default UI action (e.g., clicking a button, toggling a checkbox, opening a link).
    • Get Value and Set Value: Retrieves or sets the data value of the element, useful for data-driven automation.
    • Get text and Set text: Retrieves or inputs text into applicable elements.
    • Click: Simulates clicking the element if supported.

    Practical Benefits for ServiceNow Customers

    These additional options empower ServiceNow customers to maintain accurate and dynamic automation workflows by:

    • Ensuring screens and elements stay correctly matched and updated as applications evolve.
    • Allowing manual addition and interaction with hidden or complex UI elements.
    • Providing flexibility in managing elements through various interaction methods (highlighting, clicking, setting values).
    • Supporting integration with different application types and UI frameworks through tailored options.

    Overall, these capabilities enhance the reliability and control of application automation within the Universal App Connector.

    Validate and perform additional operations for the added application screens and their captured elements. The additional options for the application screens are categorized based on the application type.

    Type of application screens, their additional options, and descriptions

    In the Screens and elements pane, right-click the application screen to perform the following additional operations.

    Table 1. Type of application screens and their additional options
    Type of application Additional options
    Java
    • Refresh screen
    • Refresh screen and elements
    • Focus
    • Capture element
    • Delete
    Windows
    • Refresh screen
    • Refresh screen and elements
    • Focus
    • Capture element
    • Show elements
    • Delete
    Google Chrome or Microsoft Edge
    • Refresh screen
    • Refresh screen and elements
    • Focus
    • Capture element
    • Add custom element
    • Delete
    Table 2. Description of additional options for the application screens
    Additional action Description
    Refresh screen Rematches the selected screen based on the screen match rules or locators that you defined.
    Refresh screen and elements Rematches the selected screen and its child elements based on the screen match rules or locators that you defined.
    Focus Sets the targeted application screen into focus.
    Capture element Captures elements from the application screen. For more information, see Use the Universal App Connector.
    Add custom element Adds a custom element to the application screen. For example, you can interact with hidden elements that you cannot directly capture from the web page.
    Show elements Displays the Windows Elements dialog that displays all the existing elements in the target application screen in a tree view. You can select the required element from here and add it to the application screen.

    For Windows application screens, the elements are displayed in two modes. They are UI Automation and Active Accessibility. UI Automation is the default mode.

    For example, when you capture a notepad windows screen and right-click and select Show Elements, the following modes are displayed.
    Figure 1. Elements displayed in UI Automation mode for a Notepad
    Displays elements in the UI Automation mode for a Notepad.
    Figure 2. Elements displayed in Active Accessibility mode for a Notepad
    Displays elements in the Active Accessibility mode for a Notepad.
    Delete Deletes the application screen.

    Additional options for elements and their descriptions

    In the Screens and elements pane, right-click the application element to perform the following additional operations. For example, for a Windows screen.
    Figure 3. Additional options for elements, for example, for a Windows screen
    Additional options for elements, for example, for a Windows screen.
    Table 3. Additional options for elements and their description
    Additional option Description
    Refresh Rematches the selected element based on the element match attributes or locators that you defined.

    When you capture an element in both UIA and AA modes of a Windows application screen, you view both elements in the Screens and elements pane. For example, Text Editor_UIA and Text Editor_AA.Elements in the Screens and elements pane with Text Editor types in 2 modes.

    When you capture a Text Editor element in Active Accessibility mode and perform the Refresh action on that element, the Target objects preview pane displays two text editors with different types, such as window and editable text.Types of Text Editor of active accessibility mode.
    Highlight Highlights the element on the target application screen.
    Re-capture Recaptures an element from the application screen retaining the same name.
    Delete Deletes the element.
    Do Default Action Executes the default action of the target object. This the same action you perform by clicking, pressing Enter, or using another common method of activation.
    The default actions are listed for the following UI elements.
    • Button: Clicks the button
    • Check box: Toggles the check (select/clear)
    • Link: Opens the link (navigate)
    • Combo Box: Opens the drop-down
    • List Item: Selects the item
    • Tree View Node: Expands or collapses the node
    Get Value Retrieves the value of the target object, which typically represents the data the object holds or displays (not the label or name).
    Set Value Sets the value property of the target object.
    Set text Sets text to the element if applicable.
    Get text Retrieves text from the element if applicable.
    Click Clicks the elements if applicable.