Generating cross-domain guidance for navigating HCI

By translating actions between domains using domain models, the method facilitates efficient task navigation across different computer applications, addressing user interface familiarity issues.

JP7864866B2Active Publication Date: 2026-05-25X DEVELOPMENT LLC
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
X DEVELOPMENT LLC
Filing Date
2023-06-12
Publication Date
2026-05-25

AI Technical Summary

Technical Problem

Individuals often struggle to perform semantically similar tasks across different computer applications due to unfamiliarity with the application's interface, leading to inefficiencies and barriers in task completion.

Method used

A method is implemented using processors to identify a first domain, translate actions using a domain model, and generate probability distributions for actions in a second domain, providing guidance through visual and audible cues to navigate the second application's interface.

Benefits of technology

Enables seamless navigation and task completion across different computer applications by leveraging action embeddings and domain models, enhancing user experience and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007864866000001
    Figure 0007864866000001
  • Figure 0007864866000002
    Figure 0007864866000002
  • Figure 0007864866000003
    Figure 0007864866000003
Patent Text Reader

Abstract

The disclosed embodiments relate to automatically generating and providing guidance for navigating an HCI to perform semantically equivalent / similar computing tasks across different computer applications. In various embodiments, the domain of a first computer application operable using a first HCI may be used to select a domain model that transforms between the action space of the first computer application and another space. Based on the selected domain model, domain-independent action embeddings representing actions previously performed using a second HCI of a second computer application to perform a semantic task may be processed to generate a probability distribution over actions in the action space of the first computer application. Based on the probability distribution, actions that are performable using the first computer application may be identified, and these actions may be used to generate guidance for navigating the first HCI to perform the semantic task.
Need to check novelty before this filing date? Find Prior Art