Construction method and interaction method of operation track, equipment and storage medium

By constructing a user interface transition graph and generating cross-application operation trajectories using a large language model, the problem of execution failure of existing operational agents in complex environments is solved, achieving efficient and reliable automated operation, and improving user experience and the personalized adaptability of the agent.

CN122086501APending Publication Date: 2026-05-26HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Patent Type
Applications(China)
Current Assignee / Owner
HUAWEI TECH CO LTD
Filing Date
2024-11-26
Publication Date
2026-05-26

AI Technical Summary

Technical Problem

Existing operational agents are prone to failure in complex operational environments, cannot effectively operate across applications, and suffer from low accuracy and high complexity when users record or orchestrate agents, resulting in a degraded user experience.

Method used

By constructing a user interface transfer graph and a large language model, cross-application operation trajectories are generated. Intelligent agents are used to automatically execute tasks, and simulation verification and optimization algorithms are combined to improve the accuracy and reliability of the operation trajectories.

Benefits of technology

It enables automated operations across applications, improves the success rate of operating agents and user experience, reduces the complexity and error rate of user operations, and enhances the personalized adaptability of agents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122086501A_ABST
    Figure CN122086501A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of computers, and discloses an operation track construction method, an interaction method, equipment and a storage medium, and the method comprises the steps: obtaining a data set corresponding to an application, the data set comprises a control list corresponding to each page in the application and a specification of the application, the control list is used for recording all executable controls in the page, and the specification at least records corresponding operations for executing the controls; determining the user interface transfer graph based on the data set; and inputting the user interface transfer graph and the specification into a large language model to obtain an operation track for completing a task. According to the intelligent agent obtained by the method provided by the embodiment of the invention, the execution success rate of effectively completing complex operation is greatly improved, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art