3 results about "Interface analysis" patented technology

The application discloses an intelligent man-machine interaction method based on voice recognition and interface analysis, comprising the following steps: analyzing a current application program graphical user interface through an operating system interface or a background service, recognizing target controls in the interface and coordinate positions of the controls on a screen; establishing a mapping relationship based on spatial layout relationships and hierarchical structures of the controls; receiving a user voice instruction, performing voice recognition and semantic analysis to recognize a target identifier and operation content; and simulating input device action to operate the target controls according to an analysis result. The application can understand interface semantics, accurately map voice instructions to specific interface elements, realize deep cooperation between voice and interface control, and provide a more convenient computer operation mode for people with physical disabilities, thus having positive social and economic benefits.

The application provides a multi-agent cooperative interface automatic test method, device and medium, and belongs to the technical field of software test automation. The method comprises the following steps: receiving interface information of a user interface to be tested uploaded by a user; calling an image analysis agent to analyze and identify the interface information to generate an interface analysis result; based on the interface analysis result, calling a test case generation agent to automatically generate a test case; based on the test case and a selection instruction, calling a test script generation agent to generate a test script in a selected script format; calling a script execution agent to run the test script to simulate user operation, execute the test on the user interface to be tested, and record the execution process; and generating a test report according to the execution result of the test script. The application realizes automatic and efficient execution of UI automatic test.

This invention relates to the field of computer technology and discloses an interface parsing method, apparatus, device, and medium applied to an interface parser. The method includes: receiving interface request data sent by an external system through an interface layer and transmitting the interface request data to a parser layer; identifying the communication protocol type through the parser layer and matching the corresponding protocol adaptation rules according to the identified communication protocol type to generate target interface parsing rules; performing standardization processing on the interface request data according to the target interface parsing rules through the parser layer to obtain standardized request data which is then written to a business data layer; obtaining the standardized request data through a business service layer and executing business processing logic to obtain a business processing result which is returned to the parser layer; encapsulating the business processing result through the parser layer and outputting the encapsulated target response data to the external system through the interface layer. This application can improve the system's adaptability to multi-protocol environments and its overall operational stability.