Windows form application behavior simulation robot and working method thereof

A technology for simulating robots and application programs, applied in the field of robotics, can solve the problems of cumbersome operation, low scalability, and no involvement, etc., and achieve the effect of wide application prospects

Pending Publication Date: 2020-11-03
HARBIN INST OF TECH AT WEIHAI +1
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method needs to record different software behaviors each time with different application software in different scenarios. The time and economic costs are high, the operation is cumbersome, and it has great limitations.
There is also a method of using scripts to realize the simulation of specific behaviors. Since each action of each software needs to be coded separately, this method has a huge workload, low scalability, poor robustness, and requires a large amount of work.
There is also a user’s behavior pattern learned by modeling the user’s behavior habits, so as to generate the user’s behavior operation sequence. However, it does not involve how to convert the sequence into the behavior of the user’s operation software after the generation, and drive the software to operate. Therefore, it cannot Meet the needs of actual scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Windows form application behavior simulation robot and working method thereof
  • Windows form application behavior simulation robot and working method thereof
  • Windows form application behavior simulation robot and working method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] A Windows Forms application that simulates the behavior of a robot, such as figure 1 As shown, it includes the simulation task delivery module, task configuration file library, simulation task analysis module, autonomous simulation module, behavior library construction module and behavior database;

[0058] The simulated task delivery module is used for: storing the delivered task configuration file in the task configuration file library; the simulated robot will automatically receive the task configuration file. This module is the input module of the simulated robot. The simulation task parsing module is used to: obtain the task configuration file from the task configuration file library, perform parsing operations on the task configuration file, and pass the analyzed simulation parameters to the autonomous simulation module; the autonomous simulation module is used to: after receiving the simulation parameters, Set its own simulation parameters, choose a simulation m...

Embodiment 2

[0061] The working method of a kind of Windows form application program behavior simulation robot described in embodiment 1, such as figure 2 , image 3 shown, including the following steps:

[0062] (1) The task configuration file issued by the simulated task distribution module is stored locally in the computer, and then the task configuration file is stored in the task configuration file library through the communication monitoring inside the computer system;

[0063] (2) The simulation task analysis module obtains the task configuration file from the task configuration file library, performs analysis on the task configuration file, and transmits the simulation parameters obtained by the analysis to the autonomous simulation module. The simulation parameters include the name of the target software to be simulated, the target The set of buttons in the software, the installation path of the target software, the target action or state of the behavior simulation, and the sele...

Embodiment 3

[0086] According to the working method of a kind of Windows form application program behavior simulation robot described in embodiment 2, its difference is:

[0087] In step (3), after the autonomous simulation module receives the simulation parameters, it sets its own simulation parameters, selects the image recognition simulation method, processes multiple pop-up windows of the software through graphic recognition, and locates the buttons of the pop-up windows, such as Figure 5 shown, including the following steps:

[0088] First, use the OCR-based image recognition method to identify the pop-up window and the button of the pop-up window. After recognition, the interface image of the software is converted into picture pixels with two-dimensional position coordinate information; picture pixel information refers to all pixels in the entire screenshot in the screenshot The information includes the position information of the pixel point, that is, the two-dimensional position c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a Windows window application behavior simulation robot and a working method thereof. The Windows window application behavior simulation robot comprises a simulation task issuing module, a task configuration file library, a simulation task analysis module, an autonomous simulation module, a behavior library construction module and a behavior database. The simulation task issuing module stores issued task configuration files in a task configuration file library; the simulation task analysis module acquires a task configuration file from the task configuration file library, performs analysis operation on the task configuration file and transmits simulation parameters obtained through analysis to the autonomous simulation module; after the autonomous simulation modulereceives the simulation parameters, the simulation parameters of the autonomous simulation module are set, and a simulation method is selected to perform autonomous behavior simulation; and the behavior library construction module stores the simulation operation behaviors into the behavior database. According to the invention, autonomous behavior simulation can be carried out on all Windows windowapplications, and a behavior library is constructed autonomously.

Description

technical field [0001] The invention relates to a Windows form application program behavior simulation robot and a working method thereof, belonging to the technical field of robots. Background technique [0002] Research on Internet user behavior is an important part of cyberspace security, network shooting range construction, network anti-espionage and anti-fraud research, and software product development. At the same time, the research and simulation of Internet user behavior has promoted the construction of national information security and military network to a certain extent. Research on offensive and defensive weapons. Internet user behavior currently mainly includes the coarse-grained group behavior of Internet users and the fine-grained behavior of individual users. The fine-grained behaviors of individual users mainly include Internet web page access, mouse and keyboard operations, sending and receiving emails, file uploading and downloading, etc. The behavior of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/455G06F9/451G06K9/00
CPCG06F9/45529G06F9/45508G06F9/451G06V30/413G06V30/287
Inventor 张旭刘红日刘扬王巍王凯王孝鹏
Owner HARBIN INST OF TECH AT WEIHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap