1086 results about "Interactive control" patented technology

The invention belongs to the technical field of industrial equipment monitoring, and discloses an industrial production equipment monitoring and early warning system based on the Internet of Things and edge intelligence, and the system collects multi-modal data in real time through a distributed sensor network, and carries out the real-time processing and feature extraction through the edge intelligence technology. Data fusion and optimization are carried out through a cloud deep learning model, a self-adaptive early warning and decision module dynamically adjusts a threshold value and optimizes an operation strategy, an environmental adaptability optimization module ensures the stability of equipment under extreme conditions, and an equipment health management and collaborative maintenance module realizes cross-equipment collaborative maintenance. The remote monitoring and interaction module provides man-machine interaction type control, and the cross-device collaborative learning module improves the model performance through federal learning. According to the system, the accuracy of equipment monitoring, the timeliness of early warning and the intelligent level of maintenance are remarkably improved.

The invention relates to the technical field of mineral resource management, in particular to a mineral resource dynamic prediction and mining management system which comprises a data perception and fusion layer, a unified digital twinborn model, a dynamic prediction and decision intelligent agent and a visualization and interaction control layer. The data perception and fusion layer collects structured data such as geological exploration and mining environment and market unstructured data, and generates a unified space-time tensor through processing; the unified digital twinborn model generates a dynamic comprehensive mining area situation map containing resource reserve risk economic indicators through a three-dimensional convolutional neural network embedded with an attention mechanism; the dynamic prediction and decision-making agent predicts future reserves and geological risks, and constructs a dual-objective optimization model to generate an optimal mining path equipment scheduling and resource allocation scheme; and the visualization and interaction control layer presents the mining area state and the decision scheme in a three-dimensional manner and provides an interaction interface. According to the invention, the data utilization rate and decision scientificity are improved, the safety risk is reduced, and mine management intellectualization is promoted.

The invention provides a toy interaction control method and device based on a large language model, a terminal and a medium, and the method comprises the steps: obtaining user side information which comprises one or more of voice, text, image, limb movement or external environment information; performing feature extraction on the user side information to generate feature representation; inputting the feature representation into a large language model, and identifying a user intention; generating a corresponding control instruction according to the identified user intention; and converting the control instruction into a specific control signal, and sending the specific control signal to a control system of the toy so as to execute corresponding control. The large language model is utilized to perceive human language characters, voice emotions, limb actions and the like, human intentions are accurately recognized, then the feedback of the toy is controlled, and intelligent interaction is formed for users.

The invention relates to the technical field of computer graphic interactive processing, in particular to a real-time interactive image generation system based on a multi-point touch canvas. The input acquisition unit is used for acquiring original touch data from an operating system and preprocessing the original touch data; the gesture recognition and analysis unit is used for performing high-level semantic behavior analysis on the contact data sequence processed by the preprocessing module; the interaction control and parameter mapping unit is used for receiving the semantic event output by the gesture recognition and analysis unit, analyzing the semantic event into an image control command and generating an executable command sequence; and the image generation unit generates interactive image content dynamically responded in real time based on an internal graph state management mechanism. By introducing the adaptive Kalman filtering and trajectory prediction auxiliary mechanism, the filtering intensity of the contact data can be dynamically adjusted, the efficient suppression of finger jitter and the consistent reconstruction of the contact ID are realized, and the input stability and data continuity under the multi-point touch operation are remarkably improved.

The invention discloses a wellhead data acquisition modeling system. The wellhead data acquisition modeling system comprises a data acquisition module, a hydraulic characteristic processing module, a well layer coupling modeling module and an interaction control module, the invention belongs to the technical field of well water monitoring management, based on an adaptive time-frequency analysis method, a dynamic window function enhanced by local frequency spectrum entropy is introduced, feature extraction and abnormal early warning are performed on transient hydraulic fluctuation signals, and the time-frequency resolution and change recognition capability of the hydraulic signals are remarkably improved; a dynamic coupling model between a water pumping system and an aquifer is constructed by combining a multi-scale parameter coordination mechanism, and accuracy and dynamic adaptability of well layer response modeling are realized by introducing a gap compression lag function and a joint parameter calibration method; and the interaction control module implements model prediction control according to the hydraulic feature vector, the hydraulic anomaly early warning signal and the well layer coupling prediction parameter combination, and outputs wellhead data acquisition decision support data.

The invention discloses a multi-modal interaction control method for a Bluetooth knob screen, and relates to the technical field of multi-modal interaction control, and the method comprises the steps: synchronously collecting and forming a multi-modal feature vector set, and outputting a final operation instruction through a multi-modal fusion model; performing function mapping according to the final operation instruction, and identifying a control command; judging whether to resend the same instruction or adjust the instruction parameter based on the control command, and dynamically adjusting the tactile feedback parameter based on the function mapping of the current scene mode; performing low power consumption management based on the dynamically adjusted tactile feedback parameters, and triggering scene mode mapping update according to the wake-up instruction type; and optimizing the instruction output accuracy and the function mapping rule of the multi-modal fusion model based on the updated user interaction data. According to the method, deep fusion and intelligent cooperation of multiple interaction modes are realized, and accurate output of operation instructions, intelligent management of tactile feedback and adaptive updating of scene modes are achieved through dynamic function mapping, intelligent feedback adjustment and continuous learning optimization.

The invention discloses a three-dimensional energy carbon data visualization terminal and a use method thereof. The visualization terminal comprises a data acquisition module, a data processing module, a visualization display module, an interaction control module and a communication transmission module. The data acquisition module acquires a voltage signal, a current signal and a carbon emission signal of the park power equipment in real time; the data processing module performs energy-carbon coupling analysis on the original data to generate an analysis result; the visual display module dynamically displays the energy and carbon monitoring data, the electric power parameter waveform change trend, the incidence relation between energy consumption and carbon emission and abnormal event information; the interaction control module receives a user instruction and adjusts display content; and the communication transmission module performs data interaction with a remote management platform. Through multi-module cooperation, real-time acquisition, coupling analysis and three-dimensional dynamic visualization of energy and carbon data are realized, comprehensive energy efficiency and carbon efficiency management support is provided for an industrial park, and the decision efficiency of energy optimization and carbon emission regulation is improved.

The invention provides a method and a system for intelligently interactively controlling water production equipment. Wherein heavy metal ion concentration data is collected in real time through a multi-node sensing array, concentration difference fluctuation of adjacent monitoring points is analyzed, and a pollutant diffusion track is deduced; when the monitoring data exceeds the standard, switching of a standby water source is triggered based on a diffusion trajectory analysis result, and a reverse cleaning instruction is generated in combination with the dynamic ratio of the concentration gradient change rate to the diffusion speed; dynamically correcting the concentration deviation by utilizing fluid mechanics parameters in a high-pressure impact process in cooperation with multi-dimensional sensor data, and generating environmental response type pollution grade parameters; finally, a pollutant migration path in the three-dimensional diffusion model is matched according to the pollution level, a decision signal containing emergency water source coordinates and the cleaning priority is output, and full-process closed-loop intelligent control from pollution monitoring to emergency decision is achieved. According to the technical scheme provided by the invention, the response speed and the disposal accuracy of the water quality sudden pollution event are improved.

The embodiment of the invention discloses a live broadcast interaction method, system and device, equipment, a storage medium and a program product. The method comprises the following steps: displaying a preview interface of a target live broadcast room; the preview interface comprises a first interaction control, the first interaction control is triggered and displayed based on a first interaction event of the target live broadcast room, and the first interaction control is used for entering the target live broadcast room and participating in the first interaction event; and in response to the triggering of a second interaction event of the target live broadcast room, switching the first interaction control of the preview interface to a second interaction control, the second interaction control being used for entering the target live broadcast room and participating in the second interaction event. According to the embodiment of the invention, the live-broadcasting room entering possibility can be improved.

The invention discloses a multifunctional intelligent electronic ear tag device. The ear tag adopts a head hoop and an arc-shaped ear hook structure, a connecting buckle is of a magnetic attraction type, punching is not needed, and the head hoop is made of medical silica gel, so that it is ensured that the ear tag is comfortable to wear by animals and convenient to use repeatedly. The power management module guarantees power supply, and the data monitoring module can collect multi-dimensional information such as animal body surface temperature, environment and behavior data. During working, breeding areas are divided to construct a wireless network, data are acquired and then preprocessed, and the animal growth state sensing model is utilized to analyze and upload a result. The power consumption adaptive algorithm dynamically adjusts the working mode of the ear tag according to the equipment state and the like, such as adjusting the sampling frequency and the local model complexity, so that low-power-consumption edge calculation and accurate reasoning are realized. The user terminal supports data display, interaction control and remote alarm, and helps a manager adjust a breeding strategy based on an analysis result. The system has the characteristics of high comfort, low power consumption and high precision, and provides technical support for digital transformation of animal husbandry.

The invention discloses an interactive control method for virtual simulation training of electric power operation and maintenance, and particularly relates to the technical field of electric power operation and maintenance simulation, which comprises the following steps of: acquiring operation behavior data of students, performing real-time capability grading on the students by utilizing a multi-dimensional capability evaluation model, and performing real-time capability grading on the students; a difference adaptation parameter model is constructed in combination with the difference between the virtual device and the target actual device, training content with corresponding difficulty is matched from a preset training task library, a knowledge graph of students is constructed, and a personalized training path is generated through a path recommendation engine. Iteratively updating the training difficulty and the recommended path according to the newly generated behavior data and the performance of the trainee in the aspect of the difference adaptive capacity, constructing a difference adaptive parameter model, bringing the difference into a training task adjustment and capacity evaluation mechanism, dynamically adjusting the training task parameters to fit the actual equipment complexity, and evaluating the performance of the trainee in the aspect of the difference adaptive capacity. And a migration barrier between virtual training and real operation and maintenance is broken through.

The invention relates to the technical field of data processing of organic displays, in particular to an interaction control method of a double-screen organic display system, which acquires touch control, deformation and ambient light data in real time through a multi-mode sensor array, and realizes cross-screen heterogeneous data space-time alignment by adopting an improved clock synchronization protocol and a sliding window mechanism. And generating a time sequence feature vector set with weight. And based on an LSTM-Transform hybrid model, fusing historical communication delay data, analyzing space-time relevance by using a multi-head attention mechanism, and outputting a cross-screen communication delay probability distribution diagram. And generating a multi-target task allocation strategy in combination with a deep reinforcement learning model, and iteratively calculating a shortest path allocation scheme of a rendering task through an improved ant colony optimization algorithm. The space-time synchronization precision of double-screen interaction is effectively improved, signal misalignment caused by communication delay is reduced, the distribution efficiency of distributed rendering resources is optimized, and the environmental adaptability and operation robustness of a flexible display system are enhanced.

The invention provides a multi-source information fusion automobile light personalized interaction control system and method, and relates to the technical field of automobile intelligent light control. The system comprises a multi-source sensing module, a data preprocessing module, a data analysis processing module and a vehicle lamp driving module. The multi-source sensing module collects multi-source heterogeneous data, after the multi-source heterogeneous data is processed by the data preprocessing module, fusion analysis and intelligent decision are carried out by the data analysis processing module, a control instruction is generated, and finally, the instruction is executed by the vehicle lamp driving module and a state is fed back. According to the invention, the defects of the existing automobile light control technology in the aspects of intelligence, situational and individuation are overcome, the efficient, intelligent and individualized control of the automobile light is realized, and the driving safety, comfort and entertainment are improved.

The invention discloses an intelligent cabin interaction control method and system and a vehicle, and the method comprises the steps: obtaining the physiological and behavior data of a driver, and the physiological and behavior data comprise electroencephalogram signal data, eye image data, sound data and gesture image data; preprocessing the physiological and behavior data to obtain the intention tendency of the driver; and based on the intention tendency of the driver, adopting a multi-mode fusion decision to generate a vehicle control instruction. The intelligent cabin interaction control system comprises a brain-computer interface subsystem, a multi-mode interaction subsystem, a central fusion and control unit and an equipment execution subsystem. According to the invention, a more accurate vehicle control instruction conforming to the expectation of a driver can be obtained, and the situation that the vehicle cannot be executed due to the conflict of the vehicle control instructions output by different modules is prevented.

The invention discloses an LED cloud screen 3D interaction control system, and relates to the technical field of cloud screen interaction control, and the system comprises a content input module which receives multi-source signal content from the outside and converts the multi-source signal content into an SDS stream; the 3D rendering and processing module performs image generation and effect optimization, and generates a final display image step by step; the display output module converts the final display image into a data frame which can be directly loaded and displayed by the LED cloud screen; the monitoring and maintenance module performs real-time sensing, fault prediction and remote management on the operation state of the LED cloud screen system, and finally outputs system state information and a maintenance response instruction; and the interaction control module analyzes and responds to the control event data in the SDS stream, and converts a structured control event into a standardized system control instruction. The operation stability and the interaction performance quality of the cloud screen system are improved, and the failure rate in the long-term use process is reduced.

The invention relates to the technical field of intelligent interaction control, and discloses a dynamic loading method and device for an intelligent interaction control unit of a television box. The method comprises the following steps: performing data mining on a user operation log to obtain a function module classification list, a use frequency statistical table and a dependency graph; and performing modular reconstruction on the software system based on the classification list to generate a function module package. And constructing a dynamic priority queue by using the frequency statistical table and the dependency graph. And carrying out predictive module loading in combination with the priority queue and the function module packet to obtain a loaded module list and a resource allocation state. And unloading the intelligent module according to the loading condition, and updating a module list and a resource use state. And executing incremental updating based on the version information in the module packet, updating the functional module packet and reconstructing the dynamic priority queue to obtain a target priority queue. According to the method, the resources can be flexibly allocated according to actual requirements, resource waste caused by static loading is avoided, and the resource utilization efficiency is improved.

The invention provides a tower crane remote real-time operation system which comprises the following modules: a remote control system is used for receiving and converting an operation signal of a handheld assembly and transmitting the operation signal to a tower crane cab monitoring system, and the tower crane cab monitoring system is used for collecting operation parameters and environment data of a tower crane in real time and transmitting the operation signal to a remote control system; the operation signal and the collected data are sent to the tower crane lifting, amplitude-changing and corner integrated frequency converter control system, and the tower crane lifting, amplitude-changing and corner integrated frequency converter control system is used for controlling the lifting, amplitude-changing and corner actions of the tower crane in real time according to the operation signal or the collected data. The intelligent interaction control module cooperates with the multi-source data fusion analysis module and the building state sensing and feedback module, tower crane data, construction area building states and associated influence parameters are comprehensively integrated, the building state sensing and feedback module monitors building deformation and stress, it is guaranteed that construction and design are consistent in combination with a BIM model, the deviation is smaller than or equal to 3 mm, and construction safety and progress are guaranteed.

The invention discloses a VR interactive control management system and method, and relates to the technical field of virtual reality. The method comprises the steps of obtaining multi-source interaction data of a user in a virtual reality environment, performing intra-modal representation conversion and fusion, and constructing a unified multi-modal input tensor; semantic intention representation is extracted based on the cross-modal perception structure; generating a control instruction vector in combination with the historical state information and the current semantic intention; mapping the control instruction vector into an equipment control signal set conforming to various VR terminal interface specifications; after the equipment executes the control instruction, multi-dimensional feedback information is collected, the structure of the multi-dimensional feedback information is reconstructed, feedback representation capable of flowing back to the sensing module is generated, and closed-loop interaction between sensing and control is achieved. Through unifying a multi-source interaction data structure, a dynamically adaptive control instruction vector and a high-precision cross-modal semantic representation mechanism are constructed, and a closed-loop interaction process with consistent sensing and control structures, flexible response and semantic alignment in a virtual reality system is realized.

The invention relates to the field of health data processing, and particularly discloses a virtual reality-driven children tic disorder multi-modal data evaluation and intervention system, which comprises a data acquisition and evaluation module, a data processing module, a data processing module and a data processing module, a professional evaluation scale and an algorithm are adopted to comprehensively evaluate the severity, psychological tolerance and social adaptability of the tourette syndrome of children to obtain an evaluation result; a scene generation and sorting module which is connected with the data acquisition and evaluation module, generates diversified virtual reality scenes according to the evaluation result, carries out the intelligent sorting of the scenes according to a difficulty gradual increase principle, and builds a high-authenticity scene through a high-precision modeling technology; and the interaction control and behavior guide module is used for realizing interaction between the child and the virtual reality scene. By adopting the technical scheme of the invention, personalized evaluation and immersive scene experience can be realized, and intelligent intervention and feedback can be realized.

The invention discloses a whole-process vascular interventional operation training method and system based on a virtual reality technology, and the method comprises the steps: firstly, developing a vascular interventional mechanics and collision simulation module, and achieving the deformation simulation of a blood vessel and a guide wire through the combination of position dynamics, a region shape matching technology and a Cosseerat elastic rod model, the collision between the blood vessel and the guide wire is treated by adopting a wide-to-narrow three-layer progressive collision detection method; secondly, constructing an immersive virtual operation scene through model construction and rendering optimization; visual angle roaming, instrument operation and interface interaction are fused, and multi-mode interaction control driving intervention training is achieved; finally, based on a'module-event 'dual-drive framework, operation tasks such as anesthesia, puncture, radiography, intervention, stent release and hemostasis are sequentially connected in series through a unified state machine, and whole-process training is achieved. The accuracy and stability of blood vessel and guide wire simulation are improved, the training immersion sense is enhanced, interventional operation whole-process training is achieved, and high teaching and practical value is achieved.

The invention discloses a medical model visual interaction control method and system based on gesture recognition, and relates to the technical field of medical image interaction, and the method comprises the steps: S1, achieving the three-dimensional imaging and processing of CT and MRI image data through VTK; s2, carrying out image acquisition on an operator, and capturing a gesture action image of the operator; s3, performing gesture segmentation on the captured gesture action image by adopting a gesture segmentation algorithm; s4, analyzing the gesture change of the operator based on gesture segmentation; and S5, performing real-time control on the medical three-dimensional model according to gesture change analysis. According to the medical model visual interaction control method based on gesture recognition, a doctor can operate through natural gestures, and dependence on traditional input equipment (such as a mouse and a keyboard) is reduced. The visual interaction mode can better conform to the operation habits of doctors, the working efficiency is improved, and the visual interaction mode is particularly important in medical scenes where quick response and complex information processing are needed.

The invention discloses an interactive travel guide system based on an AR technology, and relates to the field of travel guide. Through the three-dimensional virtual tour guide generation module and the historical scene miniature reduction module, a unique virtual tour guide image is constructed in combination with local cultural characteristics, and a historical scene is presented in a miniature model manner, so that a user can intuitively perceive the original appearance and change of a relics or cultural place, and the manner greatly enriches tour guide contents and improves the tour guide efficiency. According to the method, the cultural cognition depth of tourists is improved, the immersion and interestingness of sightseeing are enhanced, and compared with traditional character labeling or static information superposition, a more vivid and visual historical culture display means is provided. Besides, the data processing and interaction control module is used for dynamically updating the presented virtual tour guide information and the historical scene restoration content, and the personalized interaction mode not only improves the flexibility of tour guide, but also can adjust the display content according to the real-time feedback of the user, thereby meeting the diversified requirements of tourists.

The invention discloses an interaction control method and system for an intelligent agent and a front-end and back-end system, and the method achieves the automatic control of the intelligent agent on the front-end and back-end system through the integration of a large language model. The method comprises the following steps: an intelligent agent performs natural language intention recognition through a large language model, automatically selects a proper tool, extracts parameters required by the tool, converts the intention into a target task, generates a structured control instruction, maintains a complete session history and supports multiple rounds of dialogue interaction; the back end receives a user request, calls an intelligent agent to generate a structured instruction, transmits the structured instruction to the front end, and dynamically adjusts a subsequent instruction according to the received front end feedback; and the front end receives the instruction transmitted by the rear end, automatically identifies an instruction format through a regular expression, performs corresponding operation after parameter verification and feeds back a result. According to the method, unified control of the agent on the front-end UI and the back-end business logic is realized, complex multi-round dialogue and multi-step operation are supported, and the method has a wide application prospect.

The invention discloses an identification method for human-vehicle interaction, and relates to the field of human-vehicle interaction, and the method comprises the steps: collecting the original data of bc types of sensors; performing time synchronization on the original data of the bc types of sensors by using a timestamp alignment method; performing spatial synchronization on the original data of the bc types of sensors by using coordinate transformation to obtain preprocessed data after data alignment; establishing a deep neural network architecture, and performing feature-level fusion on the preprocessed data of each sensor through the deep neural network architecture to obtain a current environment state outside the vehicle; the system interacts with a driver, performs warning and reminding display on the driver according to the current environment state outside the vehicle, realizes judgment of the environment state outside the vehicle body in a complex environment, controls the vehicle body according to intelligent judgment, and realizes interaction control between the vehicle and personnel or objects outside and inside the vehicle.

The embodiment of the invention provides a UI automatic testing method and device, a storage medium and a program product. In the embodiment of the invention, the method does not depend on a test script, the language model used for UI automatic test directly and automatically identifies the interaction control needing to be tested according to the test requirement of the user on the target page and the screenshot of the target page, and the test instruction is generated for the interaction control needing to be tested; the terminal device where the target page is located is controlled through the test instruction to simulate user operation to conduct interaction control on the interaction control, and the test requirement of the user is met. According to the scheme, the to-be-tested control is automatically identified by the language model according to the test requirements and the page screenshot instead of depending on the test script, so that the test script does not need to be frequently modified due to the change of the page layout, the test cost can be reduced, and the test efficiency can be improved.

The invention is applicable to the technical field of information interaction, and provides an asymptomatic patient interaction method based on an eye-controlled staring trigger communication interface, which comprises the following steps: sight tracking: acquiring facial image data of a patient through a camera, extracting facial and eye mark points, performing image processing on an eye area, and judging a staring direction; staring triggering: presetting a coordinate area of an interaction control, judging whether a fixation point of a patient falls into the control area in real time, and if the fixation point is continuously kept for preset time, triggering corresponding operation; executing a compensation mechanism: compensating head movement and illumination change in real time, and correcting a staring point coordinate; and interface design: designing an interactive interface with a daily communication function, and broadcasting the content of the control through voice. The invention provides an efficient, convenient and easy-to-use eye-controlled staring triggering communication interface for the patient with the asymptomatic disease, aims to reduce the learning cost and the operation complexity of the patient, and has great significance in improving the life quality of the patient with the asymptomatic disease.

An improved electronic wager-based gaming machine (EGM) is disclosed. The EGM supports multiple concurrent players and maintains a plurality of distinct virtual meters, each exclusively associated with a distinct, concurrent game session on a single EGM. The server processes financial transactions, such as deposits and withdrawals using the EGM's cash handling peripherals, against a specific virtual meter and a corresponding player's casino account, which is maintained separate from the EGM's operational funds. This enables the EGM to act as a financial terminal for the player's account. Concurrently, data derived from the virtual meters is transformed and aggregated into a single, unified regulatory meter for compliance reporting, which is distinct from the virtual meters. The EGM provides a shared multiplayer interactive control interface to solve the technical problem of supporting multiple, independent player sessions concurrently on a single EGM.

The invention discloses a multi-device and multi-mode centralized control system which comprises an interaction control end and a device assembly. The interactive control end is configured according to three different control modes of centralized control, independent control and hybrid control, in the centralized control mode, a set of main control unit is configured for all devices, and the main control unit comprises a main control server which is used for operating a main control program and coordinating and controlling operation of all device components; in the independent control mode, each equipment component is provided with a corresponding embedded controller, and the embedded controller comprises an embedded control server which is used for operating a main control program for controlling the corresponding equipment component; in the hybrid control mode, one or more independent devices are provided with embedded controllers, the embedded controllers communicate with the main control server, the device assembly comprises a device body and a driving unit, and the device body is driven by the driving unit to achieve various operation functions. According to the invention, centralized control of multiple devices in a large-scale manufacturing factory can be realized.

Embodiments of the invention provide an interaction control method and apparatus, a device and a storage medium. The method comprises the steps of obtaining a plurality of user gesture images triggered by a user for a target interface element in a current application; determining whether the gesture operation of the user is a hand turning operation based on the plurality of user gesture images; and if the gesture operation of the user is the hand turning operation, displaying the target interface element according to a set interaction response logic corresponding to the hand turning operation. By the adoption of the method and device, a new type of air gesture operation, namely the hand turning operation, is defined, and the interaction modes in the man-machine interaction process are increased. And displaying the target interface element based on an interaction response logic corresponding to the hand turning operation set for the target interface element. By adopting the mode, the current display mode can be switched to another display mode to display the target interface element, so that the display efficiency is improved.

The invention provides an interaction method and device, electronic equipment and a storage medium, and relates to the field of artificial intelligence, and the method comprises the steps: obtaining an interaction task, a first interaction control of a first GUI associated with the interaction task, an executable first action list, and a first picture displaying the first GUI; and calling an intelligent agent integrated with a backtracking mechanism, determining an execution action under at least one time step according to the interaction task, the first picture, the first interaction control and the first action list, and executing the execution action so as to complete the interaction task. Therefore, the task completion quality can be improved, repeated operation or wrong operation caused by the fact that the action deviates from the task target is avoided, the task execution process is smoother, unnecessary resource waste is reduced, and then the task completion efficiency is improved.