1252 results about "Interaction control" patented technology

The invention provides a digital human interaction control method and device fusing emotion semantics and logical reasoning and a storage medium. The method comprises the following steps: analyzing multi-modal input data of a user, constructing emotion-semantics joint representation, and generating a logic decision path; and through a cognitive fusion module, emotion-semantic representation and a logic decision path are fused, and an interaction response adapting to emotion and logic consistency is generated. The system optimizes an emotion semantic model and a logical reasoning rule on line according to user feedback and interaction history, and real-time interaction of emotion dynamic and logical rules is achieved. The system can dynamically adjust the logic decision path based on the multi-mode emotional state of the user, and improves the naturalness and situation adaptability of interaction. A dynamic time warping algorithm and a factorization machine are introduced to process a multi-modal feature fusion problem, and the accuracy and robustness of emotional state recognition are improved. The online optimization mechanism enables the model and the rule to be evolved continuously, and reasoning errors are corrected automatically through user feedback, so that error circulation is avoided.

The invention discloses a digital twin interaction control system based on robot vision and tactile fusion, and the system comprises a data collection module which is used for collecting visual image data and tactile sensing data; the preprocessing module is used for preprocessing; the multi-mode perception modeling module is used for executing spatial perception modeling and tactile state modeling; the fusion state vector construction module is used for generating a fusion state vector; the digital twinborn mapping module is used for constructing a digital twinborn body; the simulation interaction control module is used for executing interactive action control and generating a control instruction parameter group; the action execution and feedback module is used for controlling the robot to execute the actual action and updating the fusion state vector; and the dynamic evaluation and self-adaptive adjustment module is used for dynamically optimizing and adjusting the fusion state vector. Visual and touch information of the robot is fused, a digital twinning synchronous control mechanism is constructed, and the interactive optimization method which is fast in operation response, high in execution precision and stable in control process is achieved.

The invention discloses an intelligent household electrical appliance interaction control system based on embedded software. A system operation process specifically comprises the following steps: acquiring a user input signal; analyzing the user input signal based on an embedded software architecture to generate a standardized control instruction; establishing communication connection with a plurality of intelligent household electrical appliances through an Internet of Things protocol, and obtaining real-time environment data and real-time operation states of the intelligent household electrical appliances; performing conjoint analysis on the user historical behavior data and the user input signal; adjusting operation parameters of the intelligent household electrical appliance; and returning interaction response information to the user through at least one mode of a voice feedback module, a touch interface, a gesture recognition interface or a mobile phone APP. The method has the following advantages and effects: multi-mode instructions can be adaptively fused, the equipment capability and the user intention can be dynamically matched, and cross-equipment and cross-protocol efficient and accurate control is realized through standardized instruction generation, real-time load sensing and priority dynamic calculation.

The invention relates to the technical field of data processing of organic displays, in particular to an interaction control method of a double-screen organic display system, which acquires touch control, deformation and ambient light data in real time through a multi-mode sensor array, and realizes cross-screen heterogeneous data space-time alignment by adopting an improved clock synchronization protocol and a sliding window mechanism. And generating a time sequence feature vector set with weight. And based on an LSTM-Transform hybrid model, fusing historical communication delay data, analyzing space-time relevance by using a multi-head attention mechanism, and outputting a cross-screen communication delay probability distribution diagram. And generating a multi-target task allocation strategy in combination with a deep reinforcement learning model, and iteratively calculating a shortest path allocation scheme of a rendering task through an improved ant colony optimization algorithm. The space-time synchronization precision of double-screen interaction is effectively improved, signal misalignment caused by communication delay is reduced, the distribution efficiency of distributed rendering resources is optimized, and the environmental adaptability and operation robustness of a flexible display system are enhanced.

The invention provides a multi-source information fusion automobile light personalized interaction control system and method, and relates to the technical field of automobile intelligent light control. The system comprises a multi-source sensing module, a data preprocessing module, a data analysis processing module and a vehicle lamp driving module. The multi-source sensing module collects multi-source heterogeneous data, after the multi-source heterogeneous data is processed by the data preprocessing module, fusion analysis and intelligent decision are carried out by the data analysis processing module, a control instruction is generated, and finally, the instruction is executed by the vehicle lamp driving module and a state is fed back. According to the invention, the defects of the existing automobile light control technology in the aspects of intelligence, situational and individuation are overcome, the efficient, intelligent and individualized control of the automobile light is realized, and the driving safety, comfort and entertainment are improved.

The invention discloses a WebXR-based digital twinning extension method in a highway scene, and aims to solve the problems of poor interaction adaptability between a three-dimensional twinning model and a Web end XR, high interaction response delay, inflexible resource updating mechanism and the like in an existing system. The method comprises the following steps: constructing a three-dimensional twinborn model based on highway scene structure information, traffic state information and environment monitoring data; formatting the model into an analyzable data structure suitable for a Web end; starting an operation instance through a WebXR session, loading XR equipment capability, collecting and analyzing user space positioning, head posture and control input information, and generating an interaction control instruction; and the incremental resource replacement of the three-dimensional twin model is realized according to the updating instruction of the server side. According to the method, the adaptability, the interactivity and the real-time performance of the Web end XR system in the traffic digital twin environment are improved.

The invention provides an interface interaction control method and device, wearable equipment and a computer readable storage medium. The interface interaction control method comprises the steps that a virtual scene picture is displayed, and the virtual scene picture comprises a cursor interaction interface and a virtual ray of cursor control equipment; based on a current ray interaction point, a cursor of the cursor control equipment is displayed on the cursor interaction interface, and the current ray interaction point is an intersection point between the virtual ray located at the current display position and the cursor interaction interface; and when the cursor control equipment moves, controlling the cursor to move from the current ray interaction point to a target ray interaction point. According to the method, the interface interaction intuition can be improved, and the interface interaction operation efficiency is improved.

The invention discloses an LED cloud screen 3D interaction control system, and relates to the technical field of cloud screen interaction control, and the system comprises a content input module which receives multi-source signal content from the outside and converts the multi-source signal content into an SDS stream; the 3D rendering and processing module performs image generation and effect optimization, and generates a final display image step by step; the display output module converts the final display image into a data frame which can be directly loaded and displayed by the LED cloud screen; the monitoring and maintenance module performs real-time sensing, fault prediction and remote management on the operation state of the LED cloud screen system, and finally outputs system state information and a maintenance response instruction; and the interaction control module analyzes and responds to the control event data in the SDS stream, and converts a structured control event into a standardized system control instruction. The operation stability and the interaction performance quality of the cloud screen system are improved, and the failure rate in the long-term use process is reduced.

The invention belongs to the field of computer control systems, and provides an interaction control method and system based on smart home equipment, and the method comprises the steps: extracting the context information of a current user when there is missing control parameters, the context information comprising time information, a spatial position, an environment state and a user identity; constructing a control context map of the current user; searching a neighborhood user set similar to the behavior portrait characteristics of the current user, and extracting control parameter records of the neighborhood users in the context similar to the current user; performing weighted fusion on the historical control parameter of the current user and the control parameter of the neighborhood user to generate a target control parameter; forming a complete control command, and issuing the complete control command to the target smart home device to execute a control operation; and updating the control context map based on user feedback or a system monitoring result.

The invention provides a control method, which is applied to an artificial intelligence experiment system, at least comprises a robot hardware platform, a controller, a wheeled robot chassis and an industrial mechanical arm, and the method comprises the following steps: starting an operation system and executing hardware self-inspection; loading a large language model service and a traditional AI model, wherein the traditional AI model comprises a speech recognition model, a target detection model and a semantic analysis model; a natural language instruction of a user is received, voice is converted into a structured text through a voice recognition model, an instruction intention is analyzed through a large language model and a semantic analysis model, robot control parameters are generated, and a multi-modal interaction control signal is obtained; based on the multi-mode interaction control signal, a camera is called to collect image data, the position and category of a target object to be grabbed by the robot are recognized through a target detection model, the moving path of the robot and the grabbing track of the mechanical arm are calculated in combination with laser radar data, and the wheeled robot chassis and the industrial mechanical arm are controlled to execute coordinated actions.

The invention relates to the technical field of computers, and discloses an interaction control method of intelligent glasses. The method comprises the following steps: synchronously acquiring multi-modal data such as eye movement, voice, gestures and head postures and environment and application context information; carrying out independent time sequence feature coding on each modal data; generating a modulation vector in combination with the context, and outputting probability distribution of user intentions through a cross-modal attention fusion network; and a unique execution instruction is determined through an instruction arbitration module based on rules and a state machine. The system comprises corresponding function modules. According to the method, the accuracy, robustness and naturalness of interaction are improved through multi-modal synchronous fusion and a context self-adaption mechanism.

The invention discloses an interactive travel guide system based on an AR technology, and relates to the field of travel guide. Through the three-dimensional virtual tour guide generation module and the historical scene miniature reduction module, a unique virtual tour guide image is constructed in combination with local cultural characteristics, and a historical scene is presented in a miniature model manner, so that a user can intuitively perceive the original appearance and change of a relics or cultural place, and the manner greatly enriches tour guide contents and improves the tour guide efficiency. According to the method, the cultural cognition depth of tourists is improved, the immersion and interestingness of sightseeing are enhanced, and compared with traditional character labeling or static information superposition, a more vivid and visual historical culture display means is provided. Besides, the data processing and interaction control module is used for dynamically updating the presented virtual tour guide information and the historical scene restoration content, and the personalized interaction mode not only improves the flexibility of tour guide, but also can adjust the display content according to the real-time feedback of the user, thereby meeting the diversified requirements of tourists.

The invention discloses a display equipment intelligent voice interaction method based on a large language model, and the method comprises the steps: constructing a set of display equipment intelligent voice interaction system suitable for a complex scene based on a large language model technical framework through integrating a multi-stage audio processing module, an intelligent voice recognition module, a semantic understanding and intention recognition module and a multi-mode interaction control module; the voice enhancement technology is adopted, high-precision voice instruction capture and noise reduction processing can be achieved in a noisy environment, and geographic space parameters and operation logic implied in user intentions are accurately analyzed in combination with a deep semantic analysis engine; through a multi-mode fusion control mechanism, real-time linkage interaction between a voice instruction and display equipment is supported, natural and smooth voice control experience is provided especially for scenes such as three-dimensional space positioning and topographic data calling in a holographic geographical environment, and the system has strong error recovery capability and good expansibility and is suitable for being popularized and applied. The method is especially suitable for a voice control interaction scene in a holographic environment.

The invention discloses an interaction control method and system for an intelligent agent and a front-end and back-end system, and the method achieves the automatic control of the intelligent agent on the front-end and back-end system through the integration of a large language model. The method comprises the following steps: an intelligent agent performs natural language intention recognition through a large language model, automatically selects a proper tool, extracts parameters required by the tool, converts the intention into a target task, generates a structured control instruction, maintains a complete session history and supports multiple rounds of dialogue interaction; the back end receives a user request, calls an intelligent agent to generate a structured instruction, transmits the structured instruction to the front end, and dynamically adjusts a subsequent instruction according to the received front end feedback; and the front end receives the instruction transmitted by the rear end, automatically identifies an instruction format through a regular expression, performs corresponding operation after parameter verification and feeds back a result. According to the method, unified control of the agent on the front-end UI and the back-end business logic is realized, complex multi-round dialogue and multi-step operation are supported, and the method has a wide application prospect.

The invention discloses an intelligent interaction control method for AI glasses, and relates to the technical field of AI glasses, and the method comprises the following steps: synchronously collecting user input signals and environmental parameters through a multi-source sensor group built in the glasses, the sensor group at least comprising an IMU, a binocular camera, a microphone array and a physiological sensor; carrying out real-time fusion processing on the multi-modal input data by adopting a lightweight neural network to generate an interaction intention feature vector; based on real-time detection results of environmental noise intensity and illumination conditions, dynamically distributing weight coefficients of all interaction modes; generating a hierarchical response instruction according to the weight coefficient and a confidence threshold; and continuously optimizing the personalized interaction strategy of the user through a federal learning framework. According to the AI glasses intelligent interaction control method, through multi-modal weighted fusion, edge AI acceleration and federated learning optimization, the interaction success rate in a complex environment is improved to 93.6%; the end-to-end delay is controlled within 28ms; and a user-defined interaction strategy is supported.

The embodiment of the invention provides a UI automatic testing method and device, a storage medium and a program product. In the embodiment of the invention, the method does not depend on a test script, the language model used for UI automatic test directly and automatically identifies the interaction control needing to be tested according to the test requirement of the user on the target page and the screenshot of the target page, and the test instruction is generated for the interaction control needing to be tested; the terminal device where the target page is located is controlled through the test instruction to simulate user operation to conduct interaction control on the interaction control, and the test requirement of the user is met. According to the scheme, the to-be-tested control is automatically identified by the language model according to the test requirements and the page screenshot instead of depending on the test script, so that the test script does not need to be frequently modified due to the change of the page layout, the test cost can be reduced, and the test efficiency can be improved.

The invention discloses an intelligent oral examination interactive guidance system and method based on augmented reality, and the method comprises the steps: collecting an oral image through a front-facing camera and an oral examination application program of an intelligent terminal device; the application program comprises an equipment posture detection model, a display interface adjustment module, an augmented reality rendering module, an oral cavity image analysis module and a virtual role interaction control module, an equipment inverted holding mode is innovatively adopted, and a virtual dentist role is displayed in a real-time image in an overlapping manner in combination with an augmented reality technology; the virtual dentist role guides the user to adjust the shooting angle, distance and light conditions through intuitive actions and expressions, and an oral cavity inner side image is obtained in combination with a low-cost auxiliary dental mirror tool. And the system also analyzes the image quality in real time, and the virtual role performs targeted guidance, so that a high-quality oral image is finally obtained. The feasibility and effect of oral cavity self-inspection of common users under the background of lack of professional knowledge are greatly improved, and effective technical support is provided for remote oral cavity medical treatment and personal oral cavity health management.

The invention discloses a multi-device and multi-mode centralized control system which comprises an interaction control end and a device assembly. The interactive control end is configured according to three different control modes of centralized control, independent control and hybrid control, in the centralized control mode, a set of main control unit is configured for all devices, and the main control unit comprises a main control server which is used for operating a main control program and coordinating and controlling operation of all device components; in the independent control mode, each equipment component is provided with a corresponding embedded controller, and the embedded controller comprises an embedded control server which is used for operating a main control program for controlling the corresponding equipment component; in the hybrid control mode, one or more independent devices are provided with embedded controllers, the embedded controllers communicate with the main control server, the device assembly comprises a device body and a driving unit, and the device body is driven by the driving unit to achieve various operation functions. According to the invention, centralized control of multiple devices in a large-scale manufacturing factory can be realized.

The invention discloses an intelligent driving recording method and system based on voice AI, and relates to the technical field of intelligent driving recording. The method comprises the following steps: acquiring a user voice instruction through voice acquisition equipment, and identifying the user voice instruction through a vehicle-mounted lightweight ASR model; analyzing the instruction to generate a structured control instruction containing an event type and a time reference; determining a time window of the event to be marked in combination with the time reference, the motion data of the IMU sensor and the video data; packaging, encrypting and storing the video clip in the window, the sensor data and the structured control instruction to generate an event record; the video is analyzed in real time through a local lightweight computer vision model, and when a preset dangerous scene is detected, voice early warning is triggered and an associated video is automatically stored. According to the invention, voice interaction control, accurate event marking, real-time danger early warning and efficient data management of the driving record are realized, and the convenience, accuracy and safety of the driving record are improved.

The invention provides a voice interaction control method and device of a browser, electronic equipment and a storage medium, and the method comprises the steps: obtaining a voice control instruction input by a user, and determining a target control intention based on the voice control instruction; obtaining a target document object model tree corresponding to the current webpage of the browser; sending the target control intention and the target document object model tree to a server, and receiving at least one control instruction generated by the server based on the target control intention and the target document object model tree; and executing the at least one control instruction, and controlling the webpage to render an interaction result corresponding to the voice control instruction. In this way, the steps of maintaining and developing each website and exhausting all webpage functions to generate the instruction set can be reduced, and the control efficiency of browser voice interaction control can be improved.

The invention discloses a robot multi-mode interaction control method and a related device, and the method comprises the steps that a robot controller obtains user interaction information, and the user interaction information comprises user voice information and / or user action information; analyzing the user interaction information, and determining a shopping guide service type and a target vehicle part; acquiring first component information of the target vehicle component from a preset vehicle knowledge base according to the shopping guide service type; according to the shopping guide service type and the first component information, a target action sequence is determined from a preset action library, the target action sequence comprises joint actions and voice actions, the voice actions are used for outputting voice shopping guide information, and the voice shopping guide information is determined according to the first component information; and sending a first control instruction to the target robot, wherein the first control instruction is used for indicating the target robot to execute the target action sequence. According to the invention, the functionality and intelligence of the humanoid robot as an intelligent shopping guide robot can be improved.

The invention discloses a virtual interaction system for realizing multi-dimensional perception, which relates to the technical field of virtual interaction, and comprises a man-machine interaction unit, a mapping matching unit, a data processing unit and a data processing unit, and the coordinate matching module is responsible for establishing a coordinate matching relation of the virtual object in the virtual space according to the size, shape and attitude parameters of the virtual object. The interaction device is operated to control the intelligent mark point in the virtual interaction system to interact with the target object, according to the position relation in the interaction process, the position posture of the interaction object is collected to determine whether contact occurs, event triggering and target interaction are achieved through the triggering control unit, a user senses the event, and the interaction efficiency is improved. Interaction requirements can be met, multi-target interaction control requirements are met, and the purpose of saving system resources is achieved.

The invention relates to a resource interaction control method and device, equipment and a medium. The method comprises the steps of generating a scanning area of a preset range based on a coordinate position of a player character in a corresponding area in a game map, and judging whether an enemy target exists in the scanning area or not; when the hostile target does not exist in the scanning area, determining that a corresponding activity mode of a wreckage resource currently configured by the player character is an accompanying activity mode so as to drive the wreckage resource to execute a displacement behavior around the player character according to a preset movement rule; and when the hostile target exists in the scanning area, determining that the activity mode corresponding to the wreckage plastic resource is a combat activity mode so as to drive the wreckage plastic resource to execute a combat behavior on the hostile target. According to the method, the interaction effect of the game resources and the game interaction experience of players are improved, meanwhile, the game development process is optimized, and the playability and design diversity of the game are improved.

The invention discloses a lanyard data line interaction control method based on artificial intelligence, and the method comprises the following steps: S1, collecting interaction data of a lanyard data line, and carrying out the preprocessing of the interaction data; s2, segmenting according to a set window, performing singular value decomposition on each segment, and constructing a main feature set; s3, performing hypersphere embedding on the principal component vector, performing linear projection on the residual vector, and generating a characteristic spectrum by adopting Laplacian mapping; s4, performing tensor decomposition on the characteristic spectrum, and constructing a multi-order structure; s5, executing bidirectional loop iteration on the tensor interaction sequence and controlling information transmission; s6, analyzing the prediction action, matching the prediction action with an instruction mapping table, generating a control instruction, and sending the control instruction to the terminal equipment; and S7, counting execution feedback, updating a tensor interaction sequence weight, and optimizing an interaction control strategy. According to the invention, high-precision identification and stable adaptive control of the lanyard data line are realized, and the interaction precision, the response speed and the use convenience are effectively improved.

The invention relates to a clinical surgery experiment virtual simulation teaching method and device, equipment and a medium. The method comprises the following steps: responding to an obtained teaching task configuration file; the teaching task configuration file comprises a clinical scene and an evaluation standard; calling a corresponding three-dimensional digital physiological model according to the teaching task configuration file, and performing special effect rendering according to the clinical scene to obtain a visual virtual simulation experiment scene; responding to the obtained user action data, performing real-time deformation on the three-dimensional digital physiological model, and generating feedback parameters; the feedback parameter is used for indicating the interaction control to work according to the feedback parameter; and comparing the user action data with preset standard expert action data, and generating a teaching evaluation result based on an evaluation standard. By adopting the method, high fidelity can be carried out on the whole process of clinical surgery experiment teaching, effective technical support is provided for medical skill teaching, and the method is suitable for multi-scene and multi-level medical teaching practice requirements.

The invention provides a screen interaction method and device, a display device and a storage medium, and the method comprises the steps: obtaining a hand key point of a master control person controlling a target screen, and carrying out the user positioning and skeleton tracking of a target image containing the master control person to determine the hand key point; according to the three-dimensional position information of each hand key point, target pose information of a hand limb of the master control person is determined, and the target pose information comprises at least one of the curvature, the pointing direction and the movement trend; determining a target gesture of the master control person according to the target pose information of the hand limb and standard pose information of the hand limb in the preset gestures; and performing interaction control on the target screen in response to an operation event corresponding to the target gesture. According to the technical scheme, additional interaction equipment such as a mouse does not need to be configured, the equipment configuration cost is reduced, hand pointing analysis is performed based on the three-dimensional space to determine the target interaction position, the interaction accuracy is ensured, and then the interaction performance is improved.

The invention relates to the technical field of intelligent education and Internet of Things fusion, in particular to a multi-modal interaction control method and system of a multifunctional teaching-assistant robot and the robot. According to the system, a tablet AI processor runs an Android system as a core, a display module, a man-machine interaction module, an audio input module, an audio output module, an image acquisition module, a temperature and humidity sensor module, a WIFI or Bluetooth module, an Ethernet module and an Internet of Things module are connected, and the Internet of Things module supports RS485 wired access and Zigbee wireless access at the same time; the tablet AI processor executes voice interaction, video call, face recognition, environment monitoring, network interaction and equipment linkage, and provides a face recognition alignment and depth feature matching algorithm and an annular microphone array beam forming and sound source direction estimation algorithm, so that multi-modal interaction and multi-equipment linkage in a teaching scene are realized. The convenience and the safety are improved; and the equipment access cost is reduced.

The invention relates to a multi-user holographic sand table collaborative resolving system and method based on 360-degree omni-directional perception gesture recognition. The method comprises the following steps: acquiring continuous multi-frame multi-view hand image data; hand instance separation and key point extraction are carried out on the multi-view hand image data of each frame, and spatial 3D coordinates of 21 key points are independently solved for each hand instance; based on the space 3D coordinate sequence of the continuous frames, space-time action features are extracted, and a gesture template library is matched to recognize gesture types and motion parameters; analyzing the gesture type, matching an interaction intention in combination with a predefined gesture-instruction mapping table, and generating an interaction control instruction according to a matching result; generating a three-dimensional holographic sand table image cooperatively operated by multiple persons in real time according to the interaction control instruction; through a multi-hand parallel processing technology, different hand instance feature extraction paths are separated, the problem of multi-hand ID jump is solved, occlusion area coordinate prediction is optimized, and interactive use experience is improved.

The invention provides an interactive multi-dimensional data visualization display sand table and method for business data analysis, and the method comprises the steps: carrying out the semantic mapping of state parameters in an interaction control operation when the interaction control operation is received, obtaining a plurality of pieces of visualization intention metadata, and generating a structured query instruction; based on the structured query instruction, extracting a target data subset rendered visually by the heterogeneous commercial data source from a multi-dimensional data cube of the commercial data source, performing visual optimization on the visually rendered chart type, the visual coding channel and the initial visual parameter through the cardinal number of the dimension field in the target data subset and the data distribution type and the numerical range of the measurement field to obtain a visual configuration set of the target data subset; and using the visualization configuration set to render and generate a multi-dimensional data visualization view, and outputting and displaying the data visualization view in a graphical user interface. Based on the scheme, automatic closed loop generation from heterogeneous data to interactive views can be realized.

The invention discloses an interaction control method, system and equipment for intelligent glasses, and relates to the related field of intelligent glasses interaction, and the method comprises the steps: obtaining multi-modal interaction information through a multi-modal data collection device; performing interaction feature extraction on the multi-modal interaction information, and identifying an interaction intention trigger point; analyzing a co-occurrence frequency matrix between the modal pairs according to the trigger points to obtain a co-occurrence frequency vector; and inputting the co-occurrence frequency vector into a credibility evaluation module, calculating a credibility score of the interaction intention, if the score is greater than a preset threshold value, triggering an interaction control instruction, and executing a control program by the intelligent glasses. The technical problems that an existing intelligent glasses interaction mode depends on a single mode, the false triggering rate is high, and the user experience is unstable are solved, and the technical effects that through multi-mode cross validation and dynamic intention credibility evaluation, the false operation rate of the intelligent glasses is reduced, and the multi-mode interaction experience is improved are achieved.