4948 results about "Interaction mode" patented technology

The invention discloses a smart home voice interaction control method and system, and relates to the technical field of smart home. The problems that in the prior art, the intention of a user cannot be accurately understood through non-voice information such as emotion and expression of the user, a control strategy is solidified and lacks individuation, and user requirements and emotion cannot be met in real time are solved. By fusing voice and non-voice information, accurate recognition of user intentions is enhanced, recognition accuracy of voice instructions is improved, emotional states and requirements of users are understood more comprehensively, particularly in a noisy environment or a complex situation, recognition and response effects of the system are obviously improved, and user experience is improved. By utilizing the emotion analysis and context understanding technology of the user, the interaction mode is dynamically adjusted according to the emotion state of the user, the emotion demands of different users can be flexibly adapted, more humanized services are provided, the control strategy is continuously optimized according to the feedback of the user, the user satisfaction is improved, and the user experience is improved. Therefore, the intelligent degree and the user experience of the smart home system are improved.

The invention discloses a multi-perception interaction method and system based on virtual reality. The method comprises the following steps: creating a virtual scene and an intelligent agent based on an interaction demand, and constructing a perception model of the virtual scene and the intelligent agent; the intelligent agent perceives visual, auditory and tactile environments, extracts perceived feature time sequence data, divides instructions according to the perceived feature time sequence data, and calculates instruction priorities. And generating a decision network according to a preset knowledge graph, and forming an instruction chain in combination with the instruction priority, so that the intelligent agent obtains a feedback strategy. A dynamic weight value is distributed to a feedback strategy, a virtual scene is updated through fusion of an attention mechanism and a perception model, an interaction mode is obtained, meanwhile, physical and psychological parameters of a user are recorded in real time, abnormal fluctuation segments are recognized, and emotional tendency of the user is learned from corresponding interaction, so that the interaction mode is continuously optimized. According to the method, the interaction experience can be improved, the intelligent agent can better meet the user requirement, the interaction effectiveness and adaptability are enhanced, and meanwhile good interpretability is achieved.

The invention relates to the technical field of interaction systems, in particular to an intelligent control-based nursing board interaction system, which comprises a nursing board, and is characterized in that the nursing board internally comprises a voice recognition and control module integration, a board data interaction and display module, a board function page control module, an intelligent equipment control module and a feedback and interaction module; the voice recognition and control module integration, the billboard data interaction and display module, the billboard function page control module, the intelligent equipment control module and the feedback and interaction module are electrically connected. According to the method, a visual nursing billboard large screen is provided, interaction with the visual nursing billboard large screen is carried out through an API interface, instruction analysis and execution are supported, meanwhile, real-time voice and visual feedback and a multi-mode interaction mode are provided, and the user experience is remarkably improved.

The invention discloses a multi-mode instruction interaction method and system based on a virtual character, computing equipment and a storage medium, and the method comprises the steps: obtaining and recognizing user posture data, and obtaining a first operation instruction corresponding to the posture data; voice data of the user are obtained and recognized to obtain intention data of the user, and a corresponding second operation instruction is obtained according to the intention data; the first operation instruction and the second operation instruction are subjected to timestamp alignment, the similarity of the first operation instruction and the second operation instruction in the semantic space is calculated, the first operation instruction and the second operation instruction are fused and dynamically adjusted through a weighted average method, and an instruction with the highest priority is obtained to serve as a final operation instruction to control an object in the virtual scene to move. According to the method, the gesture instruction and the voice instruction are deeply fused, the interaction space between the user and the virtual environment is greatly expanded, the limitation of a traditional single interaction mode is broken through, and more natural, efficient and intelligent immersive experience is provided for the user.

The invention relates to a gesture and voice fused multi-mode man-machine interaction system and method, and belongs to the field of multi-mode man-machine interaction. The system comprises an interactive perception layer, an interactive analysis layer and an interactive response layer, the interactive perception layer is used for acquiring multi-modal interactive information, accessing gesture and voice modal information acquisition equipment, and acquiring and processing original signals of the interactive information; the interaction analysis layer is used for defining the meaning of the human-computer interaction information of each channel and analyzing the meaning and instruction intention of the multi-modal interaction information; and the interaction response layer is used for realizing mapping between the man-machine interaction intention obtained by the interaction analysis layer and the interaction operation of the application system, and comprises an instruction-operation conversion module. According to the invention, independent recognition and fusion recognition functions of gesture instructions and voice instructions are provided, the robustness of the man-machine interaction system is improved, a more natural and convenient man-machine interaction mode is provided, and the development requirements of intelligent man-machine interaction are met.

The present invention discloses a remote operation and maintenance control method and system in a dual interactive mode, which relates to the field of remote operation and maintenance control technology, including: establishing a remote two-way communication connection, collecting substation data for pre-processing; judging the equipment status to determine the execution strategy; comparing the result with the preset standard configuration according to the result, triggering the corresponding rollback or repair operation; analyzing the abnormal state of the equipment, generating a fault diagnosis report; establishing an early warning mechanism based on the diagnosis report, and dynamically adjusting the early warning response by classification. The present invention adopts a multi-level control mechanism to dynamically adjust the execution strategy during the task execution process. When multiple tasks are concurrent, resources are automatically allocated through task scheduling and priority control. Effectively improve the response speed and processing efficiency of the operation and maintenance system. After each task or fault processing, the system automatically archives the operation results to the log database, and adjusts future strategies according to the task execution effect.

The invention provides an intelligent laboratory man-machine interaction control method and system, and relates to the technical field of control, and the method comprises the steps: collecting experimenter and equipment images through a visual collection device, recognizing equipment operation state parameters based on a deep learning model through a processing server, including a switch state, an indicating lamp state, a display screen state and a fault indication state, and transmitting the state parameters to a server; and comparing the identification result with a preset parameter to generate an evaluation result. And the processing server receives the user voice instruction, extracts the content of the control instruction, and determines the target equipment and the control action. And verifying the legality of the instruction and judging whether an execution condition is met by combining an equipment state evaluation result. And a cooperative control strategy is generated according to the control instruction and the evaluation result, the cooperative control strategy comprises a control time sequence, parameters and a data interaction mode, and the control instruction is sent through the field bus network to realize multi-device cooperative control. According to the invention, intelligent management and control of laboratory equipment are realized, and the experiment efficiency and safety are improved.

The invention discloses a conference enhancement method and device, equipment and a storage medium, and relates to the technical field of computers, and the method comprises the steps: preprocessing the multi-modal original information of a conference through a data preprocessing component, carrying out the multi-modal data fusion and time alignment processing based on a preprocessing result, and determining a target data packet; analyzing the state of a participant through a participant analysis component and the target data packet, determining a target model for analyzing the behavior and state of the participant, and determining the context of a speaking party of the conference based on the target model; structural representation of the conference content is carried out through the conference content processing component and the speaking party context; analyzing a team interaction mode and a decision forming process of the conference by adopting an overall perspective through a decision analysis component, a target model, the structured content and a corresponding argument analysis result; and determining whether conference intervention is performed or not according to the analysis result through an intervention output component, and if so, determining and outputting a target intervention suggestion. The effectiveness and the quality of the conference result are improved.

A CAE simulation result visualization system supporting multiple interaction modes comprises a multi-resolution rendering module used for obtaining interaction behaviors of a user and dynamically adjusting the resolution of a rendering area according to the interaction behaviors of the user; the key frame and time step screening module is used for analyzing the input simulation data, automatically screening out key frames and detecting the time step change of the simulation data according to a time sequence analysis method; the data compression and simplification module is used for compressing the data by using a feature-preserving compression algorithm, performing incremental storage and sparse representation on the compressed data, and recording data changes; and the dynamic local playing and frame-skipping rendering module is used for acquiring a user local time playing instruction, and processing user local time and non-user local time respectively through a frame-skipping rendering method so as to realize multi-frame rendering and switching. According to the method, the data analysis efficiency is improved, the rendering and data transmission efficiency is improved, and computing resources are saved.

The invention relates to the field of modern man-machine interaction, in particular to an LUI and GUI method and system based on an emotion module. According to the technical scheme, the LUI and GUI method and system based on the emotion module comprise a dynamic GUI generation and adaptation module; compared with a traditional GUI system which generally depends on a preset interface design and a fixed interaction mode when interacting with a user and lacks active perception and active response ability to the emotion of the user, due to the defect, the user experience is not personalized enough, dynamic adjustment cannot be carried out according to the instant emotion state of the user, and the user experience is poor. According to the LUI and GUI system based on the emotion module, the language user interface is introduced to interact with the user, so that the defects in the prior art are overcome, the LUI can have a dialogue with the user through a natural language processing technology, and the system can call a dialogue management function by analyzing the emotion of the user, so that a response and interaction page conforming to the current emotion of the user is generated.

The invention discloses a meta universe-based conference interaction method, and relates to the technical field of virtual conferences, and the method comprises the steps: extracting the facial features of participants, comparing the facial features with a pre-established facial feature library, obtaining the unique identity of each participant, and recognizing the identities of the participants; after the identities of the participants are determined, position changes of key body joint points of the participants are detected in real time, and specific actions of the participants are judged by analyzing relative positions and movement tracks between the joint points; the method comprises the following steps: receiving the acoustic characteristics of the participant language, converting the voice signal of the participant into a text, and analyzing the semantics and emotion of the text in combination with natural language processing to obtain the language expression intention of the participant. According to the method and the device, the optimal interaction mode can be dynamically selected from the preset library according to different interaction intentions, and the audio and video parameters and the interface layout are adjusted in real time, so that intelligent interaction in a multi-user scene is realized, the interaction experience of a conference is optimized, and the interaction effect can also be improved.

The invention relates to intelligent glasses, an interaction method and device of the intelligent glasses, electronic equipment and a medium. The sensing module, the decision making module, the execution module and the feedback module are arranged on the glasses body so as to sense multi-dimensional environment data of a surrounding environment and current behavior data of a user in a preset intelligent interaction mode, predict a behavior intention of the user, track a first behavior change of the user and a first environment change of the surrounding environment and send the first behavior change to the feedback module; and determining an instruction chain meeting a preset execution condition, executing the instruction chain to track a second behavior change of the user based on the instruction chain, and optimizing a generation algorithm of the instruction chain based on the second behavior change. Therefore, the technical problems that in the related technology, the intelligent wearable device understands the environment in a one-sided mode, interaction is passive, the intelligent wearable device can only operate according to a set rule, the intelligent level is insufficient, convenience cannot be provided for a user, and normal use of the user is easily affected are solved.

The invention provides an interaction method and device based on agent cooperation, an agent and a storage medium, belongs to the technical field of artificial intelligence, particularly relates to the technical fields of deep learning, large models, agents, AIGC and the like, and is applied to application scenes such as wisdom education, video production, wisdom medical treatment and the like. The intelligent agent cooperation-based interaction method comprises the following steps: performing intention understanding on initial input information for a target object to obtain an initial intention understanding result; performing interaction mode demand detection on the initial intention understanding result by using a first agent to obtain an interaction mode demand attribute; an interaction element matched with the interaction mode demand attribute is called to interact with the target object, interaction information representing the demand intention of the target object is obtained, and the interaction element is used for responding to the interaction behavior; and controlling the second agent to execute the target task based on the interaction information to obtain an execution result, and pushing the execution result to the target object.

The invention belongs to the technical field of human-computer interaction, and discloses a digital twin WEB application air gesture interaction method and system. Comprising the following steps: collecting a real-time video stream of a camera of user side equipment, and preprocessing the real-time video stream; x hand region frames are obtained; inputting the X hand region frames into a preset hand key point detection model based on a generative adversarial network to obtain hand key point coordinate data; acquiring a hand skeleton model based on the hand key point coordinate data; acquiring a joint angle and a hand motion track according to the hand skeleton model; mapping the hand skeleton model into a digital twin virtual scene, presetting n gesture instruction modes in the digital twin virtual scene, and matching the hand skeleton model, the joint angle and the hand motion track with the gesture instruction modes; personalized and extensible gesture interaction capability is provided, and man-machine interaction modes are enriched.

The invention relates to the technical field of education interaction, in particular to a teaching interaction mode switching method and system, and the method comprises the following steps: collecting classroom behavior data, classifying answering time consumption and error distribution, dividing teaching task load levels, recording teaching interaction forms, calling data based on a mapping table, and recognizing task delay and errors. Marking unmatched interaction forms, matching teaching structure types, comparing student speech frequencies, screening group cooperation features, judging teaching task interaction stages, and writing in classroom interaction process instructions. According to the method, more flexible and more personalized adaptation between teaching content and student performance is realized by refining question answering time consumption and error frequency of the students, specific difficulties encountered by the students in the learning process are identified and coped with, teaching interaction forms are adjusted, teaching efficiency and learning results are improved, and when the students are in a knowledge mastering lagging period, the students can learn the knowledge conveniently and quickly. A more suitable teaching structure is recommended, and it is ensured that each student can progress in the most suitable learning environment.

The invention discloses an intelligent interaction control method for AI glasses, and relates to the technical field of AI glasses, and the method comprises the following steps: synchronously collecting user input signals and environmental parameters through a multi-source sensor group built in the glasses, the sensor group at least comprising an IMU, a binocular camera, a microphone array and a physiological sensor; carrying out real-time fusion processing on the multi-modal input data by adopting a lightweight neural network to generate an interaction intention feature vector; based on real-time detection results of environmental noise intensity and illumination conditions, dynamically distributing weight coefficients of all interaction modes; generating a hierarchical response instruction according to the weight coefficient and a confidence threshold; and continuously optimizing the personalized interaction strategy of the user through a federal learning framework. According to the AI glasses intelligent interaction control method, through multi-modal weighted fusion, edge AI acceleration and federated learning optimization, the interaction success rate in a complex environment is improved to 93.6%; the end-to-end delay is controlled within 28ms; and a user-defined interaction strategy is supported.

The invention provides an information processing method and device in a game, electronic equipment and a storage medium, and the method comprises the steps that a first game scene and a first virtual character are displayed in a first graphical user interface, and the first virtual character is a player virtual character controlled by first terminal equipment; controlling the first virtual character to move in the first game scene in a first moving mode; in response to a first interaction instruction initiated for a behavior event of the first virtual character in the first game scene, providing an interaction label through a preset release channel to share the behavior event with a user under the preset release channel, the interaction label comprising an interaction entrance for entering a replica game scene, and a user interface for receiving the interaction entrance; a replica game scene is determined based on the behavioral event. Through the method and the device, interaction modes among players can be increased, game scenes are enriched, the game experience of the players is improved, and the utilization rate of service resources is increased.

The embodiment of the invention provides a man-machine interaction method, which comprises the following steps that: in response to an operation of selecting an interaction area on a first interface of electronic equipment by a user, the electronic equipment acquires first interaction content associated with the interaction area; the electronic equipment obtains a first voice instruction; and the electronic equipment executes a first operation according to the first voice instruction and the first interaction content. Through the method, the interaction content can be selected on the display screen of the electronic equipment, convenient voice interaction based on the interaction content between the electronic equipment and the user is realized based on the application related to the interaction content on the electronic equipment, and a man-machine interaction mode convenient to operate is provided for the user.

The invention discloses a multi-modal agent interaction method and system under an agent framework, and belongs to the technical field of artificial intelligence, and the method is implemented by the following steps: multi-modal input: supporting input of multiple modals including texts, voices and images, and automatically identifying and converting into a format which can be processed by the system; mode switching: automatically switching an interaction mode according to an input mode of a user so as to ensure the naturalness and fluency of interaction; multi-modal fusion: carrying out fusion processing on the input information of different modals; efficient processing and response to multi-modal input are achieved based on an intelligent agent framework, and the intelligent agent framework dynamically adjusts an interaction strategy according to input of a user and historical interaction records. According to the method, the interaction modes can be automatically switched according to the input mode of the user, richer and more accurate feedback is provided through the multi-mode fusion technology, meanwhile, personalized adaptation is performed according to different application scenes, the requirements of different users are met, and the user experience and the interaction efficiency are improved.

Embodiments of the invention provide an interaction control method and apparatus, a device and a storage medium. The method comprises the steps of obtaining a plurality of user gesture images triggered by a user for a target interface element in a current application; determining whether the gesture operation of the user is a hand turning operation based on the plurality of user gesture images; and if the gesture operation of the user is the hand turning operation, displaying the target interface element according to a set interaction response logic corresponding to the hand turning operation. By the adoption of the method and device, a new type of air gesture operation, namely the hand turning operation, is defined, and the interaction modes in the man-machine interaction process are increased. And displaying the target interface element based on an interaction response logic corresponding to the hand turning operation set for the target interface element. By adopting the mode, the current display mode can be switched to another display mode to display the target interface element, so that the display efficiency is improved.

The invention belongs to the field of man-machine interaction, and particularly discloses a man-machine interaction method for electronic screen control, which comprises the following steps: acquiring touch track data of a user according to a touch sensor, and performing feature extraction on the touch track data to obtain a touch feature vector; the method comprises the following steps: acquiring gesture action data of a user according to image acquisition equipment, and performing key point detection on the gesture action data to obtain a gesture feature vector; the method comprises the following steps: acquiring voice instruction data of a user according to an audio acquisition device, and performing acoustic feature extraction on the voice instruction data to obtain a voice feature vector; acquiring current environment parameters in real time through an environment detection module, wherein the environment parameters comprise illumination intensity, environment noise level and distance between a user and a screen; the objective of the invention is to solve the problem of insufficient reliability of a man-machine interaction mode in a complex environment in the prior art.

The invention discloses an artificial intelligence interaction method and device, a display device, a storage medium and a product, and relates to the technical field of display device.The method is applied to the display device.The method comprises the steps that in response to an awakening instruction, a preset interaction interface is displayed, and video information is obtained in real time; inputting the video information and the interaction information into preset artificial intelligence software to obtain output information of the artificial intelligence software; and displaying the output information through the interactive interface. The interactive interface is displayed in the screen through the display device, the video information is detected through the display device, after the user inputs the interactive information through the interactive interface, the AI software can comprehensively output the result based on the interactive information input by the user and the video information obtained by the display device, and the output information is obtained; and the video information is fed back to the user through the interaction interface, so that the user can interact with the AI software based on the video information acquired by the current display equipment, and a new interaction mode is introduced for the display equipment.

The invention provides a vehicle-machine interaction method and device, a vehicle, electronic equipment and a storage medium, and relates to the technical field of vehicles, and the main technical scheme comprises the following steps: obtaining a sign language image of vehicle control by a user; identifying the sign language image to obtain corresponding vehicle control information; the corresponding vehicle control is executed according to the vehicle control information, compared with the related technology, the sign language image is recognized, the corresponding vehicle control information is obtained, the corresponding vehicle control is executed, and people with hearing and speaking obstacles can conduct vehicle interaction in a voice interaction mode.

The invention provides a man-machine interaction method and intelligent glasses, which not only can capture interaction information of a user in real time and realize interaction with the user based on the interaction information, but also can recommend an interaction mode matched with the complexity of the content of the current display interface of the intelligent glasses to the user. The man-machine interaction method comprises the following steps: performing complexity evaluation on display content and / or a current application scene of a current display interface of the intelligent glasses to obtain a complexity level of the current display content; and determining an interaction mode corresponding to the complexity level of the current display content according to a preset corresponding relationship between the complexity level and each interaction mode, and recommending the interaction mode to a user.

The invention provides a multi-mode interaction method, system and device based on an intelligent cabin and a vehicle, and relates to the technical field of intelligent cabins, and the method comprises the steps: displaying a main interface comprising a multi-mode interaction instruction setting control, a user authority management control and a real-time feedback display area; and flexible configuration and real-time feedback of the interaction mode of the intelligent cabin are realized. According to the method, the safety and personalized setting of operation authorities of different users are ensured by utilizing cross validation binding of the biological characteristic data and the authority levels. Meanwhile, through fusion processing of multi-mode input signals such as voice, gestures, eye movement and facial expressions, the weight of each signal is dynamically adjusted according to a signal priority rule, an interaction instruction conforming to the intention of the user is generated, and the naturalness and efficiency of interaction are improved. Finally, the execution mechanism is controlled to complete the corresponding operation by performing matching verification on the interaction intention instruction and the user permission level, and the safety and accuracy of the operation are further ensured.

The invention discloses an intelligent interaction system applied to AI glasses, relates to the technical field of man-machine interaction, and is used for solving the problems that resource utilization redundancy is increased and equipment power consumption efficiency is reduced. Fusing to form a head posture variable quantity, and analyzing the dispersion degree of the head posture variable quantity based on an MAD algorithm to judge the complexity of an interaction scene; selecting to execute resource optimization or enhance an interaction response strategy according to the complexity, such as improving the speech recognition accuracy and adapting to a complex sound field; further introducing a proportionality coefficient of illumination intensity, movement speed and noise intensity, constructing a long-short-term memory neural network model to predict interaction complexity, realizing dynamic interaction mode adjustment through a gating mechanism and a regularization method, and judging whether to improve the interaction mode according to prediction output. And the self-adaption and high-reliability interaction capability of the AI glasses in a complex environment is ensured.

The invention discloses a man-machine interaction enhancement method based on intelligent driving. The man-machine interaction enhancement method comprises the following steps: S1, acquiring identity information of a current driver; s2, finding a corresponding target interaction model based on identity information matching; s3, matching and searching a corresponding optimal cockpit state; s4, adjusting the current state of the cockpit; s5, monitoring the behavior state of the driver in real time to obtain monitoring data; the behavior state comprises a face behavior and a head behavior; s6, predicting the fatigue state of the driver based on the monitoring data and a fatigue judgment model; and S7, based on the predicted driver fatigue state, automatically adjusting a human-computer interaction interface and an interaction mode. The man-machine interaction enhancement system comprises a monitoring module, an analysis module, an interaction module and the like. According to the method, the cockpit can be quickly adjusted to the optimal adaptive position to adapt to individual differences, and the man-machine interaction comfort is improved; the accuracy of fatigue judgment can be improved, the man-machine interaction mode and interface can be accurately adjusted, and the trust degree of man-machine interaction is enhanced.

The invention relates to the field of man-machine interaction, and discloses a man-machine interaction method used in an intelligent automobile scene, which comprises the following steps of: firstly, receiving an interaction instruction of a user through a vehicle-mounted input device; vehicle state data including the vehicle speed V, the steering wheel steering angle theta and the transverse acceleration R are collected in real time; dynamically adjusting an interaction mode according to the vehicle state data; then, the interaction instruction is transmitted to a vehicle-mounted processing unit, and the processing unit analyzes the instruction; according to an analysis result, calling a corresponding vehicle-mounted function module to execute operation; and finally, an execution result is fed back to the user through the vehicle-mounted output device. The scene where the vehicle is located can be obtained through analysis according to different vehicle states, so that the interaction mode is dynamically adjusted, and the safety and response efficiency of man-machine interaction in the vehicle driving process are optimized in combination with vehicle sensor data such as the vehicle speed, the steering angle, the transverse acceleration and user behavior characteristics.

The embodiment of the invention provides a media content generation method and device, equipment, a medium and a program product. The method comprises the following steps: displaying a material import control and a generation control on a first page; in response to an interaction operation for the material import control, displaying a second page, the second page comprising candidate materials; and in response to a selection operation for the candidate material, determining a target material, and displaying the target material on the first page, the target material including the target picture set and / or the target video. And in response to an interaction operation for the generation control, generating a target audio according to the target material, and generating a target media content according to the target audio and the target material. According to the technical scheme provided by the embodiment of the invention, the target audio is generated through the target material, and the target media content is generated according to the target audio and the target material, so that the media content is generated through the video or multiple pictures, the interaction mode of media content creation is effectively enriched, and the difficulty of media content creation is reduced.

The invention discloses an interaction method and device, computer equipment and a storage medium. The method specifically comprises the following steps: in a session process, receiving a response voice message of interaction indication information sent by a target virtual object based on a target tone; wherein the target timbre comprises a timbre obtained by executing a timbre selection operation based on a recommended timbre provided by the interactive application or a timbre obtained by executing a timbre creation operation based on a timbre creation entrance provided by the interactive application. In the application, the target virtual object can send the response voice message of the interaction indication information based on the target tone, so that the highly anthropomorphic design of the target virtual object is realized, and the interaction mode between the user and the target virtual object is more vivid and more interesting.