4045 results about "Interaction mode" patented technology

The present invention discloses a remote operation and maintenance control method and system in a dual interactive mode, which relates to the field of remote operation and maintenance control technology, including: establishing a remote two-way communication connection, collecting substation data for pre-processing; judging the equipment status to determine the execution strategy; comparing the result with the preset standard configuration according to the result, triggering the corresponding rollback or repair operation; analyzing the abnormal state of the equipment, generating a fault diagnosis report; establishing an early warning mechanism based on the diagnosis report, and dynamically adjusting the early warning response by classification. The present invention adopts a multi-level control mechanism to dynamically adjust the execution strategy during the task execution process. When multiple tasks are concurrent, resources are automatically allocated through task scheduling and priority control. Effectively improve the response speed and processing efficiency of the operation and maintenance system. After each task or fault processing, the system automatically archives the operation results to the log database, and adjusts future strategies according to the task execution effect.

The invention discloses a conference enhancement method and device, equipment and a storage medium, and relates to the technical field of computers, and the method comprises the steps: preprocessing the multi-modal original information of a conference through a data preprocessing component, carrying out the multi-modal data fusion and time alignment processing based on a preprocessing result, and determining a target data packet; analyzing the state of a participant through a participant analysis component and the target data packet, determining a target model for analyzing the behavior and state of the participant, and determining the context of a speaking party of the conference based on the target model; structural representation of the conference content is carried out through the conference content processing component and the speaking party context; analyzing a team interaction mode and a decision forming process of the conference by adopting an overall perspective through a decision analysis component, a target model, the structured content and a corresponding argument analysis result; and determining whether conference intervention is performed or not according to the analysis result through an intervention output component, and if so, determining and outputting a target intervention suggestion. The effectiveness and the quality of the conference result are improved.

The invention relates to intelligent glasses, an interaction method and device of the intelligent glasses, electronic equipment and a medium. The sensing module, the decision making module, the execution module and the feedback module are arranged on the glasses body so as to sense multi-dimensional environment data of a surrounding environment and current behavior data of a user in a preset intelligent interaction mode, predict a behavior intention of the user, track a first behavior change of the user and a first environment change of the surrounding environment and send the first behavior change to the feedback module; and determining an instruction chain meeting a preset execution condition, executing the instruction chain to track a second behavior change of the user based on the instruction chain, and optimizing a generation algorithm of the instruction chain based on the second behavior change. Therefore, the technical problems that in the related technology, the intelligent wearable device understands the environment in a one-sided mode, interaction is passive, the intelligent wearable device can only operate according to a set rule, the intelligent level is insufficient, convenience cannot be provided for a user, and normal use of the user is easily affected are solved.

The invention provides an interaction method and device based on agent cooperation, an agent and a storage medium, belongs to the technical field of artificial intelligence, particularly relates to the technical fields of deep learning, large models, agents, AIGC and the like, and is applied to application scenes such as wisdom education, video production, wisdom medical treatment and the like. The intelligent agent cooperation-based interaction method comprises the following steps: performing intention understanding on initial input information for a target object to obtain an initial intention understanding result; performing interaction mode demand detection on the initial intention understanding result by using a first agent to obtain an interaction mode demand attribute; an interaction element matched with the interaction mode demand attribute is called to interact with the target object, interaction information representing the demand intention of the target object is obtained, and the interaction element is used for responding to the interaction behavior; and controlling the second agent to execute the target task based on the interaction information to obtain an execution result, and pushing the execution result to the target object.

The invention belongs to the technical field of human-computer interaction, and discloses a digital twin WEB application air gesture interaction method and system. Comprising the following steps: collecting a real-time video stream of a camera of user side equipment, and preprocessing the real-time video stream; x hand region frames are obtained; inputting the X hand region frames into a preset hand key point detection model based on a generative adversarial network to obtain hand key point coordinate data; acquiring a hand skeleton model based on the hand key point coordinate data; acquiring a joint angle and a hand motion track according to the hand skeleton model; mapping the hand skeleton model into a digital twin virtual scene, presetting n gesture instruction modes in the digital twin virtual scene, and matching the hand skeleton model, the joint angle and the hand motion track with the gesture instruction modes; personalized and extensible gesture interaction capability is provided, and man-machine interaction modes are enriched.

The invention relates to the technical field of education interaction, in particular to a teaching interaction mode switching method and system, and the method comprises the following steps: collecting classroom behavior data, classifying answering time consumption and error distribution, dividing teaching task load levels, recording teaching interaction forms, calling data based on a mapping table, and recognizing task delay and errors. Marking unmatched interaction forms, matching teaching structure types, comparing student speech frequencies, screening group cooperation features, judging teaching task interaction stages, and writing in classroom interaction process instructions. According to the method, more flexible and more personalized adaptation between teaching content and student performance is realized by refining question answering time consumption and error frequency of the students, specific difficulties encountered by the students in the learning process are identified and coped with, teaching interaction forms are adjusted, teaching efficiency and learning results are improved, and when the students are in a knowledge mastering lagging period, the students can learn the knowledge conveniently and quickly. A more suitable teaching structure is recommended, and it is ensured that each student can progress in the most suitable learning environment.

The invention discloses an intelligent interaction control method for AI glasses, and relates to the technical field of AI glasses, and the method comprises the following steps: synchronously collecting user input signals and environmental parameters through a multi-source sensor group built in the glasses, the sensor group at least comprising an IMU, a binocular camera, a microphone array and a physiological sensor; carrying out real-time fusion processing on the multi-modal input data by adopting a lightweight neural network to generate an interaction intention feature vector; based on real-time detection results of environmental noise intensity and illumination conditions, dynamically distributing weight coefficients of all interaction modes; generating a hierarchical response instruction according to the weight coefficient and a confidence threshold; and continuously optimizing the personalized interaction strategy of the user through a federal learning framework. According to the AI glasses intelligent interaction control method, through multi-modal weighted fusion, edge AI acceleration and federated learning optimization, the interaction success rate in a complex environment is improved to 93.6%; the end-to-end delay is controlled within 28ms; and a user-defined interaction strategy is supported.

The embodiment of the invention provides a man-machine interaction method, which comprises the following steps that: in response to an operation of selecting an interaction area on a first interface of electronic equipment by a user, the electronic equipment acquires first interaction content associated with the interaction area; the electronic equipment obtains a first voice instruction; and the electronic equipment executes a first operation according to the first voice instruction and the first interaction content. Through the method, the interaction content can be selected on the display screen of the electronic equipment, convenient voice interaction based on the interaction content between the electronic equipment and the user is realized based on the application related to the interaction content on the electronic equipment, and a man-machine interaction mode convenient to operate is provided for the user.

The invention discloses a multi-modal agent interaction method and system under an agent framework, and belongs to the technical field of artificial intelligence, and the method is implemented by the following steps: multi-modal input: supporting input of multiple modals including texts, voices and images, and automatically identifying and converting into a format which can be processed by the system; mode switching: automatically switching an interaction mode according to an input mode of a user so as to ensure the naturalness and fluency of interaction; multi-modal fusion: carrying out fusion processing on the input information of different modals; efficient processing and response to multi-modal input are achieved based on an intelligent agent framework, and the intelligent agent framework dynamically adjusts an interaction strategy according to input of a user and historical interaction records. According to the method, the interaction modes can be automatically switched according to the input mode of the user, richer and more accurate feedback is provided through the multi-mode fusion technology, meanwhile, personalized adaptation is performed according to different application scenes, the requirements of different users are met, and the user experience and the interaction efficiency are improved.

The invention belongs to the field of man-machine interaction, and particularly discloses a man-machine interaction method for electronic screen control, which comprises the following steps: acquiring touch track data of a user according to a touch sensor, and performing feature extraction on the touch track data to obtain a touch feature vector; the method comprises the following steps: acquiring gesture action data of a user according to image acquisition equipment, and performing key point detection on the gesture action data to obtain a gesture feature vector; the method comprises the following steps: acquiring voice instruction data of a user according to an audio acquisition device, and performing acoustic feature extraction on the voice instruction data to obtain a voice feature vector; acquiring current environment parameters in real time through an environment detection module, wherein the environment parameters comprise illumination intensity, environment noise level and distance between a user and a screen; the objective of the invention is to solve the problem of insufficient reliability of a man-machine interaction mode in a complex environment in the prior art.

The invention discloses an artificial intelligence interaction method and device, a display device, a storage medium and a product, and relates to the technical field of display device.The method is applied to the display device.The method comprises the steps that in response to an awakening instruction, a preset interaction interface is displayed, and video information is obtained in real time; inputting the video information and the interaction information into preset artificial intelligence software to obtain output information of the artificial intelligence software; and displaying the output information through the interactive interface. The interactive interface is displayed in the screen through the display device, the video information is detected through the display device, after the user inputs the interactive information through the interactive interface, the AI software can comprehensively output the result based on the interactive information input by the user and the video information obtained by the display device, and the output information is obtained; and the video information is fed back to the user through the interaction interface, so that the user can interact with the AI software based on the video information acquired by the current display equipment, and a new interaction mode is introduced for the display equipment.

The invention provides a multi-mode interaction method, system and device based on an intelligent cabin and a vehicle, and relates to the technical field of intelligent cabins, and the method comprises the steps: displaying a main interface comprising a multi-mode interaction instruction setting control, a user authority management control and a real-time feedback display area; and flexible configuration and real-time feedback of the interaction mode of the intelligent cabin are realized. According to the method, the safety and personalized setting of operation authorities of different users are ensured by utilizing cross validation binding of the biological characteristic data and the authority levels. Meanwhile, through fusion processing of multi-mode input signals such as voice, gestures, eye movement and facial expressions, the weight of each signal is dynamically adjusted according to a signal priority rule, an interaction instruction conforming to the intention of the user is generated, and the naturalness and efficiency of interaction are improved. Finally, the execution mechanism is controlled to complete the corresponding operation by performing matching verification on the interaction intention instruction and the user permission level, and the safety and accuracy of the operation are further ensured.

The invention discloses an intelligent interaction system applied to AI glasses, relates to the technical field of man-machine interaction, and is used for solving the problems that resource utilization redundancy is increased and equipment power consumption efficiency is reduced. Fusing to form a head posture variable quantity, and analyzing the dispersion degree of the head posture variable quantity based on an MAD algorithm to judge the complexity of an interaction scene; selecting to execute resource optimization or enhance an interaction response strategy according to the complexity, such as improving the speech recognition accuracy and adapting to a complex sound field; further introducing a proportionality coefficient of illumination intensity, movement speed and noise intensity, constructing a long-short-term memory neural network model to predict interaction complexity, realizing dynamic interaction mode adjustment through a gating mechanism and a regularization method, and judging whether to improve the interaction mode according to prediction output. And the self-adaption and high-reliability interaction capability of the AI glasses in a complex environment is ensured.

The invention relates to the field of man-machine interaction, and discloses a man-machine interaction method used in an intelligent automobile scene, which comprises the following steps of: firstly, receiving an interaction instruction of a user through a vehicle-mounted input device; vehicle state data including the vehicle speed V, the steering wheel steering angle theta and the transverse acceleration R are collected in real time; dynamically adjusting an interaction mode according to the vehicle state data; then, the interaction instruction is transmitted to a vehicle-mounted processing unit, and the processing unit analyzes the instruction; according to an analysis result, calling a corresponding vehicle-mounted function module to execute operation; and finally, an execution result is fed back to the user through the vehicle-mounted output device. The scene where the vehicle is located can be obtained through analysis according to different vehicle states, so that the interaction mode is dynamically adjusted, and the safety and response efficiency of man-machine interaction in the vehicle driving process are optimized in combination with vehicle sensor data such as the vehicle speed, the steering angle, the transverse acceleration and user behavior characteristics.

The invention discloses a novel data transmission interaction mode, which belongs to the technical field of data transmission interaction, and comprises the following steps of: performing dual authentication through quantum key distribution and biological characteristics, monitoring and analyzing a network state in real time through AI after the dual authentication, dynamically selecting an optimal transmission path and distributing a load. By combining dynamic weight adjustment and path priority scoring, path optimization which is more intelligent than that of a traditional dynamic routing protocol is realized, an optimal path can be more accurately selected through comprehensive scoring and correlation interference resistance coefficients, and a dynamic load distribution formula ensures flow balance, maximizes the network utilization rate, reduces congestion and delay and improves the routing efficiency. The path correlation suppression mechanism can avoid multi-path simultaneous congestion, improves the overall reliability of the system, and is suitable for a complex network environment.

The invention discloses an exhibition hall interactive display method and system supporting artificial intelligence recognition, and relates to the technical field of data processing. Comprising the steps that interaction information of visitors is obtained, a matched artificial intelligence interaction method is opened according to the type of the interaction information, the interaction information is matched with the corresponding visitors, and based on a matching result, an exhibition hall transmits content information of exhibits to the visitors according to the matched artificial intelligence interaction method. The content information is displayed in different artificial intelligence interaction methods in different forms, and the exhibition hall executes a corresponding judgment rule based on the interaction degree of the visitor and the content information. The exhibition hall provides different exhibit information transmission for the visitors in different interaction modes according to the types of the visitors, in addition, by obtaining the interaction information of the visitors, the exhibition hall can intelligently select the proper interaction mode, and the visitors can obtain richer and deeper exhibit information in the interaction process.

The invention discloses a cloud mobile phone multi-mode interaction method and related equipment, and relates to the technical field of cloud mobile phones, and the method comprises the steps: obtaining a multi-mode interaction signal inputted by a user; generating a unified interaction instruction based on the multi-mode interaction signal, and determining a current interaction mode according to the unified interaction instruction; carrying out computing resource allocation on the cloud mobile phone based on the current interaction mode to obtain a resource allocation scheme; predicting a user behavior through a preset deep learning model based on the multi-modal interaction signal and user historical interaction data to obtain a resource preloading instruction; and loading the target resource based on the resource preloading instruction, and generating a corresponding interaction response result according to the resource allocation scheme. Through multi-mode interaction fusion, interaction mode recognition and intelligent resource scheduling, comprehensive optimization of the cloud mobile phone system in the aspects of interaction naturalness, response efficiency and resource utilization rate is realized, and the smoothness of user operation can be improved.

The invention relates to an emotion pacifying method for a vehicle user, a controller, a vehicle, a medium and a product. The method comprises the following steps: displaying a 3D virtual object in the vehicle; identifying emotion information of a vehicle user, wherein the vehicle user comprises a driver of the vehicle; and controlling the 3D virtual object according to the emotion information so as to pacify the emotion of the vehicle user. Since the vehicle user comprises the driver of the vehicle, emotion pacification can be performed on the driver through the displayed 3D virtual object, and the emotion of the driver returns to the emotion interval suitable for driving, so that the driving risk caused by the emotion is reduced, and traffic accidents caused by the emotion problem of the driver are reduced. Besides, the displayed 3D virtual object is controlled to pacify the mood of the vehicle user, so that the man-machine interaction mode is more natural and visual, the mood pacifying effect on the driver is improved, and traffic accidents caused by the mood problem of the driver are further reduced.

The embodiment of the invention provides a man-machine interaction method based on an artificial intelligence system and a related system, and relates to the technical field of artificial intelligence, and the method comprises the steps: responding to a received interaction request, determining a corresponding interaction mode, responding to a determined first interaction mode, and feeding back a request result for the interaction request. Wherein before the request result for the interaction request is fed back, the corresponding gasket content is generated and fed back to maintain the continuity of the interaction, and the request result for the interaction request is directly fed back under the condition that the gasket content is not generated in response to the determined second interaction mode, so that the man-machine interaction performance is improved.

The invention relates to a virtual reality data interaction method and device based on AR / VR / MR glasses and a medium, and the method comprises the steps: obtaining multi-modal interaction data collected by wearable equipment in a use process based on a data collection device corresponding to the wearable equipment, carrying out the recognition of the multi-modal interaction data, and carrying out the recognition of the multi-modal interaction data; according to the probability data distribution information, the interaction mode weight information and the interaction feature function, performing data fusion on the multi-modal interaction data, generating interaction instruction data of the wearable device, according to the multi-modal interaction data, constructing a virtual reality space, and generating a corresponding virtual display interface; generating an interface adjustment instruction under the virtual display interface according to the interaction instruction data, adjusting the virtual display interface based on the interface adjustment instruction, generating a target virtual display interface, and displaying the target virtual display interface through the wearable device. Therefore, data interaction based on the wearable device is realized.

The present application relates to a construction method of an intelligent interaction service system and a website intelligent interaction method and device, which involve, through obtaining a user identity, determining historical multimodal interaction data and a user type that are corresponding to the user identity; obtaining first modal interaction data sent by a user, and determining a user interaction mode according to the historical multimodal interaction data and the first modal interaction data; performing an intent recognition analysis on current interaction data according to an intent recognition component to obtain a user intent label, and transforming the user intent label into a user intent vector; performing a retrieve and match on the user intent vector based on a vector database group to obtain user interaction result information, and sending the user interaction result information corresponding to the user type to a human-computer interaction interface in the user interaction mode.

The invention discloses automatic boundary creation and relocation. Aspects of the present disclosure relate to instant boundary creation for virtual reality (VR) experiences. An artificial reality (XR) system may scan and collect visual feature data of a user's real-world environment in the background while rendering an augmented reality (AR) environment or a mixed reality (MR) environment. When the XR system detects an intent to enter a VR mode (e.g., by launching a VR application), the XR system may generate a recommendation to a boundary of a real-world space, which may include a type of interaction mode (e.g., a movable mode or a stationary mode). Based on the user's response to the recommendation, the XR system may prompt the user to further scan the real-world space and / or manually adjust the boundaries while continuing to scan and collect visual feature data in the background. Alternatively or additionally, some embodiments may automatically relocate the real-world space based on the generated boundaries.

The invention relates to the technical field of vehicles, in particular to a multi-mode out-of-vehicle interaction method and related equipment based on environment self-adaptation, and the method comprises the steps: obtaining perception information in real time through an environment perception module, the perception information comprising environment conditions, interaction object information and scene semantic understanding information; based on the perception information, utilizing an adaptive decision engine to dynamically analyze an optimized interaction mode and parameters, and generating interaction content; outputting interaction information according to the interaction content generated by the self-adaptive decision engine through a multi-modal output module; the interaction strategy is dynamically adjusted by sensing the environment state in real time, and the safety and the interaction efficiency can be improved.

The invention discloses a diabetes cognitive impairment method based on metabonomics analysis and prediction, and relates to the technical field of biological information, and the method comprises the following steps: S1, obtaining metabonomics data and immunomics data from a peripheral blood sample of a diabetic patient, extracting relevant time sequence data aiming at glucose metabolism, and calculating the glucose metabolism related time sequence data; processing the sequence data by adopting a time sequence analysis algorithm to obtain time sequence change characteristics; s2, constructing a cross-omics interaction network according to time sequence change characteristics, integrating an incidence relation between metabolite concentration and immune factor expression, and setting a dynamic interaction mode; according to the diabetes cognitive impairment method based on metabonomics analysis and prediction, through multi-omics data integration and dynamic network analysis, the precision and reliability of diabetes cognitive impairment mechanism analysis are remarkably improved, and a theoretical basis is provided for precise intervention.

The invention belongs to the technical field of equipment interaction control, and provides an interaction control method, electronic atomization equipment, electronic equipment and a program product.The method comprises the steps that after near-field induction connection between the electronic atomization equipment and any other electronic equipment is established, interaction signals output by the other electronic equipment are obtained; analyzing the interaction signal to obtain interaction instruction information; logic judgment is conducted according to the local equipment information of the electronic atomization equipment and the interaction instruction information, interaction operation information is obtained, and the interaction operation information comprises at least one of an interaction scene, an interaction mode, an interaction state, interaction duration and interaction prompt; and displaying the interactive operation information in a dynamic effect image style on a human-computer interaction interface of the electronic atomization equipment. The technical problem that interaction between electronic atomization devices or between the electronic atomization device and other devices cannot be achieved in the prior art is solved.

The present disclosure provides an extended reality interaction method and apparatus, an electronic device and a storage medium, the extended reality interaction method includes: acquiring action data of a user in an extended reality scene; determining an action type of the user according to the action data; and triggering a corresponding interaction mode according to the action type, the corresponding interaction mode comprising a handle tracking mode and a bare hand tracking mode, according to the method provided by the present disclosure, an action type of the user is recognized and then a target interaction mode according to the action type is triggered for computing processing, without the need to manually set the interaction mode in advance.

1. The name of the design product: custom window of graphical user interface for customizing display layout of electronic device. 2. The use of the design product: electronic device. 3. The design points of the design product: in graphical user interface. 4. The picture or photo that best indicates the design points: design 1 front view. 5. Design 1 is designated as the basic design. 6. The use of the graphical user interface: enables the user to customize the display layout of data received from one or more inputs connected to the medical console. 7. The human-computer interaction mode of the graphical user interface: interact through the touch screen of the medical console, when the number of screens in the upper right corner of the graphical user interface is selected as "1", the display layout shown in each design front view appears; when the number of screens in the upper right corner of the graphical user interface is selected as "2", the display layout shown in each design change state diagram 1 appears; when the number of screens in the upper right corner of the graphical user interface is selected as "3", the display layout shown in each design change state diagram 2 appears; when the number of screens in the upper right corner of the graphical user interface is selected as "4", the display layout shown in each design change state diagram 3 appears. 8. Other circumstances that need to be explained: the dashed line does not constitute part of the claimed design.

The embodiment of the invention provides an information interaction method and device, electronic equipment, a storage medium and a program product. The method comprises the following steps: receiving a resource configuration operation, and obtaining a media resource configured by a first user; determining interactive content according to the media resource, wherein the interactive content is configured to enable a second user to perform content interaction operation based on the interactive content and generate interaction feedback content; and sending the interactive content on a session interface with a second user. According to the technical scheme provided by the embodiment of the invention, flexible configuration of the media resources through simple interaction operation is supported, differentiated interaction requirements of different users are met, presentation forms of the media resources are enriched, interaction attributes of the media resources are improved, interaction modes between the second user and the first user are increased, and user experience is improved. Visual presentation of the interactive content is realized, information interaction forms are enriched, and information interaction experience is remarkably improved.

The invention provides an agent collaborative interaction method and system and electronic equipment. The agent collaborative interaction method comprises the following steps: registering agent capability information to a network registration function network element; sending a first service retrieval request to the network registration function network element according to the current task, and receiving a first retrieval result returned by the network registration function network element; when the first retrieval result comprises at least one service party agent, determining state information of the service party agent according to the first retrieval result, and selecting the service party agent to send a service negotiation request; when it is determined that a service negotiation response returned by the service party agent based on the service negotiation request is received, sending a co-processing data packet corresponding to the current task to the service party agent through an interaction mode corresponding to the service negotiation response; and receiving a co-processing result corresponding to the co-processing data packet returned by the service agent, and processing the current task according to the co-processing result. According to the embodiment of the invention, the agent interaction efficiency can be improved.

The invention relates to a sentry mode interaction method and device and electronic equipment, and belongs to the technical field of intelligent driving, and the interaction method comprises the steps: obtaining a visual danger value, a radar alarm value and a vehicle body vibration value, obtaining a risk value according to the visual danger value, the radar alarm value and the vehicle body vibration value, obtaining a risk level according to the risk value, and obtaining a risk result; according to the risk level, the interaction mode is determined, the interaction mode comprises low-risk interaction, medium-risk interaction and high-risk interaction, the interaction mode is changed from low risk to high risk, the corresponding reminding level is progressive layer by layer, and dangerous events can be effectively prevented from continuing to spread.