Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

8553 results about "Interaction method" patented technology

Knowledge fusion multi-modal interaction method and apparatus based on improved alignment method

A knowledge fusion multi-modal interaction method and apparatus based on an improved alignment method. The method comprises: acquiring multi-modal data (S101); constructing a query transformation model (S102); on the basis of a multi-stream feature extraction method, performing improved processing on a vision transformer to obtain a multi-scale vision transformer (S103); on the basis of a joint text method, training the multi-scale vision transformer to obtain a target vision transformer (S104); freezing the target vision transformer, and on the basis of the target vision transformer, performing vision-text alignment training processing on the query transformation model to obtain a target query transformation model (S105); connecting the target query transformation model to a language model to obtain a knowledge fusion multi-modal interaction model (S106); and inputting the multi-modal data into the knowledge fusion multi-modal interaction model to obtain an interaction result (S107). In the embodiments of the present invention, the knowledge fusion multi-modal interaction model aligns visual representation with text representation, so that the mutual information between the visual representation and the text representation can be maximized, and the present invention can be widely applied to the technical field of artificial intelligence.
Owner:SUN YAT SEN UNIV +1

Intelligent multi-mode virtual digital human interaction system based on AI language large model, interaction method and application

The invention discloses an intelligent multi-modal virtual digital human interaction system based on an AI language large model. The system comprises a high-authenticity face generation module; the high-authenticity face generation module uses an AdaAN network, based on adaptive feature fusion and voice driving and time sequence modeling of voice features, feature information related to voice is extracted, the extracted voice features are processed through a deep neural network, it is ensured that the voice and facial expressions are highly aligned in time and space, and the face recognition accuracy is improved. Collecting a bio-electricity signal, mapping the signal to facial muscle movement, generating a final facial expression, and interacting with a user; the system further comprises an intelligent interaction module, a training optimization and efficient generation module, an efficient integration module, a multi-modal data acquisition module, an AI large model core processing module, a digital human image generation and driving module, an interaction scene adaptation module and a feedback optimization module. The invention further discloses a multi-mode digital human interaction method which has wide application value.
Owner:EAST CHINA NORMAL UNIV

Digital human real-time interaction system and digital human real-time interaction method

The invention discloses a digital human real-time interaction system and method. The interaction system comprises terminal equipment and a cloud server. The terminal device receives voice input by a user and transmits the voice to the cloud server. The cloud server comprises a video acquisition and processing module, an intelligent question and answer and voice generation module, an audio processing module and an image rendering module. A video capture and processing module captures original video data indicative of an object of a digital figure and generates successive image frames. The intelligent question and answer and voice generation module converts the voice into a text; performing semantic analysis on the text, understanding the intention of the user, and generating a corresponding reply text; the reply text is also converted into a reply voice. The audio processing module processes the reply voice and the continuous image frames to generate first video data. And the image rendering module fuses the first video data with the virtual background, and performs real-time processing on the fused video to generate a response video. And the terminal equipment outputs the response video.
Owner:BEIJING HONGLIAN 95 INFORMATION IND CO LTD +1

Building engineering interaction method and system based on BIM model, and medium

The invention relates to the technical field of building data interaction, in particular to a building engineering interaction method and system based on a BIM model and a medium. The method comprises the following steps: collecting construction site environment parameters and structure response data by using a distributed sensor network; preprocessing the data by an edge computing node; generating standardized environment data and key structure indexes; comparing environment threshold values to identify abnormal events; the method comprises the following steps of: displaying spatial positioning and risk levels through a visual interface, receiving a regulation and control instruction input by a user, dynamically adjusting construction parameters of a BIM model, generating an optimized construction progress scheme, comparing the optimized scheme with an original model to identify a construction conflict area, and generating a conflict resolution report. Through the advanced monitoring technology and construction management technology, the response speed and decision-making efficiency of the building engineering project are improved, and the safety guarantee and resource utilization efficiency in the construction process are improved.
Owner:SHENZHEN GUOJIAN ARCHITECTURAL DECORATION ENG CO LTD

Multi-modal intelligent robot system and interaction method

The invention relates to a multi-modal intelligent robot system and an interaction method, and belongs to the technical field of robot digital data processing, and the method comprises the following steps: S1, multi-modal input collection; s2, carrying out multi-modal input preprocessing; s3, performing multi-modal information fusion, inputting the information into a pre-trained multi-modal feature fusion model, and performing feature fusion on each modal feature through a quantitative feature data fusion mechanism to obtain a user interaction intention vector and a user emotional state vector; s4, interaction response generation: matching a preset interaction response strategy library based on the user interaction intention vector to obtain basic response content, and performing emotion adaptation adjustment on the basic response content in combination with the user emotion state vector to generate multi-modal response content including text information, voice information and action information; s5, interactive feedback is executed; the method has the beneficial effects that the robot is fused with multi-modal information through the basic response content and the user emotional state vector, and interaction is dynamically optimized.
Owner:四川参盘供应链科技有限公司

Government affair digital human dynamic interaction method and system based on multi-modal large model

The embodiment of the invention provides a government affair digital human dynamic interaction method and system based on a multi-mode large model. The method is applied to the technical field of government affair intelligent services, and comprises the following steps: acquiring a policy announcement text, and performing cleaning and structuring processing to obtain a structured policy data set; and extracting old and new policy data, performing difference comparison, marking key change fields, and generating policy change data. Abstracting and element extraction are carried out on the change data to form structured semantic fragments, and the structured semantic fragments are incrementally embedded into the policy knowledge graph. And generating a question and answer pair sample based on the updated knowledge graph, and carrying out self-supervised fine tuning training on the multi-modal large model. A user inputs multi-modal data, and the model generates a government affair response and feeds back the government affair response. According to the scheme, the multi-modal large model can continuously keep the latest policy knowledge; the model is enabled to generate accurate government affair response with consistent context while understanding multi-modal input such as text, voice and image, and timeliness, accuracy and interactive experience of policy interpretation are improved.
Owner:JIANGSU FENGYUN TECH SERVICE CO LTD

Vehicle ad hoc network based on intelligent network connection vehicle WiFi and V2V interaction method

The invention relates to the technical field of wireless communication networks, in particular to a vehicle ad hoc network based on intelligent networked vehicle WiFi and a V2V interaction method, a vehicle motion state and network load data are acquired through a vehicle-mounted sensor, AP / STA modes are dynamically switched by combining a deep Q network (DQN) model and an epsilon-greedy strategy, and an adaptive topological structure is constructed. And expanding OLSR protocol message embedding path delay fields, calculating and optimizing multi-hop routing selection in combination with pheromone gradient, and realizing message priority classification and differential privacy protection through a federated learning model. And dynamically adjusting an AP / STA proportion threshold based on a particle swarm algorithm, and triggering node role reconfiguration to balance network load. According to the method, the existing WiFi hardware is reused, the deployment cost is reduced, cross-layer routing optimization and a distributed decision mechanism are combined, and the network real-time performance, the expansibility and the group cooperation capability in a dynamic scene are improved.
Owner:BEIJING YUNCHI FUTURE TECH CO LTD

Dynamic interaction method based on multi-modal dynamic fusion large model and intelligent agent collaboration

The invention discloses a dynamic interaction method based on cooperation of a multi-modal dynamic fusion large model and an intelligent agent. The method comprises the following steps: performing feature extraction on user voice information to obtain a voice coding vector, a text semantic vector and an emotion feature vector; performing dynamic weight feature fusion on the voice coding vector, the text semantic vector and the emotion feature vector through a multi-modal dynamic fusion large model to obtain a fusion feature vector; inputting the fusion feature vector into an intention-scene coupling network, and identifying to obtain a user intention label; and identifying according to the user behavior log to obtain a user portrait tag, inputting the user intention tag and the user portrait tag into an autonomous decision-making agent, generating a target decision-making action through a lightweight policy network, and then interacting with the user according to the target decision-making action. The intelligent interaction efficiency and accuracy of the customer service system are improved, the interaction experience of the user is also improved, and the method can be widely applied to the technical field of artificial intelligence.
Owner:E SURFING IOT CO LTD

Content publishing method, content interaction method, system, device, equipment, storage medium and program product

PendingCN119094863Aeasy accessConducive to lightweight operationsSelective content distributionInteraction deviceEngineering
The invention provides a content publishing method, a content interaction method, a content interaction system, a content interaction device, equipment, a storage medium and a program product. The content publishing method comprises the following steps: in response to a triggering operation on a shooting control in a shooting interface, generating target content; displaying an editing interface comprising a publishing control for publishing the target content and a label adding control; in response to a triggering operation on the tag adding control, adding a content tag to the target content; and in response to a trigger operation on the release control, releasing the target content including the content tag. The content interaction method comprises the steps of displaying a content display interface comprising a second position identification control, and displaying associated published content or a map interface in response to a triggering operation on the second position identification control. According to the method provided by the invention, the content including the content label can be published at the publishing end, lightweight publishing is realized, the publishing efficiency is improved, the associated publishing content or the map interface is displayed at the display end, the limitation of a content interaction mode is avoided, and the use experience is improved.
Owner:SHUXING TECH (BEIJING) CO LTD

Interaction method and system based on deep learning

The invention provides an interaction method and system based on deep learning, and relates to the technical field of computer vision, and the method comprises the steps: collecting a continuous image sequence, extracting feature points, calculating the position variation and gradient variation of the feature points, constructing a two-dimensional feature vector, and carrying out the clustering through a Gaussian mixture model, thereby obtaining a stable feature class. And weighting the feature points based on a feature weight distribution function, calculating feature similarity and constructing a matching relationship. And calculating a dynamic parallax threshold in combination with the vehicle movement speed, screening reliable matching feature pairs, and solving pose transformation parameters. A feature change sequence is extracted through a feature detection network, a motion feature mapping matrix is constructed, and a compensation depth map is generated in combination with depth information. And scene reconstruction is carried out based on the compensation depth map and the pose transformation parameters, the scene confidence score is calculated, the pose parameters are calibrated, a high-precision pose parameter sequence is obtained, and the robustness of feature matching and the accuracy of pose estimation can be improved.
Owner:ZHONGTIAN ZHILING (BEIJING) TECH CO LTD

Large language model intelligent interaction method and system with memory management capability

The invention provides a large language model intelligent interaction method and system with memory management capability in the technical field of artificial intelligence. The method comprises the following steps: S1, creating a work memory module, a long-term memory module, a memory fusion module and an intelligent interaction module; s2, acquiring external knowledge and integrating the external knowledge into a long-term memory module; s3, the intelligent interaction module obtains an intention sequence based on a user query statement and sends the intention sequence to a work memory module; s4, the memory fusion module retrieves context information from the long-term memory module based on the user query statement and sends the context information to the working memory module; s5, the work memory module constructs a work memory sending intelligent interaction module based on the intention sequence, the context information and the system instruction; s6, the intelligent interaction module outputs a query result based on the working memory; s7, a memory fusion module extracts semantic memory and plot memory from user query statements and query results and stores the semantic memory and plot memory in a long-term memory module. The method has the advantage that the man-machine interaction performance is greatly improved.
Owner:FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD

Video generation method and interaction method based on digital human, and device, storage medium and program product

Provided in the embodiments of the present application are a video generation method and interaction method based on a digital human, and a device, a storage medium and a program product. In the embodiments of the present application, text-to-speech processing is performed on the basis of voice features of a user and an emotion label, speech-to-expression processing is performed on the basis of a mapping relationship between the voice features of the user and expression coefficients, and a digital human model is rendered on the basis of speech signals and the expression coefficients, so as to obtain video data of the digital human model. Thus, voice features of a user are accurately simulated, so as to ensure that a speech output of a digital human sounds natural and is also highly personalized, thereby realizing personalized driving of the digital human, and improving the realism of the digital human in terms of voice and dynamic images. Thus, the user experience is improved, and the interactivity of the digital human and the authenticity and immersion are enhanced.
Owner:TAOBAO CHINA SOFTWARE

Virtual-real fusion interaction method and system based on digital twinning

The invention discloses a virtual-real fusion interaction method and system based on digital twinning, particularly relates to the technical field of digital twinning and virtual-real interaction, and is used for solving the problem that semantic drift is difficult to monitor in a virtual-real fusion interaction process in the prior art. The method comprises the following steps: constructing a digital twin model consistent with a current state of a physical entity in a virtual space; accurate mapping of user operation and physical entities is realized through a multi-modal interaction algorithm; analyzing the energy change of an abnormal propagation path by using a multi-scale dissipation power network, and dividing the possibility of semantic drift into global or locality; when the semantic drift is likely to be locality, the semantic entropy value change degree caused by user operation is evaluated in combination with the maximum entropy principle, the change of the semantic graph topological structure is analyzed through the graph matching deformation network, the potential influence of the semantic drift is comprehensively evaluated, the accuracy and stability of virtual-real interaction are effectively improved, and the user experience is improved. And a technical support is provided for semantic drift monitoring and processing in a complex interaction scene.
Owner:YUNTIAN HENGZHI (QINGDAO) TECH CO LTD

Multi-mode perception and interaction method and device in personal environment

The invention relates to the technical field of artificial intelligence and robots. According to the multi-modal perception and interaction method and device in the body environment, the method comprises the steps that environment entropy estimation processing is carried out through a dynamic weighting multi-modal feature fusion algorithm, and an environment entropy value representing the disorder degree of the environment is generated; performing cross-modal alignment processing to generate a fusion environment understanding map; performing dynamic decision processing through the task adaptive reinforcement learning model to generate an interaction instruction; driving an execution mechanism to execute the interaction action to obtain an execution result of the interaction action; carrying out dynamic adjustment processing on the weight of the environment entropy value to generate an updated environment entropy weight; and performing local knowledge node incremental updating processing on the meta-knowledge base to generate an optimized meta-knowledge base so as to solve the problems of insufficient consistency of cross-modal data and poor environmental understanding robustness caused by large distribution deviation between virtual features generated by a generation model in a noise or data missing scene and a real environment in related technologies.
Owner:ZHONGBEI UNIV

Multi-mode interaction method of accompanying robot

The invention discloses a multi-mode interaction method for an accompanying robot, and relates to the technical field of robot interaction.The multi-mode interaction method comprises the steps that voice, visual and tactile signals are converted into quantum states through multi-mode quantum state coding, emotion weights are dynamically fused, and unified quantum representation is constructed; the dynamic quantum decision engine analyzes environmental noise and user emotion intensity in real time based on a quantum measurement theory, generates an adaptive strategy through dynamic modal weight distribution, and solves a multi-modal instruction conflict; holographic reinforcement learning optimization is combined with quantum acceleration calculation and classical reinforcement learning, the reward function weight is dynamically adjusted, cross-modal knowledge migration is achieved through the quantum tunneling effect, and the system strategy is continuously optimized. The problems that a traditional multi-mode interaction system is rigid in mode switching, high in emotion recognition error rate, lack of self-adaptive optimization of a feedback strategy and the like are solved, and the interaction efficiency and the user experience are improved.
Owner:WIRELESS TAG TECH CO LTD

Multi-perception interaction method and system based on virtual reality

The invention discloses a multi-perception interaction method and system based on virtual reality. The method comprises the following steps: creating a virtual scene and an intelligent agent based on an interaction demand, and constructing a perception model of the virtual scene and the intelligent agent; the intelligent agent perceives visual, auditory and tactile environments, extracts perceived feature time sequence data, divides instructions according to the perceived feature time sequence data, and calculates instruction priorities. And generating a decision network according to a preset knowledge graph, and forming an instruction chain in combination with the instruction priority, so that the intelligent agent obtains a feedback strategy. A dynamic weight value is distributed to a feedback strategy, a virtual scene is updated through fusion of an attention mechanism and a perception model, an interaction mode is obtained, meanwhile, physical and psychological parameters of a user are recorded in real time, abnormal fluctuation segments are recognized, and emotional tendency of the user is learned from corresponding interaction, so that the interaction mode is continuously optimized. According to the method, the interaction experience can be improved, the intelligent agent can better meet the user requirement, the interaction effectiveness and adaptability are enhanced, and meanwhile good interpretability is achieved.
Owner:CHINA NAT INST OF STANDARDIZATION

Database interaction method and device based on multi-agent cooperation, equipment and medium

The invention discloses a database interaction method, device and equipment based on multi-agent cooperation and a medium, and relates to the technical field of database interaction. The method comprises the steps of obtaining a query request, performing semantic partitioning and vectorization, and obtaining a retrieval vector set; and selecting a search source and searching to obtain an information block. And obtaining candidate knowledge through knowledge base retrieval. And integrating the information blocks and the candidate knowledge to obtain a candidate information set. And constructing a dynamic demand understanding model according to the query request and the candidate information set, and obtaining a task state matrix and a tool calling task. And calling a corresponding auxiliary tool and operating, updating the task state matrix according to an operation result and returning the task state matrix to the task planning agent to update the tool calling task until the tool calling task is no longer output, and obtaining a task result. And when the database interaction module is called, generating a chart according to an output result of the database interaction module, and outputting the chart and a task result together. Otherwise, directly outputting a task result.
Owner:XIAMEN UNIV OF TECH +2

Question answering interaction method and apparatus based on large language model data vectorization query

The present application relates to a question answering interaction method and apparatus based on a large language model data vectorization query, and an electronic device and a computer-readable medium. The method comprises: performing semantic recognition on input data of a user, and determining a question category corresponding to the input data; determining a target vector database on the basis of the question category; converting the input data into an input vector; using the input vector to perform a vector query in the target vector database, and performing splicing to generate a query result; generating a prompt question by means of the input data and the query result; inputting the prompt question into a large language model, so as to acquire a logical analysis result; and when the logical analysis result is a positive result, performing question answering interaction on the basis of the logical analysis result. The present application can provide an intelligent question answering method for a user, thereby improving the answering quality and accuracy of a man-machine intelligent dialogue and question query.
Owner:SHANGHAI QIYUE INFORMATION TECH CO LTD

Multi-platform fusion interaction method and system based on large touch screen

The invention provides a multi-platform fusion interaction method and system based on a large touch screen, and relates to the technical field of man-machine interaction, and the method comprises the steps: dividing a main control area and a cooperative display area, building a mapping relation between touch operation and a multi-platform interaction scene, recognizing a gesture intention through a neural network, and generating touch event data. After touch event data are received, a platform control instruction is generated according to the data dependency graph and the interaction rule base, a master control platform instruction is processed preferentially, and an execution result is synchronized to the cooperation platform or vice versa. And finally, establishing an inter-platform real-time data synchronization mechanism, transmitting data through a bidirectional data channel, dynamically adjusting a transmission strategy, and ensuring data consistency of each platform, thereby realizing efficient multi-platform fusion interaction, improving user experience and reducing system delay.
Owner:BEIJING ZHONGHE HUANGPU EDUCATION TECHNOLOGY CO LTD

Intelligent interaction method and device and interaction system based on intelligent agent

The invention provides an intelligent interaction method and device and an agent-based interaction system, relates to the technical field of artificial intelligence such as natural language processing, large language models and deep learning, and can be applied to multi-agent collaboration based on a large language model (LLM). Comprising the steps of determining a knowledge base, a positive sample reference statement and a negative sample reference statement which are currently associated with a dialogue system; performing intention recognition on the current first input statement based on the knowledge base, the positive sample reference statement and the negative sample reference statement, and determining a first intention of the first input statement and the definition of the first intention; outputting an intention inquiry statement under the condition that the definition of the first intention is smaller than a first threshold value; obtaining a second input statement, and returning to execute the step of performing intention recognition on the first input statement based on the second input statement until a target intention with the definition greater than a first threshold value is obtained; and outputting a reply statement corresponding to the first input statement based on the target intention.
Owner:BEIJING BAIDU NETCOM SCI & TECH CO LTD

Large model interaction method and system based on multi-model collaborative dialogue

The invention provides a large model interaction method and system based on multi-model collaborative dialogue, and relates to the technical field of artificial intelligence, and the method comprises the steps: dividing multi-modal data into a pixel block matrix and extracting feature vectors, constructing a hexagonal honeycomb-shaped coding matrix to store data information, and generating an attention score matrix by adopting a multi-head attention mechanism; constructing a model communication network based on the transmission data unit, and calculating a professional degree score through graph convolution; according to the method, performance data is collected to generate an evaluation graph, and an optimal node cooperation strategy is output in combination with dominant learning, so that the efficiency and accuracy of multi-model cooperation dialogue are improved, and the robustness and expandability of the system are enhanced.
Owner:北京科杰科技有限公司

Interaction method and device, electronic equipment, storage medium and product

Relates to an interaction method and device, electronic equipment, a storage medium and a product, and relates to the technical field of terminals. The interaction method comprises: displaying multimedia content on a playing interface (S102); determining a called object based on the multimedia content (S104); in response to the called object being an agent, displaying, in the playing interface, a message sent by the agent through a message control, the message being obtained by understanding the multimedia content (S106); and in response to a trigger operation of the user on the message control, displaying a dialogue interface between the user and the agent (S108).
Owner:BEIJING ZITIAO NETWORK TECH CO LTD

Interaction method, system, equipment and medium

The invention provides an interaction method, system and device and a medium, and relates to the technical field of man-machine interaction, and the method comprises the steps: obtaining an interaction process of a main control agent and a target user in a current round of interaction process according to the intention information and state information of the target user in the current round of interaction process; according to the interaction process, controlling an execution agent to perform response operation on current input information to obtain a response operation result of the current input information; the current input information is information input by the target user in a current round of interaction process; and outputting response information corresponding to the current input information according to the response operation result. According to the method, the interaction process and the dialogue content are flexibly adjusted according to the real-time intention and the real-time state of the user, and the fluency, naturalness and adaptability of interaction, the efficiency and real-time performance of interaction processing and the user experience feeling are remarkably improved.
Owner:IFLYTEK CO LTD

Immersive space virtual-real interaction method and system based on meta universe

The invention discloses an immersive space virtual-real interaction method and system based on element universe, and relates to the technical field of brain-computer interfaces, and the method comprises the steps: capturing an electroencephalogram signal of a user, and obtaining brain wave data of the user in real time; transmitting the brain wave data to a neural feedback adaptive network for analysis, and generating a corresponding interaction intention; virtual environment elements in the meta universe are adjusted in real time according to the interaction intention; the physical environment of the user is monitored in real time, physical environment parameters are obtained, the physical environment parameters are compared with the virtual environment elements, and bidirectional synchronous adjustment is carried out; dynamically adjusting sensory elements in the virtual environment elements by utilizing electroencephalogram resonance based on the electroencephalogram signal of the user and the synchronized physical environment parameters; through bidirectional synchronous adjustment of the physical environment parameters and the virtual environment elements, high consistency between the virtual environment and the physical environment of the user is ensured, and the immersion and authenticity experience of the user are greatly improved.
Owner:ZHONGYI INSTECH TECH CO LTD

Smart home scene understanding and interaction method and system based on multi-modal fusion

The invention discloses a smart home scene understanding and interaction method and system based on multi-modal fusion, and the method comprises the steps: converting collected voice data into text data, carrying out the content understanding of collected image / video data through a multi-modal visual large model in order to more effectively understand the behaviors and potential intentions of a user, and carrying out the interaction of the collected image / video data. Then performing information extraction and reasoning on text data converted from voice data and contents understood by the multi-modal visual large model by utilizing the strong logical reasoning ability of the large language model; then, an instruction is generated based on the content of user interaction, visual cue words are generated from the instruction, real-time segmentation of the image / video content is implemented according to the visual cue words by adopting a multi-modal visual large model, and the large language model and the multi-modal visual model are fused in the intelligent home scene user interaction process through the visual cue words; and finally, performing three-dimensional processing on the segmented image, and realizing deep fusion with an AR / MR scene based on real-time segmentation of the scene.
Owner:QINGDAO HAIDA NOVA SOFTWARE CONSULTING CO LTD

AR intelligent shopping guide interaction method and system applied to store management

The invention provides an AR intelligent shopping guide interaction method and system applied to store management, and the method comprises the steps: firstly obtaining an interaction data set of a user in a store, covering a user position movement track, a commodity attention action sequence and voice consultation content, carrying out the user intention analysis of the interaction data set, and carrying out the user intention analysis of the interaction data set; the method comprises the steps of obtaining commodity demand characteristics and interaction preference characteristics, generating AR shopping guide interaction content, including commodity three-dimensional display information and an interaction guide instruction, adaptive to a user based on the commodity demand characteristics and the interaction preference characteristics, aligning and fusing the AR shopping guide interaction content with a store physical scene space, generating an AR shopping guide interaction scene capable of being displayed in real time, and displaying the AR shopping guide interaction scene in real time. And finally, responding to user interaction operation in the AR shopping guide interaction scene, generating feedback information and updating the interaction data set to trigger interactive process iterative optimization, thereby providing personalized and immersive shopping guide experience, and improving store operation efficiency and customer satisfaction.
Owner:SHANGHAI PINSHANG LIFE NETWORK TECHNOLOGY CO LTD +1

Multi-modal instruction interaction method and system, computing device and storage medium

The invention discloses a multi-mode instruction interaction method and system based on a virtual character, computing equipment and a storage medium, and the method comprises the steps: obtaining and recognizing user posture data, and obtaining a first operation instruction corresponding to the posture data; voice data of the user are obtained and recognized to obtain intention data of the user, and a corresponding second operation instruction is obtained according to the intention data; the first operation instruction and the second operation instruction are subjected to timestamp alignment, the similarity of the first operation instruction and the second operation instruction in the semantic space is calculated, the first operation instruction and the second operation instruction are fused and dynamically adjusted through a weighted average method, and an instruction with the highest priority is obtained to serve as a final operation instruction to control an object in the virtual scene to move. According to the method, the gesture instruction and the voice instruction are deeply fused, the interaction space between the user and the virtual environment is greatly expanded, the limitation of a traditional single interaction mode is broken through, and more natural, efficient and intelligent immersive experience is provided for the user.
Owner:SHENZHEN YUANXIANG VISION TECH GRP CO LTD

Interaction method and platform system based on artificial intelligence equipment

The invention provides an interaction method based on artificial intelligence equipment, belongs to the technical field of artificial intelligence, and remarkably optimizes the efficiency of an AI equipment interaction system through distributed resource dynamic scheduling, multi-framework heterogeneous collaboration and full-link intelligent monitoring. Based on an elastic capacity expansion and contraction and priority scheduling strategy of Kubernetes, GPU resource islands are eliminated, and the computing power distribution efficiency is improved; a Flink checkpoint mechanism and Spark RDD blood relationship tracking are integrated, training task breakpoint continuous calculation and millisecond-level fault recovery are achieved, and repeated data processing is avoided; gPU node performance indexes are collected in real time through Prometheus Exporter, and in combination with Grafana visual early warning, the anomaly detection response speed is shortened to the second level; seamless access of frames such as TensorFlow / PyTorch is supported, heterogeneous device protocol conversion is achieved through a unified API gateway, and the cross-platform migration cost is reduced.
Owner:ZHONGKE NUOXIN BEIJING HI TECH

Model-based interaction method and system, wearable device and storage medium

The invention provides a model-based interaction method and system, wearable equipment and a storage medium, and belongs to the technical field of intelligent interaction.The method comprises the steps that in response to a received interaction instruction, voice data, a gesture image, eye movement data and an environment image are obtained based on the interaction instruction; extracting user intention features based on the voice data, the gesture image and the eye movement data, and determining scene type features based on the environment image; determining an interaction theme based on the interaction instruction, obtaining user historical interaction information associated with the interaction theme from a context memory database, and generating a context feature vector based on the user historical interaction information; and inputting the user intention feature, the scene type feature and the context feature vector into an intention recognition model based on quantum enhancement to obtain a user intention, and generating interaction response data based on the user intention. According to the invention, the accuracy of user intention recognition can be improved, and the intelligence of interaction is improved.
Owner:BEIJING SUPERHEXA CENTURY TECH CO LTD

Interaction method for driving digital human language understanding and corresponding reaction through artificial intelligence algorithm

The invention relates to the technical field of electric digital data processing, in particular to an artificial intelligence algorithm-driven digital human language understanding and corresponding reaction interaction method. The method comprises the following steps: collecting historical language data, text data, action instruction data and physical environment information of a user to obtain structured training data; vectorizing the text data to obtain a text semantic vector; environment feature vectors are extracted from the physical environment information; splicing the text semantic vector and the environment feature vector to obtain an environment enhanced text vector; and constructing a pre-training language model based on the environment enhanced text vector, and performing secondary pre-training to generate an optimized language model parameter. According to the invention, by fusing the user language and the physical environment information and combining with the multi-module intelligent component, context perception, efficient understanding and multi-modal natural interaction of the digital human in a complex scene are realized, and the intelligence, adaptability and user experience of the system are remarkably improved.
Owner:SHENZHEN NEITWAY INFORMATION & TECH DEV CO LTD +1