381 results about "Interaction technique" patented technology

The invention provides an intelligent data query method based on a natural language, and relates to the technical field of intelligent data processing and natural language interaction.The intelligent data query method comprises the steps that firstly, enterprise original data is subjected to standard treatment, and a standardized theme database and a data directory and index definition document are constructed; key semantics are extracted based on unstructured knowledge, and a domain knowledge vector library is fused and constructed by combining document text fragments and vector representation of a mapping relation between historical questions of a user and an SQL (Structured Query Language). And after receiving a natural language question of a user, calling a large language model to identify a task type, and distinguishing knowledge questions and answers, data query and complex analysis. Executing corresponding operations according to different types: directly retrieving a vector library by knowledge questions and answers to generate answers; extracting keywords in data query and generating a query request in combination with context; and in the complex analysis, predefined workflow is judged and executed or intelligent agent processing is called, and query or analysis requirements are output.

The invention discloses a virtual-real fusion interaction method and system based on digital twinning, particularly relates to the technical field of digital twinning and virtual-real interaction, and is used for solving the problem that semantic drift is difficult to monitor in a virtual-real fusion interaction process in the prior art. The method comprises the following steps: constructing a digital twin model consistent with a current state of a physical entity in a virtual space; accurate mapping of user operation and physical entities is realized through a multi-modal interaction algorithm; analyzing the energy change of an abnormal propagation path by using a multi-scale dissipation power network, and dividing the possibility of semantic drift into global or locality; when the semantic drift is likely to be locality, the semantic entropy value change degree caused by user operation is evaluated in combination with the maximum entropy principle, the change of the semantic graph topological structure is analyzed through the graph matching deformation network, the potential influence of the semantic drift is comprehensively evaluated, the accuracy and stability of virtual-real interaction are effectively improved, and the user experience is improved. And a technical support is provided for semantic drift monitoring and processing in a complex interaction scene.

The invention relates to the technical field of user interaction, in particular to a live broadcast bullet screen real-time feedback method and system based on interaction semantic matching, and the method comprises the steps: receiving and caching user bullet screens in real time, carrying out the density analysis and priority evaluation of bullet screen flows through the combination of filtering and resource optimization rules, dynamically adjusting the response frequency, and screening key bullet screens; a distillation processing mechanism intention unit is introduced, a user intention label in a key bullet screen is extracted, a vector is generated, historical behavior data of a sending user is obtained at the same time, the intention label, the vector and current real-time scene data of a live broadcast room are fused, and a bullet screen vector is constructed; performing similarity calculation in combination with the live broadcast content and user historical behaviors to obtain first feedback content; based on a reinforcement learning sentiment analysis strategy, combining user preference memory to generate second feedback content; and embedding the second feedback content into the current live broadcast interface through the client. According to the invention, real-time forward feedback and intelligent guidance of the live broadcast bullet screen are realized through interactive semantic matching.

The invention relates to the technical field of intelligent voice interaction, in particular to an intelligent voice interaction system and an electronic student identity card, and the system comprises a voice input processing module, a semantic decomposition module, a task allocation module, a logic execution module, a dynamic response module and a voice interaction adjustment module. According to the invention, by analyzing the frequency domain and time domain features of the voice signal, accurately capturing voice details, improving the recognition accuracy, analyzing and recombining semantic content word by word, supporting accurate extraction and task description of complex semantics, analyzing resource consumption and dependency relationship, optimizing a task sequence, and improving the efficiency and adaptability of the system; task execution is combined with data retrieval and content classification, it is ensured that key tasks and associated tasks are carried out in a coordinated mode, uncompleted tasks are dynamically fed back and marked, supplementary information is assembled, dialogue continuity and response naturalness are enhanced, a voice interaction adjustment module analyzes uncompleted instructions and repeated calling, and adaptability to demand changes and service efficiency are improved.

The invention provides an interaction method, system and device and a medium, and relates to the technical field of man-machine interaction, and the method comprises the steps: obtaining an interaction process of a main control agent and a target user in a current round of interaction process according to the intention information and state information of the target user in the current round of interaction process; according to the interaction process, controlling an execution agent to perform response operation on current input information to obtain a response operation result of the current input information; the current input information is information input by the target user in a current round of interaction process; and outputting response information corresponding to the current input information according to the response operation result. According to the method, the interaction process and the dialogue content are flexibly adjusted according to the real-time intention and the real-time state of the user, and the fluency, naturalness and adaptability of interaction, the efficiency and real-time performance of interaction processing and the user experience feeling are remarkably improved.

The invention discloses an immersive space virtual-real interaction method and system, and relates to the technical field of virtual reality interaction, and the method comprises the steps: collecting a full-view scene picture and illumination data through a camera, carrying out the preprocessing, simulating the real optical characteristics according to the scene picture and illumination data, and building a virtual scene; the virtual scene is evaluated and optimized; acquiring a user gesture image for analysis, identifying a user interaction command for virtual scene interaction, and displaying an interaction result in real time; and recording and storing the user interaction command and the interaction result. According to the method, the trueness and quality of the virtual scene are effectively improved, meanwhile, the user interaction command is recognized and analyzed by collecting the user gesture image and converting the user gesture image into the three-dimensional coordinate for virtual scene interaction, the gesture recognition accuracy is improved, and the experience effect of user virtual scene interaction is greatly improved.

The invention discloses an intelligent customer service interaction method and system, and relates to the technical field of intelligent customer service interaction, and the method comprises the steps: obtaining a user request; calculating a comprehensive emotion score through multi-modal emotion analysis based on a user request; according to the comprehensive emotion score, classifying the user emotion state, according to a classification result, initializing a dialogue context, and constructing a dialogue context graph; dynamically adjusting the response mode of the intelligent customer service according to the emotional state and the user question in the dialogue context graph, and collecting the feedback information of the user; and dynamically adjusting the dialogue strategy based on the feedback information of the user and the dialogue context. According to the method, the emotion state of the user can be comprehensively captured from multiple aspects such as texts, voices and facial expressions through multi-modal emotion analysis, so that the accuracy and robustness of emotion recognition are improved, a reliable basis is provided for subsequent dialogue management and response modes, and the experience satisfaction degree and the service quality of the user are improved.

The invention discloses a digital human interaction system based on a web end, relates to the technical field of digital human interaction, and aims to solve the problem of accumulated dislocation of browser end digital population animation and actual audio playback caused by multiple clocks and buffer scheduling. The system comprises a visual position cooperative control module, a session initialization module, an audio track and rendering canvas binding module, a multi-domain alignment time base cluster establishment module, construction of a time base cluster containing a system reference sub-time base and a content logic sub-time base, potential candidate anchor point generation module, an optimal anchor point selection module, synchronization error calculation, and judgment of a synchronization steady state, a fine adjustment state or a lost state. An optimal anchor point is screened to adjust the animation, and a visual effect studio dynamic maintenance module and an enhancement generation module assist in out-of-step processing and parameter optimization; through cooperation of multiple modules, accurate synchronization of audio and digital human animation is realized.

The invention discloses a digital large-screen interaction method and device based on multi-agent cooperation and a medium, and relates to the technical field of digital large-screen interaction.The method comprises the steps that postures, expressions and voice data of a user are collected in real time, the attention weight is calculated in combination with spatial position information, the emotional state change rate is monitored, and the user experience is improved in combination with personal historical browsing preferences; acquiring a main interaction user, an emotional state feature and an emotional change trend; according to the main interaction user, the emotional state features and the emotional change trend, obtaining an initial confidence coefficient of the suspected interested field through a semantic understanding model; and based on the candidate guide images, identifying a user selection intention through a multi-modal fusion processing mechanism, calculating a selection probability, triggering content activation of the main interaction area and content dynamic generation of the auxiliary information area, synchronizing state information, and starting an immersive collaborative interaction process. Through three-level collaborative service configuration, the beneficial effects of improving large screen content organization efficiency and enhancing immersive interaction experience are achieved.

The invention is suitable for the technical field of intelligent door locks, and provides a voice interaction processing method, device and system, an intelligent door lock and a cloud server, and the method comprises the steps: receiving a voice instruction sent by a user, and carrying out the local recognition, so as to obtain a local recognition result and the confidence of the local recognition result; when the local recognition result is matched with the local instruction set and the confidence is high, executing a local operation corresponding to the local recognition result; otherwise, establishing a secure communication session with the cloud server based on voiceprint biological characteristics extracted from the voice instruction; sending the voice instruction to a cloud server through the secure communication session, and receiving a cloud operation instruction and / or a dynamic response text returned by the cloud server; and executing corresponding operation according to the cloud operation instruction, and / or converting the dynamic response text into voice for broadcasting through a text-to-voice engine. The intelligent door lock voice interaction system solves the problem that the real-time performance, the reliability, the safety and the interaction intellectualization are difficult to balance in the existing intelligent door lock voice interaction technology.

The invention provides an AI role interaction method, interaction device and interaction equipment in a game platform, and relates to the technical field of game interaction.The method comprises the steps that a current game scene, game task information and game character information are obtained, and a first behavior parameter set of AI roles is generated; collecting current operation behavior data and voice interaction data of a user; performing intention recognition processing on the operation behavior data and the voice interaction data to generate a user behavior feature vector, and determining a relation link between the user behavior feature vector and at least one of game scene information, task information and character information to generate a dynamic interaction strategy; a second behavior parameter set is generated according to the dynamic interaction strategy, and multi-modal interaction content matched with the second behavior parameter set is rendered and generated; and displaying the multi-modal interaction content to the user terminal. According to the method, the interaction of the AI role can be more real and natural, and the game immersion and satisfaction of the user can be remarkably improved.

The invention relates to the technical field of large model interaction, in particular to a long-term and short-term memory processing system based on a large model and a vector database, and provides a scheme that short-term context memory and long-term stable memory are subjected to hierarchical management and joint retrieval by performing semantic analysis and structured modeling on user interaction contents. Under the condition that historical interaction content exists, a theme segment division and intention stack mechanism is introduced, ordered organization and step-by-step alignment of intention states in multiple rounds of conversations are achieved, and matched memory entries are obtained from a cache database and a long-term database based on query semantic representation. Furthermore, by performing normalization, situational rewriting and conflict suppression on memory entries, controllable reasoning prompt information is constructed and input to a large model to generate target output, so that the consistency, stability and controllability of a generated result are improved in a multi-round interaction and cross-session scene.

The invention discloses a voice dialogue system based on a large model, and relates to the technical field of voice interaction, and the system comprises an intelligent scheduling module which determines a task type according to a to-be-recognized text, and dynamically adapts to a fast and slow thinking module according to the task type; the fast and slow thinking module dynamically adapts to the calculation unit according to the task type and outputs a feedback result; the voice interaction module generates a to-be-recognized text according to the voice characteristics of the user and generates a voice instruction based on a feedback result; the context management module stores the interaction log to a corresponding storage unit according to the index key value; the interaction log comprises a task type belonging to the same data flow, an adaptive path and a feedback result; and the data centralized control module determines a parameter adjustment strategy according to the performance index factors in the interaction logs, and the parameter adjustment strategy acts on the intelligent scheduling module or / and the fast and slow thinking module to optimize corresponding parameters. The intelligent balance of quick response and deep reasoning of the dialogue system under a single architecture is realized, and the real-time performance and accuracy of interaction are remarkably improved.

The invention provides a vision-based cross-network interaction method and system, and relates to the technical field of intelligent interaction, and the method comprises the steps: obtaining a visual interaction sequence, constructing multi-modal feature representation, achieving cross-domain semantic alignment, deconstructing visual information into a hierarchical control instruction set, and transmitting the hierarchical control instruction set to a target network environment for execution after security classification. And a bidirectional mapping relation graph is constructed to realize incremental optimization. According to the method, semantic bridging between heterogeneous networks can be established, the cross-domain control precision is improved, and meanwhile safe interaction in a network isolation environment is guaranteed.

The invention discloses a real-time voice stream and text dialogue interaction system based on a large language model, relates to the technical field of dialogue interaction, and solves the technical problem that a self-designed corpus and a large language model are difficult to combine, so that a generated answer is difficult to quickly respond to a professional question in a targeted manner. According to the method, the pre-defined answers can be quickly returned for the questions of which the answers can be found in the corpus, so that the response time is shortened. By preferentially using the existing knowledge base, the burden of the large language model can be reduced, and the overall processing efficiency of the system is improved. The information obtained from the corpus is generally more professional data, which can improve the accuracy and reliability of the answer. Meanwhile, information better meeting the requirements or the background of the user is provided in combination with the user tag, so that the reply better fits the expectation of the user. And when the answer is not found in the corpus, the large language model can be called to generate the answer, so that the adaptability of the system to complex or new questions is enhanced.

The invention relates to the technical field of voice interaction, is applied to the fields of intelligent automobiles, Internet of Vehicles, mobile terminals and the like, and discloses a voice interaction method and device and a storage medium. The voice interaction method comprises the steps that when a first voice instruction of a first user is detected, a screen, such as a first screen, corresponding to the first user is firstly determined, then the first screen can be determined as a main voice screen, and the first screen is adopted to display a first voice interaction interface. In the process that the vehicle-mounted equipment receives the first voice instruction, if a second voice instruction initiated by a second user is detected and a screen corresponding to the second user is determined to be other screens, such as the second screen, the second screen is determined to be an auxiliary voice screen, and the second screen is adopted to display a second voice interaction interface. And meanwhile, displaying an interaction identifier representing that other user interactions exist by adopting a first screen. Based on the scheme, the multi-screen advantage can be fully played, multi-screen man-machine interaction is realized, and the user experience is effectively improved.

The invention relates to the technical field of intelligent voice interaction, in particular to an AI mobile phone voice interaction method oriented to automatic marketing, which comprises the following steps of: providing a comprehensive basis for personalized marketing and improving the marketing pertinence by recognizing a user emotional state and a real-time user intention in parallel and mastering the user state; an emotion state transition network is dynamically constructed and updated, key indexes are extracted, and a user emotion change rule is analyzed, so that an interaction strategy is accurately adjusted; semantic fragments are recombined by combining emotional stability and emotional infection degree indexes, adaptive dynamic marketing verbal skill is generated, the attraction and persuasion of the verbal skill are enhanced, and the marketing effect is improved; the local NPU is utilized to synthesize emotional voices and superpose features, so that natural and vivid interaction experience is provided, and recognition of a user on marketing content is enhanced; through dynamic decision-making verbal skill strategy cross-scene switching, timely adjustment is carried out according to user changes, marketing strategy stiffness is avoided, and the marketing success rate is guaranteed.

The invention relates to the technical field of intelligent interaction, and particularly provides a method, medium, equipment and product for tool calling in task-based dialogues, the method is applied to intelligent glasses, and the method comprises the following steps: obtaining multi-round dialogue contents of a user and a pre-trained large language model; wherein the pre-trained large language model contains a plurality of different application scenes; based on the multi-round dialogue content, a marking tool calls a cue word; outputting and calling a target tool in a scene corresponding to the tool calling prompt word by utilizing the pre-trained large language model; the target tool comprises a tool name, a tool parameter name and a tool parameter value; the target tool comprises application software corresponding to the multiple different application scenes and a function control tool of the application software. Some embodiments of the application can realize task type multi-round dialogue interaction, and meet the dialogue demand of the user.

The embodiment of the invention discloses an application split-screen display method and device, a terminal and a storage medium, and belongs to the technical field of interface interaction. The method comprises the steps that in a split-screen mode, a first application interface of a first application is displayed, a first application assembly corresponding to a second application is displayed, and the first application interface and the first application assembly are located in different display areas; wherein the interface elements contained in the application component of the same application are less than the interface elements contained in the application interface, and the interface elements contained in the application component are used for realizing the core function of the application. By adopting the method provided by the embodiment of the invention, the split-screen display form of the display application component can be added during split-screen display of the application, the split-screen display effect and the split-screen function are optimized, and the convenience and flexibility of application operation are improved.

The invention discloses a service control method based on voice analysis and a large language model, relates to the technical field of voice interaction, and solves the technical problems that in the prior art, an enterprise service system needs a user to manually fill in form fields item by item, so that operation is tedious and low in efficiency, and a process is interrupted due to lack of an intelligent completion mechanism due to lack of necessary parameters. According to the invention, a full-closed-loop control chain from the voice instruction to the service operation is constructed, the intention of the user voice input is analyzed through the fine-tuning large language model, and the service interface is dynamically matched, so that the system function operation is directly driven by the voice, and a two-way cooperation mechanism of voice input-system operation-result feedback is formed; and meanwhile, a dynamic parameter completion technology is adopted, the interface field needing to be filled is automatically verified in the parameter extraction stage, missing parameters are completed through context completion or voice guidance, the operation bottleneck of traditional form item-by-item filling is eliminated, missing of the field needing to be filled is avoided, and the service execution efficiency and the process robustness are remarkably improved.

The invention relates to the technical field of voice interaction, in particular to a dialogue type AI low-delay response control method and system based on semantic analysis. The method comprises the following steps: firstly, generating a driving intensity correlation factor of a current time window according to the change of CAN bus data; further monitoring the output of the NLU, analyzing the acoustic intonation raising characteristics, and obtaining an interaction suppression coefficient in combination with the driving intensity correlation factor; further acquiring a time pressure coefficient based on the mute duration after the user stops sounding; further comparing the interaction suppression coefficient and the time pressure coefficient of the current time window to obtain a response judgment value; further analyzing the change trend of the interaction inhibition coefficient, and updating an environment improvement flag bit; and finally, according to the driving intensity correlation factor, the environment improvement flag bit and the response decision value of the current time window, carrying out multi-level response decision control, and carrying out selective reset of an interaction state, thereby solving the problems of wrong truncation and response delay of voice interaction under dynamic driving.

The invention relates to the technical field of intelligent voice interaction, and discloses a voice interaction method and system based on 3D virtualization, and the method comprises the steps: receiving real-time voice of a user, carrying out the preprocessing, building a voice recognition model, and analyzing the pronunciation characteristics and definition of the user; optimizing the speech recognition model based on the pronunciation characteristics and definition of the user; generating a candidate prediction instruction set of the next step of the user by using the optimized voice recognition model in combination with a historical command of the user and a current 3D environment context; the candidate prediction instruction set comprises a plurality of candidate instructions; the priority of each candidate instruction is recognized, the candidate instruction with the highest priority serves as a prediction instruction of the user in the next step, related resources of the prediction instruction are loaded preferentially, and user requirements are quickly responded. The user demand is predicted more accurately in a complex scene, and the accuracy and the real-time response capability of voice interaction are remarkably improved.

The invention discloses a personalized interaction method and system based on multi-modal emotion perception, and relates to the technical field of intelligent interaction, and the method comprises the steps: collecting user historical interaction event data, and extracting interaction content features and user behavior features; obtaining interaction emotion data of the user in real time through a multi-mode sensor; fusing the interactive emotion multi-modal data to generate a dynamic emotion quantized value; generating an emotion correction factor; dynamically generating a personalized interaction strategy; and executing the interaction strategy, and collecting user response data to update a historical interaction event library. The method has the advantages that the key problem that a traditional interaction system is difficult to perceive the real-time emotional state of the user is effectively solved, a closed-loop optimization system of perception-decision-execution-feedback is constructed, and the user interaction satisfaction degree and the situation adaptive capacity of the whole system are continuously improved.

The invention discloses a voice interaction method and device, relates to the technical field of voice interaction, and mainly aims at giving a response matched with the emotion of a user in a voice interaction process to realize emotion interaction with the user so as to improve the voice interaction experience of the user. According to the main technical scheme, the method comprises the steps of obtaining voice data of a user in a current dialogue process, and generating a reply text for feeding back the voice data; emotion recognition is carried out on the voice data, and acoustic emotion features and semantic emotion features of the user are determined; determining a real emotion feature of the user by combining the acoustic emotion feature and the semantic emotion feature; determining a target emotion feature and a target timbre feature adapted to feed back the real emotion feature; and playing the reply text by adopting the target emotion feature and the target tone feature.

The invention provides a door lock voice interaction method and device and a related product, and relates to the technical field of intelligent interaction. When the method is executed, a PIR passive infrared sensor is triggered, whether a voice instruction of a user is received or not is judged, the voice instruction is a preset voice instruction, and the voice instruction of the user is used for indicating that a first use scene is met, that is, when the first use scene is met, an interaction strategy corresponding to the first use scene is executed, and the interaction strategy corresponding to the first use scene is executed. Obtaining a door lock voice interaction result, and finally outputting the door lock voice interaction result. Thus, in response to the fact that the PIR passive infrared sensor is triggered and the use scene is met, the interaction strategy corresponding to the met use scene is executed, so that a user interacts with the door lock, and the voice interaction experience of the user and the door lock can be improved.

The invention belongs to the technical field of intelligent interaction, and discloses a conversation interaction method and device based on voice recognition, and the method comprises the steps: obtaining audio data, and carrying out the preprocessing of the audio data, and obtaining a short-time signal; extracting audio feature information in the short-time signal; inputting the audio feature information into a full covariance Gaussian mixture model to obtain a real person possibility score; if the real person possibility score is greater than a preset threshold value, converting the audio data into text data, and performing intention recognition, entity recognition and emotion recognition on the text data to obtain a recognition result; matching an answer text in a corresponding industry database according to a recognition result; and converting the answer text into voice data, and playing the voice data. The diversity and complexity of short-time signals can be captured, the robustness and accuracy of audio recognition are improved, dialogues between a dialogue engine and non-people are avoided, and computing resources are saved.

The invention provides a multi-modal fusion-driven agent interaction method and system, and relates to the technical field of intelligent interaction, and the method comprises the steps: extracting image, text and audio feature vectors through a deep neural network, carrying out the self-adaptive fusion through a cross-modal self-attention sub-module and an inter-modal interaction attention sub-module, and carrying out the self-adaptive fusion. And updating node features of the agent knowledge graph based on the difference degree, performing relation reasoning, and generating an interaction strategy to control the agent to execute an interaction action. According to the method, effective fusion of multi-modal information and dynamic updating of the knowledge graph are realized, and the accuracy and adaptability of agent interaction are improved.

The invention discloses an intelligent voice outbound system capable of realizing automatic adjustment, and relates to the technical field of intelligent voice interaction, the system comprises a voice acquisition and preprocessing module, a voiceprint analysis and emotion recognition module, a dynamic verbal skill generation module, a verbal skill real-time optimization module and a voice synthesis and outbound module; the communication efficiency and personalized service are improved through a'generation-optimization-feedback 'closed-loop design, the system generates scene-fitting verbal skills according to customer emotions, historical records and demands, adjusts strategies according to instant feedback of customers, reduces invalid conversations, reduces customer conflicts, shortens the communication period, and meanwhile, improves the user experience. Voiceprint features are decomposed into four quantifiable dimensions, emotion is accurately recognized in combination with a combination rule, limitation of a single index is avoided, the dynamic verbal skill generation module is based on a generative adversarial network, high-quality verbal skill can be learned, the dynamic verbal skill generation module adapts to multiple scenes, customization cost is reduced, and intelligent outbound large-scale application is promoted.