864 results about "S Voice" patented technology

The invention provides a multi-mode-based man-machine interaction method and system, and relates to the technical field of man-machine interaction. Voice input of a user is received, environment information is collected, facial expressions of the user are captured, and voice features, environment features and facial features are obtained based on the input; utilizing a pre-trained emotion recognition model to generate emotion features of the user, and utilizing a pre-trained user behavior model to generate behavior features according to the current operation information of the user; after the features are obtained, the first weights and the second weights of the features are dynamically adjusted, feature weighted fusion is carried out, and comprehensive features are obtained; the multiple candidate responses are generated based on the comprehensive characteristics, the final response is screened out through a preset scoring mechanism and output, comprehensive understanding of the intention and the emotional state of the user is achieved through comprehensive utilization of multiple data sources, and meanwhile the weight of each characteristic can be dynamically adjusted so that more intelligent and humanized interaction experience can be generated.

The invention relates to the technical field of computer vision and human-computer interaction, and discloses an AI digital human intelligent interaction method, system and equipment based on multiple modalities, and the method comprises the steps: pre-awakening a digital human when a human face is detected, and further thoroughly awakening the digital human based on recognized preset voice information or preset gesture information; voice and video information of a user in the interaction process is obtained, a keyword extraction result, a gesture recognition result and an emotional state tag are generated, a pre-constructed knowledge base is utilized to retrieve related information, a big language generation model module is combined to generate an answer text, and the answer text is input into a preset voice synthesis model to generate emotional voice output. And based on the current emotional state label of the user, driving the digital human animation to be output in an emotional manner. According to the method and the system, the digital human for understanding the emotion of the user, generating personalized answers, providing voices with rich emotions and displaying natural expressions and actions can be created, better interaction with the user can be realized, and more humanized and effective services can be provided.

The invention provides a dynamic self-adaptive multi-modal sentiment analysis fusion method and system, and relates to the technical field of multi-modal sentiment analysis. The method comprises the following steps: synchronously acquiring voice, text, facial expression and limb movement data of a target user to form a multi-modal data set; the method comprises the following steps: firstly, extracting emotional characteristics of each mode, and constructing a cross-mode correlation model to capture a collaborative and complementary relationship among different modes; and calculating a real-time confidence score and a complementarity index of each modal based on the weight matrix of the cross-modal correlation model. Then, according to the scores and the indexes, a weighted average or maximum entropy algorithm is dynamically selected to fuse multi-modal emotion features, and a comprehensive emotion feature vector is generated; and finally, inputting the vector into a pre-training deep learning model, and outputting an emotional state category of the user. According to the method, the user emotion can be accurately and comprehensively captured, efficient emotion recognition and classification are realized, and the robustness and flexibility of an emotion analysis system in a complex scene are improved.

The invention belongs to the technical field of vehicle state detection and early warning, and particularly relates to a vehicle state monitoring and early warning method and system.The monitoring and early warning method comprises the steps that a sensor obtains real-time data, an anomaly detection algorithm is applied, and an abnormal event is marked; calculating an information priority according to the abnormal severity and the driving scene, and distributing the information priority to a high-priority queue; multi-mode early warning is generated, and high-frequency sound and vibration are used during high-speed driving; extracting a voice prompt, and generating voice waveform data through a voice synthesis module; voice input of a driver is recognized, intention is analyzed, and abnormal information feedback is provided; according to the scene and the abnormal state, interactive output is optimized, and detailed information is displayed during low-speed congestion; dynamically adjusting the interface of the instrument panel, and amplifying the key area in case of abnormal severity; and integrating the image data and the voice data, generating a multi-mode signal, and transmitting the multi-mode signal after rendering processing. The vehicle abnormal information can be timely and accurately transmitted to a driver, and the driving safety is effectively improved.

The embodiment of the invention provides a voice conversation method and system, electronic equipment, a storage medium and a program product. One method is implemented as follows: a voice dialogue stream (which can be an inquiry voice stream input by a user for a target commodity) of a user is subjected to streaming response, a plurality of dialogue text segments are generated in a segmented manner in the streaming response process, and the dialogue text segments are output in real time after being generated and stored in a first cache queue; and when it is detected that the reply text fragment is stored in the first cache queue, the stored reply text fragment is converted into a reply voice fragment in real time and played. The streaming response may be performed by an agent. Visibly, according to the response of the voice dialogue stream of the user, the dialogue is played while being generated, the waiting time from text to voice synthesis can be greatly shortened, and therefore the response time can be shortened.

The invention relates to the technical field of language learning, and discloses an English auxiliary pronunciation training method and system based on multi-task learning, and the method comprises the following steps: constructing a multi-task learning framework which comprises at least two subtask models related to pronunciation, comprising the steps of pronunciation accuracy scoring, pronunciation error type positioning and intonation fluency analysis. A voice signal, a lip movement video and a text content of a user are collected through a multi-modal data input module; and performing joint coding on the multi-modal data by using the shared feature extraction layer to generate fused acoustics. According to the English auxiliary pronunciation training method and system based on multi-task learning, the pronunciation training path of the user can be adaptively adjusted, the requirements of different users can be met, the English pronunciation level can be more effectively improved, and through strategies such as multi-modal data input, shared feature extraction, inter-task attention mechanism and adaptive training path adjustment, the English pronunciation training efficiency can be improved. Accurate evaluation and personalized training of English pronunciation are realized.

The invention provides a dynamic health monitoring system integrating artificial intelligence and wearable equipment and a method thereof, and relates to the field of health monitoring, and the method comprises the steps: collecting physiological parameters and environmental data of a user, eliminating time migration of multi-source data through a timestamp alignment technology, extracting dynamic coupling features of the physiological parameters and the environmental data, and obtaining a dynamic health monitoring result; and generating the health state characterization guided by the environment. The method comprises the following steps: synchronously acquiring user voice input information, and extracting and analyzing acoustic features to generate emotional state change features after performing Mel spectrum conversion; then, cross-modal semantic association between emotions and health states is established through a modal soft constraint mechanism, and personalized guidance suggestions are generated and displayed, so that the dynamic perception ability of health state assessment and the scene adaptability of suggestion generation are improved; therefore, the problems of environmental factor splitting, subjective and objective data isolation and insufficient dynamic nonlinear relation modeling in a traditional method are solved.

The invention provides a digital human real-time question-answering method, system and device for intelligent emotion interaction and a medium, and the method comprises the steps: capturing identity information, facial expressions and the like of different figures through face recognition and face attribute analysis, and obtaining an instruction and emotion of a user based on voice recognition and voice emotion analysis; information such as instructions, identities and emotions of a user is fused through a large language model to output appropriate answers, multi-round question answering can be conducted on associated question association contexts, meanwhile, appropriate emotions are given to the answers of the large model in combination with context analysis and emotion analysis, and what expressions and actions are inserted at a certain time are calculated; performing speech synthesis by using proper emotion, and realizing matching of audio and digital population types by using a mouth shape generation algorithm; and finally, generating expressions and actions at proper opportunities in combination with contexts and emotions while broadcasting the voice of the digital person. According to the method, high-simulation digital human real-time question answering with high intelligent emotion interaction can be realized.

An automatic online voice translation system and method, comprising a virtual translator, a SIP gateway, and a storage, wherein the SIP gateway receives a call from a caller, when the virtual translator is not activated, the SIP gateway establishes a communication between the caller and the agent by streaming in real-time caller's voice directly to the agent and agent's voice directly to the caller, and when the virtual translator is activated, the SIP gateway creates audio files based on the received voice streams of both the caller and the agent, and sends the created audio files to the virtual translator for translating the caller's voice into a language understood by the agent, before transmitting the voice to the agent. In another embodiment, a contact center platform is used for applying features such as call recording, Interactive Voice Response (IVR) service, and conferencing service to the call.

The embodiment of the invention provides a dialogue interaction state recognition method and system, electronic equipment and a storage medium, and relates to the technical field of voice interaction, and the method comprises the steps: extracting time sequence features and semantic features from obtained voice information; the time sequence feature represents the rhythm change condition of the user in the dialogue process, and the semantic feature represents the voice content and the voice intensity of the user in the dialogue process; recognizing the current dialogue interaction state of the user according to the time sequence features and the semantic features; the dialogue interaction state comprises one of a silent state, an interrupted state and a hesitant state. Therefore, the conversation interaction state of the user is recognized by combining the time sequence features and the semantic features, voice signal level analysis is considered, and changes of voice rhythm, voice content and voice intensity are also considered, so that the conversation interaction state of the user is accurately recognized, and the recognition precision of complex interaction states such as hesitation and interruption is improved.

The invention discloses an intelligent accompanying method and an emotion monitoring device, which are applied to an emotion monitoring intelligent bed, and the method comprises the steps: obtaining emotion data of a user, the emotion data comprising voice features, expression features and posture change features; judging different emotion data to obtain different emotional states, and obtaining a target emotional state of the user according to the different emotional states and preset weight information of the different emotional states; when the target emotional state is an abnormal state, sending out a first feedback signal; and according to the first feedback signal, guiding the user to perform voice interaction through a semantic analysis model, and outputting an audio reply corresponding to the user voice information. According to the method, the emotion state of the user can be detected and fed back in real time, the emotion of the user is adjusted in a voice dialogue communication mode, and the nursing quality of the user is improved.

The present invention relates to the technical field of intelligent voice customer service response, and a water service intelligent voice customer service response method and system based on AI, including: obtaining a plurality of users, and performing the following operations on each user among the plurality of users: obtaining the user's voice, performing voice signal processing on the user's voice to obtain user voice features, retrieving matching voice features, detecting the feature similarity between the user voice features and the matching voice features, constructing a water service knowledge graph, obtaining inquiry information voice and encrypted user data, obtaining updated voice, using the updated voice as the user's voice, returning to the step of performing voice signal processing on the user's voice, obtaining the number of inquiries of the inquiry information voice, updating the water service voice database to obtain an optimized water service voice database, and completing the water service intelligent voice customer service response based on AI based on the encrypted user data set and the optimized water service voice database. The present invention can improve the efficiency and quality of water service customer service and enhance the user experience.

The invention discloses an intelligent blind guiding glasses system based on a multi-mode large language model. The intelligent blind guiding glasses system comprises an image acquisition module, a voice acquisition module, a large language model module, a bone conduction sound transmission module, a navigation path planning module, a central processor module and a wireless communication module, the image acquisition module is used for acquiring a three-dimensional image of a front scene and providing three-dimensional space information; the voice acquisition module is used for acquiring a voice instruction of a user; the big language model module is used for generating character answers and converting the character answers into voice according to the voice instruction of the user by utilizing a big language model; the bone conduction sound transmission module is used for receiving and playing the voice generated by the large language model module; the navigation path planning module is used for planning a navigation path according to the user position and the destination; the functions of navigation positioning, line guiding, voice prompting and the like are provided for the blind, the glasses are adopted as a carrier, carrying is convenient, voice awakening and other instructions are adopted to replace keys, operation is easy, and practicability is high.

Systems and methods for annotating, also known as tagging, visually identifiable objects using natural language (i.e. spoken voice) are provided. More specifically, but not exclusively, this disclosure relates to systems and methods for tagging identified objects related to underground utilities and assets, and communication systems. Once tagged, data representing identified objects can be stored, transmitted, and / or mapped. In an exemplary embodiment, a utility service worker or other personnel may walk or drive around an area of interest using utility locating equipment or systems to collect data. As data is being collected, the user may visually identify utility related or other items using a laser pointer, and then use their voice to tag items of interest. A headset including a microphone may be provided for capturing the user's voice. Hardware and / or software may be provided for processing tagged items, and relating them to a specific location, and / or utility asset.

The invention relates to the technical field of intelligent recognition, in particular to a multi-model hierarchy-based user intention classification method and device, a vehicle and a medium, and the method comprises the steps: obtaining a voice instruction of a user; decoding and converting the voice instruction into text data, inputting the text data into a pre-constructed intention classification model to obtain a matching result, and recognizing the user intention through a plurality of model layers in the intention classification model based on a confidence interval of the matching result to obtain a user intention recognition result; the target control instruction is determined according to the user intention recognition result, the vehicle is controlled to execute the corresponding operation according to the target control instruction, and the operation result is fed back, so that the problems of low user intention recognition speed and low user intention recognition accuracy in related technologies are solved, the user intention recognition speed is increased, and the user intention recognition efficiency is improved. And the accuracy of user intention recognition is improved.

The invention belongs to the technical field of artificial intelligence, and particularly relates to a real-time voice interaction and adaptive content generation system based on RTC and AI GC, which comprises the steps of capturing voice input of a user through a microphone of equipment, and converting the voice input into text information by using a voice recognition technology; the recognized text input is transmitted to a natural language understanding module, semantic analysis is carried out, and user intention and information are recognized; according to the intention and demand of the user, the AI GC technology is used for dynamically generating personalized content; and the generated content is optimized in real time according to the feedback in interaction, the demand change of the user is adapted, the generated text content is converted into voice to be output and provided for the user, and the effects of meeting the demands of different types of users and promoting real-time interactive propagation and automatic content generation are achieved.

The invention relates to a voice control ultrasonic wave adjustment setting method based on a CTC-Attention mixed architecture, and the method comprises the following steps: S1, receiving a voice instruction of a doctor through a voice receiving device, and carrying out the preprocessing of an original voice signal; s2, constructing an acoustic model of a CTC-Attention hybrid architecture, and training the acoustic model to obtain a trained acoustic model; s3, inputting the preprocessed voice signal into the trained acoustic model, and performing voice recognition through CTC path probability alignment and Attention context dependence joint optimization; s4, outputting an identification result and decoding the identification result into a text instruction; and S5, analyzing the operation intention according to the text instruction, and controlling the ultrasonic instrument to execute a corresponding state adjustment operation. According to the method, the voice signal of the operator is received, the voice signal is recognized and analyzed, the obtained result is optimized and then converted into the character content with the meaning, then the ultrasonic energy with the intensity corresponding to the character content is generated by the ultrasonic instrument based on the character content, and the ultrasonic instrument is effectively used for medical operation.

Voice anonymization systems and methods are provided. Voice anonymization is done on the speaker's computing device and can prevent voice theft. The voice anonymization systems and methods are lightweight and run efficiently in real time on a computing device, allowing for speaker anonymity without diminishing system performance during a teleconference or VoIP meeting. The anonymization system outputs a transformed speaker voice. The anonymization system can also generate a voice embedding that can be used to reconstruct the original speaker voice. The voice embedding can be encrypted and transmitted to another device. Sometimes, the voice embedding is not transmitted and the listener receives the anonymized voice. Systems and methods are provided for the detection of voice transformations in received audio. Thus, a listener can be informed whether the speaker voice output from the listener's computing device is the original speaker's voice or a transformed version of the original speaker voice.

To make various kinds of improvements and refinements to service robots.SOLUTION: A service robot according to the present invention is a service robot that can travel and provides various kinds of services to a user, and includes a speaker that outputs voice to the user, a receiver that outputs voice to the user and can also input user's voice, a storage location for storing the receiver, and a control unit that performs voice control on the speaker and the receiver.SELECTED DRAWING: Figure 1

The invention provides a self-media content streaming matching method and system based on dynamic semantic analysis, and the method comprises the steps: carrying out the dynamic semantic analysis of the text content of a voice stream of a creator, generating a semantic theme sequence, aligning the semantic theme sequence with an emotion fluctuation curve of the voice stream of the creator, and generating an emotion semantic incidence matrix; dividing a mapping relationship between an emotional intensity numerical range in the emotional fluctuation curve and a semantic topic type in the semantic topic sequence; performing behavior association fitting on the mapping relationship based on user historical feedback behavior data, and generating a dynamic association rule between the emotion intensity numerical range and the user feedback behavior; and adjusting a preset self-media content delivery strategy in real time, and generating an adjusted delivery strategy so as to carry out self-media content delivery stream matching. According to the method, the emotion semantic association matrix is constructed, accurate space-time matching of the content theme and the emotion expression is realized, and the target of adaptively optimizing the flow casting matching according to the real-time emotion state of the creator is achieved.

The invention relates to the technical field of dialogue robots, and provides a big language model dialogue robot-based data processing method and related equipment, and the method comprises the steps: carrying out the text conversion and vectorization processing of voice input content, and obtaining text data and vector representation; performing similarity retrieval on the vector representation and vector data in a preset vector database to obtain associated knowledge content; performing keyword and key demand screening on the text data to generate cue words, and inputting the associated knowledge content and cue words into a preset large language model to generate a natural language answer text; and converting the natural language answer text into voice information and outputting the voice information. Through the scheme, the understanding of the voice input content of the user and the generation of the natural language answer are realized, and the problems of time and labor consumption in knowledge base construction and mechanization of the dialogue content due to the fact that an existing dialogue robot extracts predefined content or pre-recorded text from a knowledge base to answer the user are solved.

The present invention relates to a communication system and method designed for patients in clinical settings who face challenges using standard communication devices. This system includes a mobile application and associated devices that establish a secure, asynchronous communication channel between clinicians, patients, and their support networks. Authorized users can record and send voice messages and other media, which are automatically played on the patient's device without requiring active operation. The system is tailored for ease of use, accommodating patients with severe physical or cognitive limitations through hands-free operation and simple commands. It adapts to the patient's condition, pausing messages during rest or medical procedures and resuming when appropriate. The system also features cross-linguistic messaging, translating and synthesizing voice messages across languages while maintaining the speaker's voice. Additional features include support for rich media, automatic transcription, and AI-driven content analysis. Secure, encrypted channels ensure privacy, complying with healthcare regulations. This invention enhances emotional connection and support for isolated patients, acting as a virtual visitation tool.

The invention provides a game assisting method and device.The method comprises the steps that in the process that a user plays a game, voice of the user is recognized, the voice is converted into a text, and a game image corresponding to the text is matched and recorded as a target game image; retrieving a preset game strategy knowledge base by utilizing the target game image to obtain target game strategy information; the target game image, the text and the target game strategy information are submitted to the large-scale multi-mode model for analysis, the instructive text is generated, the instructive text is synthesized into the voice and played, and a game assisting scheme which does not affect the game experience of the user in the game playing process of the user and efficiently and effectively guides the user is provided.

The invention discloses a user operation guiding method based on a digital person and an intelligent terminal, and the method comprises the steps: creating a navigation digital person with a plurality of preset images, and setting a first dynamic shape motion, a first dynamic facial expression and a navigation voice according to the images of the navigation digital person; obtaining voice information of a user, performing voice recognition and analysis on the voice information to obtain an analysis text, and extracting a service keyword according to the analysis text; matching a response text based on the business keyword, and obtaining response audio and lip shape time sequence data according to the response text; and setting a second dynamic facial expression and second dynamic shape data of the guide digital person based on the lip shape time sequence data, displaying the guide digital person through the intelligent service terminal, and playing response audio. According to the invention, the user is guided through the guide digital person, and the voice questions input by the user are answered by videos and audios, so that the intelligent degree of real estate business handling and the user experience are improved.

User authentication is an extremely important process in many applications and industries. Because of its importance, most security-sensitive user authentication processes employ an automatic multi-factor authentication process that involves confirming a SMS message, answering a security question, entering a PIN, etc. However, even these auto multi-factor authentication processes are vulnerable to attack and hack. For example, some facial recognition authentication processes can be defeated using a picture. Voice print can also be duplicated using a previous recording of the user's voice. As such, most financial institutions employ some form of human involvement (on top of multi-factor authentication) to authenticate a user for high security sensitive situations. The cost for performing authentication with human involvement can be very expensive. Accordingly, what is needed is an automatic multi-factor authentication process that is less prone to hack and workaround such as using a picture to defeat facial recognition processes.

The invention discloses an intelligent interaction system and method based on a far-field voice module, and relates to the technical field of voice recognizing.The system forms different processing feedback mechanisms according to different network states by capturing voice input signals of a user; recognizing and optimizing the preprocessed voice input signal in combination with an acoustic model and a language model to form a final processed text; starting a self-protection mechanism, and forming first response instruction data of a next period based on big data training; speculating second response instruction data forming a next period by using a period mode set by the system; and setting a storage space, and storing coincident response instruction data in the first response instruction data and the second response instruction data, thereby forming voice response prediction in an offline state, not only being capable of ensuring that purposeful voice interaction is realized in an offline environment and voice control is realized in a private environment, but also being capable of reducing storage for configuring offline voice, and improving the voice response prediction efficiency. And the portability of voice interaction is improved.

The invention relates to the technical field of voice recognition, in particular to an intelligent customer service voice interaction method and system based on voice recognition, and the method comprises the steps: collecting voice signals of a user in a voice instruction issuing process in a voice interaction scene in real time, and text data generated when the user interacts in a historical period, and forming a historical text set; dividing the voice signal into a plurality of signal segments; obtaining each instruction signal segment; obtaining a phoneme sequence corresponding to each instruction signal segment and all candidate texts corresponding to the phoneme sequence; calculating a matching degree and a semantic association degree of each vocabulary in each candidate text to obtain a candidate probability of each candidate text; and correcting the candidate probability to obtain a corrected candidate probability corresponding to each candidate text under each instruction signal segment, identifying a voice signal and performing voice interaction. According to the invention, the accuracy of voice recognition is improved, so that the intelligent customer service can more accurately understand and respond to the voice instruction of the user, and the accuracy of voice interaction is improved.

The embodiment of the invention provides a voice interaction method and device. The method can be applied to voice receiving equipment, and comprises the following steps: receiving a voice instruction of a user; determining a target regional space and a control instruction according to a target position in the voice instruction or indication information used for indicating the regional space in the voice instruction; sending area space information used for indicating the target area space and a voice instruction to the control equipment; receiving an execution result sent by the control equipment, wherein the execution result is a result that the controlled equipment executes the voice instruction control instruction; and providing feedback information according to the execution result. According to the method, when the user performs voice interaction with the household equipment, the household equipment in a certain specific area space expected to be controlled by the user can be controlled through a simple voice instruction.

The invention discloses an intelligent accompanying system and method based on semantic recognition, relates to the technical field of intelligent questions and answers, and solves the problem that an expected dredging effect cannot be achieved due to the fact that emotional changes and psychological needs of old people are often difficult to comprehensively capture in a traditional method. The method comprises the following steps: converting an acquired voice sample into a text form based on Paraformer voice recognition; constructing an emotional model and performing user emotion recognition based on the emotional model; emotional support strategies and voice output verbal skills are set, time, environment data and user emotions are collected in real time, and the corresponding emotional support strategies and voice output verbal skills are started; a sound copying technology of Ali cloud CosyVoice is adopted to simulate sound of relatives of a user to carry out voice output in a user interaction process. In a word, unprecedented care and support are provided for the elderly in the emotional level, and each elderly in a pension community can feel warmth and accompanying brought by science and technology.

The invention provides a voice dialogue interaction method and system for industrial equipment, and relates to the technical field of man-machine interaction, and the method comprises the following steps: obtaining a voice signal of a user, and carrying out the voice enhancement processing of the voice signal of the user through an incremental adaptive filtering algorithm, and obtaining an enhanced voice; according to the enhanced voice, using an information gain transfer learning method to identify an interaction intention of the user, and generating a to-be-interacted voice based on the interaction intention of the user; based on the enhanced voice, utilizing a time delay estimation method to identify an interaction position of the user, and performing position prediction on the position of the user; according to the position prediction result, an industrial equipment horn output strategy is constructed; and outputting the to-be-interacted voice based on the industrial equipment loudspeaker output strategy so as to realize voice dialogue interaction between the user and the industrial equipment. According to the invention, convenience, high efficiency and accuracy of interaction between the user and the equipment in an industrial scene are greatly improved, and intelligent development of industrial production is facilitated.