1182 results about "S Voice" patented technology

The invention provides a multi-mode-based man-machine interaction method and system, and relates to the technical field of man-machine interaction. Voice input of a user is received, environment information is collected, facial expressions of the user are captured, and voice features, environment features and facial features are obtained based on the input; utilizing a pre-trained emotion recognition model to generate emotion features of the user, and utilizing a pre-trained user behavior model to generate behavior features according to the current operation information of the user; after the features are obtained, the first weights and the second weights of the features are dynamically adjusted, feature weighted fusion is carried out, and comprehensive features are obtained; the multiple candidate responses are generated based on the comprehensive characteristics, the final response is screened out through a preset scoring mechanism and output, comprehensive understanding of the intention and the emotional state of the user is achieved through comprehensive utilization of multiple data sources, and meanwhile the weight of each characteristic can be dynamically adjusted so that more intelligent and humanized interaction experience can be generated.

A novel avatar-based conversational AI platform that integrates large language models (LLMs) with realistic avatar visualization is disclosed. The platform employs advanced AI technologies to create lifelike avatars capable of personalized and emotionally responsive communication with users. avatar creation tools enable users to generate unique avatar configurations, while animation machine learning subsystems automatically generate the avatar's speech, movements, and emotional responses in real-time. personality machine learning subsystems direct the avatar's voice, personality, and emotions, enhancing the realism of the interaction. The platform supports integration with third-party applications and provides comprehensive deployment and asset management tools. A two-way messaging architecture enables real-time interactions between avatars and users. Authorization and licensing controls protect intellectual property rights, while the avatar's personality dynamically evolves based on user interactions. By integrating LLMs, real-time animation, and emotional intelligence, the platform offers a groundbreaking solution for creating immersive and personalized conversational experiences across various applications.

The invention relates to the technical field of computer vision and human-computer interaction, and discloses an AI digital human intelligent interaction method, system and equipment based on multiple modalities, and the method comprises the steps: pre-awakening a digital human when a human face is detected, and further thoroughly awakening the digital human based on recognized preset voice information or preset gesture information; voice and video information of a user in the interaction process is obtained, a keyword extraction result, a gesture recognition result and an emotional state tag are generated, a pre-constructed knowledge base is utilized to retrieve related information, a big language generation model module is combined to generate an answer text, and the answer text is input into a preset voice synthesis model to generate emotional voice output. And based on the current emotional state label of the user, driving the digital human animation to be output in an emotional manner. According to the method and the system, the digital human for understanding the emotion of the user, generating personalized answers, providing voices with rich emotions and displaying natural expressions and actions can be created, better interaction with the user can be realized, and more humanized and effective services can be provided.

The invention provides a dynamic self-adaptive multi-modal sentiment analysis fusion method and system, and relates to the technical field of multi-modal sentiment analysis. The method comprises the following steps: synchronously acquiring voice, text, facial expression and limb movement data of a target user to form a multi-modal data set; the method comprises the following steps: firstly, extracting emotional characteristics of each mode, and constructing a cross-mode correlation model to capture a collaborative and complementary relationship among different modes; and calculating a real-time confidence score and a complementarity index of each modal based on the weight matrix of the cross-modal correlation model. Then, according to the scores and the indexes, a weighted average or maximum entropy algorithm is dynamically selected to fuse multi-modal emotion features, and a comprehensive emotion feature vector is generated; and finally, inputting the vector into a pre-training deep learning model, and outputting an emotional state category of the user. According to the method, the user emotion can be accurately and comprehensively captured, efficient emotion recognition and classification are realized, and the robustness and flexibility of an emotion analysis system in a complex scene are improved.

The invention belongs to the technical field of vehicle state detection and early warning, and particularly relates to a vehicle state monitoring and early warning method and system.The monitoring and early warning method comprises the steps that a sensor obtains real-time data, an anomaly detection algorithm is applied, and an abnormal event is marked; calculating an information priority according to the abnormal severity and the driving scene, and distributing the information priority to a high-priority queue; multi-mode early warning is generated, and high-frequency sound and vibration are used during high-speed driving; extracting a voice prompt, and generating voice waveform data through a voice synthesis module; voice input of a driver is recognized, intention is analyzed, and abnormal information feedback is provided; according to the scene and the abnormal state, interactive output is optimized, and detailed information is displayed during low-speed congestion; dynamically adjusting the interface of the instrument panel, and amplifying the key area in case of abnormal severity; and integrating the image data and the voice data, generating a multi-mode signal, and transmitting the multi-mode signal after rendering processing. The vehicle abnormal information can be timely and accurately transmitted to a driver, and the driving safety is effectively improved.

The embodiment of the invention provides a voice conversation method and system, electronic equipment, a storage medium and a program product. One method is implemented as follows: a voice dialogue stream (which can be an inquiry voice stream input by a user for a target commodity) of a user is subjected to streaming response, a plurality of dialogue text segments are generated in a segmented manner in the streaming response process, and the dialogue text segments are output in real time after being generated and stored in a first cache queue; and when it is detected that the reply text fragment is stored in the first cache queue, the stored reply text fragment is converted into a reply voice fragment in real time and played. The streaming response may be performed by an agent. Visibly, according to the response of the voice dialogue stream of the user, the dialogue is played while being generated, the waiting time from text to voice synthesis can be greatly shortened, and therefore the response time can be shortened.

The invention relates to the technical field of language learning, and discloses an English auxiliary pronunciation training method and system based on multi-task learning, and the method comprises the following steps: constructing a multi-task learning framework which comprises at least two subtask models related to pronunciation, comprising the steps of pronunciation accuracy scoring, pronunciation error type positioning and intonation fluency analysis. A voice signal, a lip movement video and a text content of a user are collected through a multi-modal data input module; and performing joint coding on the multi-modal data by using the shared feature extraction layer to generate fused acoustics. According to the English auxiliary pronunciation training method and system based on multi-task learning, the pronunciation training path of the user can be adaptively adjusted, the requirements of different users can be met, the English pronunciation level can be more effectively improved, and through strategies such as multi-modal data input, shared feature extraction, inter-task attention mechanism and adaptive training path adjustment, the English pronunciation training efficiency can be improved. Accurate evaluation and personalized training of English pronunciation are realized.

The invention provides a dynamic health monitoring system integrating artificial intelligence and wearable equipment and a method thereof, and relates to the field of health monitoring, and the method comprises the steps: collecting physiological parameters and environmental data of a user, eliminating time migration of multi-source data through a timestamp alignment technology, extracting dynamic coupling features of the physiological parameters and the environmental data, and obtaining a dynamic health monitoring result; and generating the health state characterization guided by the environment. The method comprises the following steps: synchronously acquiring user voice input information, and extracting and analyzing acoustic features to generate emotional state change features after performing Mel spectrum conversion; then, cross-modal semantic association between emotions and health states is established through a modal soft constraint mechanism, and personalized guidance suggestions are generated and displayed, so that the dynamic perception ability of health state assessment and the scene adaptability of suggestion generation are improved; therefore, the problems of environmental factor splitting, subjective and objective data isolation and insufficient dynamic nonlinear relation modeling in a traditional method are solved.

The invention provides a digital human real-time question-answering method, system and device for intelligent emotion interaction and a medium, and the method comprises the steps: capturing identity information, facial expressions and the like of different figures through face recognition and face attribute analysis, and obtaining an instruction and emotion of a user based on voice recognition and voice emotion analysis; information such as instructions, identities and emotions of a user is fused through a large language model to output appropriate answers, multi-round question answering can be conducted on associated question association contexts, meanwhile, appropriate emotions are given to the answers of the large model in combination with context analysis and emotion analysis, and what expressions and actions are inserted at a certain time are calculated; performing speech synthesis by using proper emotion, and realizing matching of audio and digital population types by using a mouth shape generation algorithm; and finally, generating expressions and actions at proper opportunities in combination with contexts and emotions while broadcasting the voice of the digital person. According to the method, high-simulation digital human real-time question answering with high intelligent emotion interaction can be realized.

An automatic online voice translation system and method, comprising a virtual translator, a SIP gateway, and a storage, wherein the SIP gateway receives a call from a caller, when the virtual translator is not activated, the SIP gateway establishes a communication between the caller and the agent by streaming in real-time caller's voice directly to the agent and agent's voice directly to the caller, and when the virtual translator is activated, the SIP gateway creates audio files based on the received voice streams of both the caller and the agent, and sends the created audio files to the virtual translator for translating the caller's voice into a language understood by the agent, before transmitting the voice to the agent. In another embodiment, a contact center platform is used for applying features such as call recording, Interactive Voice Response (IVR) service, and conferencing service to the call.

The embodiment of the invention provides a dialogue interaction state recognition method and system, electronic equipment and a storage medium, and relates to the technical field of voice interaction, and the method comprises the steps: extracting time sequence features and semantic features from obtained voice information; the time sequence feature represents the rhythm change condition of the user in the dialogue process, and the semantic feature represents the voice content and the voice intensity of the user in the dialogue process; recognizing the current dialogue interaction state of the user according to the time sequence features and the semantic features; the dialogue interaction state comprises one of a silent state, an interrupted state and a hesitant state. Therefore, the conversation interaction state of the user is recognized by combining the time sequence features and the semantic features, voice signal level analysis is considered, and changes of voice rhythm, voice content and voice intensity are also considered, so that the conversation interaction state of the user is accurately recognized, and the recognition precision of complex interaction states such as hesitation and interruption is improved.

The invention relates to the technical field of vehicles, in particular to a vehicle voice control method and device, a vehicle and a storage medium, and the method comprises the steps: collecting voice information of at least one driver and passenger in a vehicle cabin; performing message text rewriting on the voice information by using the user vehicle control intention recognition model to obtain a rewritten message text; based on an information retrieval enhancement technology, determining a target similarity text of the rewritten message text, inputting the rewritten message text and the target similarity text into a user vehicle control intention recognition model to recognize a voice control intention of a driver and a passenger, and generating a voice control instruction of a vehicle according to the voice control intention, and executing a control action corresponding to the voice control instruction. Therefore, the problems that in the related technology, due to the fact that a large number of rules and a large number of mapping functions are written, voice recognition is limited, due to too many rules, voice recognition is disordered, and the accuracy and intelligence of vehicle voice control are reduced are solved.

The present disclosure provides a system and a method for voice based authentication, which involves receiving voice data of a user enunciating a predetermined sequence of speech elements, with the predetermined sequence of speech elements is configured to capture a defined range of voiced sounds produced by the user; extracting voice features from the received voice data; deriving a voice signature for the user based on the extracted voice features, wherein the voice signature is representative of at least one of tonal, timbral, and temporal characteristics of the user's voiced speech; storing the derived voice signature in a database; receiving a verification voice sample of the user enunciating a predetermined sub-set of speech elements; comparing the verification voice sample with the stored voice signature; and authenticating the user based on the comparison.

The invention discloses an intelligent accompanying method and an emotion monitoring device, which are applied to an emotion monitoring intelligent bed, and the method comprises the steps: obtaining emotion data of a user, the emotion data comprising voice features, expression features and posture change features; judging different emotion data to obtain different emotional states, and obtaining a target emotional state of the user according to the different emotional states and preset weight information of the different emotional states; when the target emotional state is an abnormal state, sending out a first feedback signal; and according to the first feedback signal, guiding the user to perform voice interaction through a semantic analysis model, and outputting an audio reply corresponding to the user voice information. According to the method, the emotion state of the user can be detected and fed back in real time, the emotion of the user is adjusted in a voice dialogue communication mode, and the nursing quality of the user is improved.

The present invention relates to the technical field of intelligent voice customer service response, and a water service intelligent voice customer service response method and system based on AI, including: obtaining a plurality of users, and performing the following operations on each user among the plurality of users: obtaining the user's voice, performing voice signal processing on the user's voice to obtain user voice features, retrieving matching voice features, detecting the feature similarity between the user voice features and the matching voice features, constructing a water service knowledge graph, obtaining inquiry information voice and encrypted user data, obtaining updated voice, using the updated voice as the user's voice, returning to the step of performing voice signal processing on the user's voice, obtaining the number of inquiries of the inquiry information voice, updating the water service voice database to obtain an optimized water service voice database, and completing the water service intelligent voice customer service response based on AI based on the encrypted user data set and the optimized water service voice database. The present invention can improve the efficiency and quality of water service customer service and enhance the user experience.

The invention discloses an intelligent blind guiding glasses system based on a multi-mode large language model. The intelligent blind guiding glasses system comprises an image acquisition module, a voice acquisition module, a large language model module, a bone conduction sound transmission module, a navigation path planning module, a central processor module and a wireless communication module, the image acquisition module is used for acquiring a three-dimensional image of a front scene and providing three-dimensional space information; the voice acquisition module is used for acquiring a voice instruction of a user; the big language model module is used for generating character answers and converting the character answers into voice according to the voice instruction of the user by utilizing a big language model; the bone conduction sound transmission module is used for receiving and playing the voice generated by the large language model module; the navigation path planning module is used for planning a navigation path according to the user position and the destination; the functions of navigation positioning, line guiding, voice prompting and the like are provided for the blind, the glasses are adopted as a carrier, carrying is convenient, voice awakening and other instructions are adopted to replace keys, operation is easy, and practicability is high.

The invention discloses a user personalized content recommendation processing method and device based on sound listening and person recognition. The method comprises the steps that collected sound information of a user in front of a smart television is recognized; when the user identity corresponding to the current sound information is identified as a new user, creating a new virtual user account; when the user identity corresponding to the current sound information is identified as the user with the existing user portrait, calling out personalized content or service corresponding to the user with the existing user portrait for first recommendation display; in the first recommendation display process, sound information of the current user is continuously collected, and the emotion of the current user is recognized; and further screening and filtering the content of the first recommendation display to obtain personalized content or service second recommendation display matched with the emotion of the current user. According to the invention, a new function is added to the smart television, and accurate recognition of different family members is realized through voice voiceprint recognition and mood recognition, so that contents and services more conforming to preferences are provided for the family members.

Systems and methods for annotating, also known as tagging, visually identifiable objects using natural language (i.e. spoken voice) are provided. More specifically, but not exclusively, this disclosure relates to systems and methods for tagging identified objects related to underground utilities and assets, and communication systems. Once tagged, data representing identified objects can be stored, transmitted, and / or mapped. In an exemplary embodiment, a utility service worker or other personnel may walk or drive around an area of interest using utility locating equipment or systems to collect data. As data is being collected, the user may visually identify utility related or other items using a laser pointer, and then use their voice to tag items of interest. A headset including a microphone may be provided for capturing the user's voice. Hardware and / or software may be provided for processing tagged items, and relating them to a specific location, and / or utility asset.

The invention relates to the technical field of intelligent recognition, in particular to a multi-model hierarchy-based user intention classification method and device, a vehicle and a medium, and the method comprises the steps: obtaining a voice instruction of a user; decoding and converting the voice instruction into text data, inputting the text data into a pre-constructed intention classification model to obtain a matching result, and recognizing the user intention through a plurality of model layers in the intention classification model based on a confidence interval of the matching result to obtain a user intention recognition result; the target control instruction is determined according to the user intention recognition result, the vehicle is controlled to execute the corresponding operation according to the target control instruction, and the operation result is fed back, so that the problems of low user intention recognition speed and low user intention recognition accuracy in related technologies are solved, the user intention recognition speed is increased, and the user intention recognition efficiency is improved. And the accuracy of user intention recognition is improved.

The invention relates to the technical field of speech recognition, and particularly provides a multi-mode speech processing method and device, a medium and a computer program product. The multi-mode voice processing method comprises the following steps: acquiring to-be-processed audio and video data, and performing data separation processing on the to-be-processed audio and video data to obtain original audio data and original video data; performing face detection processing on the original video data to obtain initial video data; performing audio detection processing on the original audio data to obtain initial audio data; and performing consistency detection processing on the initial video data and the initial audio data, and outputting target audio data and target video data under the condition that a consistency verification condition is met. The face in the video is recognized through face detection, noise and sound of the target speaker are recognized and separated through audio detection, and synchronization and matching of audio and video data in time and content are ensured through consistency detection, so that development of a multi-mode voice separation task is supported.

The invention belongs to the technical field of artificial intelligence, and particularly relates to a real-time voice interaction and adaptive content generation system based on RTC and AI GC, which comprises the steps of capturing voice input of a user through a microphone of equipment, and converting the voice input into text information by using a voice recognition technology; the recognized text input is transmitted to a natural language understanding module, semantic analysis is carried out, and user intention and information are recognized; according to the intention and demand of the user, the AI GC technology is used for dynamically generating personalized content; and the generated content is optimized in real time according to the feedback in interaction, the demand change of the user is adapted, the generated text content is converted into voice to be output and provided for the user, and the effects of meeting the demands of different types of users and promoting real-time interactive propagation and automatic content generation are achieved.

The invention provides a voice barrier analysis method and system based on voice information, a medium and equipment. The method comprises the following steps: S1, acquiring voice to obtain user voice; s2, performing voice definition analysis on the user voice to obtain a word error rate; s3, if the error word rate is lower than a preset threshold value, determining that the voice definition is normal, and performing voice feature extraction preparation on the user voice to obtain a Mel-cepstrum coefficient; if the wrong word rate is higher than the preset threshold value, judging that the result is language barrier, and entering S5; s4, inputting the Mel-cepstrum coefficient into the trained language barrier classification model to obtain a judgment result of the voice fluency; if the judgment result of the voice fluency is smooth, the judgment result is normal; otherwise, the judgment result is language barrier; and S5, performing result feedback and interaction on a judgment result. According to the method, the speech recognition technology and the convolutional neural network trained by the pronunciation disorder data set are adopted, and the purpose of analyzing the speech clarity and fluency of the user is achieved.

The invention relates to a voice control ultrasonic wave adjustment setting method based on a CTC-Attention mixed architecture, and the method comprises the following steps: S1, receiving a voice instruction of a doctor through a voice receiving device, and carrying out the preprocessing of an original voice signal; s2, constructing an acoustic model of a CTC-Attention hybrid architecture, and training the acoustic model to obtain a trained acoustic model; s3, inputting the preprocessed voice signal into the trained acoustic model, and performing voice recognition through CTC path probability alignment and Attention context dependence joint optimization; s4, outputting an identification result and decoding the identification result into a text instruction; and S5, analyzing the operation intention according to the text instruction, and controlling the ultrasonic instrument to execute a corresponding state adjustment operation. According to the method, the voice signal of the operator is received, the voice signal is recognized and analyzed, the obtained result is optimized and then converted into the character content with the meaning, then the ultrasonic energy with the intensity corresponding to the character content is generated by the ultrasonic instrument based on the character content, and the ultrasonic instrument is effectively used for medical operation.

Voice anonymization systems and methods are provided. Voice anonymization is done on the speaker's computing device and can prevent voice theft. The voice anonymization systems and methods are lightweight and run efficiently in real time on a computing device, allowing for speaker anonymity without diminishing system performance during a teleconference or VoIP meeting. The anonymization system outputs a transformed speaker voice. The anonymization system can also generate a voice embedding that can be used to reconstruct the original speaker voice. The voice embedding can be encrypted and transmitted to another device. Sometimes, the voice embedding is not transmitted and the listener receives the anonymized voice. Systems and methods are provided for the detection of voice transformations in received audio. Thus, a listener can be informed whether the speaker voice output from the listener's computing device is the original speaker's voice or a transformed version of the original speaker voice.

To make various kinds of improvements and refinements to service robots.SOLUTION: A service robot according to the present invention is a service robot that can travel and provides various kinds of services to a user, and includes a speaker that outputs voice to the user, a receiver that outputs voice to the user and can also input user's voice, a storage location for storing the receiver, and a control unit that performs voice control on the speaker and the receiver.SELECTED DRAWING: Figure 1

The invention provides a self-media content streaming matching method and system based on dynamic semantic analysis, and the method comprises the steps: carrying out the dynamic semantic analysis of the text content of a voice stream of a creator, generating a semantic theme sequence, aligning the semantic theme sequence with an emotion fluctuation curve of the voice stream of the creator, and generating an emotion semantic incidence matrix; dividing a mapping relationship between an emotional intensity numerical range in the emotional fluctuation curve and a semantic topic type in the semantic topic sequence; performing behavior association fitting on the mapping relationship based on user historical feedback behavior data, and generating a dynamic association rule between the emotion intensity numerical range and the user feedback behavior; and adjusting a preset self-media content delivery strategy in real time, and generating an adjusted delivery strategy so as to carry out self-media content delivery stream matching. According to the method, the emotion semantic association matrix is constructed, accurate space-time matching of the content theme and the emotion expression is realized, and the target of adaptively optimizing the flow casting matching according to the real-time emotion state of the creator is achieved.

The invention relates to the technical field of dialogue robots, and provides a big language model dialogue robot-based data processing method and related equipment, and the method comprises the steps: carrying out the text conversion and vectorization processing of voice input content, and obtaining text data and vector representation; performing similarity retrieval on the vector representation and vector data in a preset vector database to obtain associated knowledge content; performing keyword and key demand screening on the text data to generate cue words, and inputting the associated knowledge content and cue words into a preset large language model to generate a natural language answer text; and converting the natural language answer text into voice information and outputting the voice information. Through the scheme, the understanding of the voice input content of the user and the generation of the natural language answer are realized, and the problems of time and labor consumption in knowledge base construction and mechanization of the dialogue content due to the fact that an existing dialogue robot extracts predefined content or pre-recorded text from a knowledge base to answer the user are solved.

The present invention relates to a communication system and method designed for patients in clinical settings who face challenges using standard communication devices. This system includes a mobile application and associated devices that establish a secure, asynchronous communication channel between clinicians, patients, and their support networks. Authorized users can record and send voice messages and other media, which are automatically played on the patient's device without requiring active operation. The system is tailored for ease of use, accommodating patients with severe physical or cognitive limitations through hands-free operation and simple commands. It adapts to the patient's condition, pausing messages during rest or medical procedures and resuming when appropriate. The system also features cross-linguistic messaging, translating and synthesizing voice messages across languages while maintaining the speaker's voice. Additional features include support for rich media, automatic transcription, and AI-driven content analysis. Secure, encrypted channels ensure privacy, complying with healthcare regulations. This invention enhances emotional connection and support for isolated patients, acting as a virtual visitation tool.

The invention provides a game assisting method and device.The method comprises the steps that in the process that a user plays a game, voice of the user is recognized, the voice is converted into a text, and a game image corresponding to the text is matched and recorded as a target game image; retrieving a preset game strategy knowledge base by utilizing the target game image to obtain target game strategy information; the target game image, the text and the target game strategy information are submitted to the large-scale multi-mode model for analysis, the instructive text is generated, the instructive text is synthesized into the voice and played, and a game assisting scheme which does not affect the game experience of the user in the game playing process of the user and efficiently and effectively guides the user is provided.

The invention discloses a user operation guiding method based on a digital person and an intelligent terminal, and the method comprises the steps: creating a navigation digital person with a plurality of preset images, and setting a first dynamic shape motion, a first dynamic facial expression and a navigation voice according to the images of the navigation digital person; obtaining voice information of a user, performing voice recognition and analysis on the voice information to obtain an analysis text, and extracting a service keyword according to the analysis text; matching a response text based on the business keyword, and obtaining response audio and lip shape time sequence data according to the response text; and setting a second dynamic facial expression and second dynamic shape data of the guide digital person based on the lip shape time sequence data, displaying the guide digital person through the intelligent service terminal, and playing response audio. According to the invention, the user is guided through the guide digital person, and the voice questions input by the user are answered by videos and audios, so that the intelligent degree of real estate business handling and the user experience are improved.