124 results about "Conversational speech" patented technology

The invention relates to the field of voice signal processing, and discloses a multi-level labeling method and device in a dialogue scene. Through the endpoint detection and automatic speech recognition method of the dialogue audio data, noise and mute in real speech can be removed, and effective speech segments can be obtained. And carrying out clustering analysis based on the effective voice segments, obtaining target voice segments and text data of the corresponding speakers, and carrying out emotion feature extraction through multi-modal emotion analysis. And finally, realizing automatic annotation of the inquiry strategy or intention understanding of the corresponding speaker by utilizing a large language model. According to the method, the recorded conversation voice can be subjected to multi-level labeling, an efficient and accurate information management and analysis tool is provided for a conversation scene, and the arrangement efficiency of conversation records can be greatly improved. The annotation information can be used for training and improving an artificial intelligence system, so that the artificial intelligence system plays a greater role in future psychological consultation service, and the overall quality and efficiency of psychological health service are improved.

The invention relates to the technical field of voice processing, can be applied to business scenes such as financial science and technology and medical health, and discloses a multi-speaker dialogue voice analysis method, device and equipment and a medium, and the method comprises the steps: obtaining a to-be-analyzed multi-speaker dialogue voice, determining a naturalness score based on an acoustic feature, and obtaining a multi-speaker dialogue voice analysis result; determining a semantic consistency score based on voice embedding and semantic embedding corresponding to a preset text, determining a speaker consistency score based on embedding of a plurality of speakers of the same speaker, determining an interaction rationality score based on voice alternate overlapping duration, determining a diversity score based on a variance of voice features, and fusing the scores, the comprehensive mass fraction is obtained. According to the invention, through quantitative evaluation of five dimensions of naturalness, semantic consistency, speaker consistency, interaction rationality and diversity, a comprehensive quality scoring system is established, so that the evaluation result simultaneously reflects voice fluency, content matching degree, identity stability, interaction rhythm rationality and feature richness.

The invention provides a voice quality inspection method and device, electronic equipment and a computer readable storage medium, relates to the technical field of artificial intelligence, and is suitable for the field of financial science and technology. The method comprises the following steps: acquiring target dialogue voice; performing text conversion on the target dialogue voice to obtain a target dialogue text; performing semantic division on the target dialogue text to obtain target semantic blocks and semantic block categories; performing information search on a preset knowledge graph according to the target semantic block to obtain an entity triple text; reading sentences in a preset semantic sentence database according to the semantic block categories to obtain standard semantic sentences; performing text fusion according to the semantic block category, the standard semantic sentence, the target semantic block and the entity triple text to obtain a target quality inspection prompt text; and performing quality inspection on the target quality inspection prompt text to obtain a voice quality inspection result. According to the embodiment of the invention, the voice quality inspection accuracy can be improved.

Disclosed is a system and method for standalone automated patient referral management. The system comprises an intake module that accepts and processes referrals from diverse referral communication channels as entry points for patient referrals. A processing module undertakes the analysis of patient information to pinpoint a healthcare provider based on a healthcare need, a preference, and a schedule availability. A scheduling module confirms the appointment, and engages in dynamic three-way communication between the patient, the referring entity, and the healthcare provider. A feedback module dispatches feedback to the referring entity, offering a report on an outcome of the appointment. A natural language processing (NLP) module extracts information from conversational speech. The system utilizes algorithms to match patients with the healthcare providers based on criteria including specialty, availability, and patient preferences. A feedback module communicates with the originating EHR systems and provides updates to maintain continuity of care.

The invention discloses a digital human personalized shaping method and device based on user psychology and a medium. The method comprises the following steps: acquiring multi-modal data when a user interacts with a digital human; based on the multi-modal data, according to the style preference of the user, establishing a psychological feature model through an adaptive learning mode; dialogue voice of the digital person is generated according to the psychological feature model, and matched facial expressions and limb actions of the digital person are generated according to the dialogue voice and the psychological features of the user. According to the digital human personalized shaping method and device based on the psychology of the user and the medium, the psychological feature model is established based on the style preference of the user, and the interaction content matched with the conversation voice, the facial expression and the body movement is generated, so that the digital human can show more real and natural personalized behaviors, and the user experience is improved. The problem that it is difficult to carry out personalized behavior shaping on the digital human according to psychological characteristics and interaction preferences of the user can be solved.

The invention discloses a double-earphone sound effect adjusting method and system, a storage medium and a program product, and relates to the field of loudspeakers, and the method comprises the steps: collecting an environment audio signal through a binaural microphone, and executing spectrum analysis to obtain a frequency distribution characteristic of the environment audio signal; based on a preset human voice frequency range, extracting an audio signal conforming to the human voice feature from the frequency distribution feature as a target audio; calculating the time difference and the intensity difference of the target audio between the left ear and the right ear to obtain the human sound source direction and the relative distance in the environment; acquiring head attitude sensor data, and calculating a matching included angle between the head orientation of the user and the human sound source direction based on the head attitude sensor data; when the matching included angle is smaller than a preset threshold value, increasing the audio signal gain of the head facing the direction; and when the conversation voice of the user is detected, the audio signal gain is kept unchanged. By implementing the application, the interaction efficiency when the double earphones are used can be improved.

The invention relates to the technical field of sentiment analysis, in particular to a sentiment analysis method and system. The sentiment analysis method comprises the steps of collecting a dialogue voice signal, extracting an acoustic feature and a semantic feature from the dialogue voice signal, performing double-flow extraction of the acoustic feature and the semantic feature on the collected dialogue voice signal, performing normalization on the acoustic feature and the semantic feature respectively, and performing sentiment analysis on the acquired dialogue voice signal. The normalized acoustic features and semantic features are spliced to form a joint feature vector, the joint feature vector is mapped into a high-dimensional intermediate emotion vector through linear transformation, controllable Laplace noise is added to the intermediate emotion vector, and the intermediate emotion vector is mapped into a high-dimensional intermediate emotion vector; and outputting an encrypted intermediate emotion vector, inputting the encrypted intermediate emotion vector into a pre-trained emotion analysis neural network, outputting a nine-dimensional emotion vector spectrum, and generating visual feedback on a local device by using the nine-dimensional emotion vector spectrum. According to the invention, emotion understanding and communication optimization in a dialogue scene are greatly improved.

Frameworks, interfaces and configurable data structures are disclosed that enable programs to execute speech-enabled conversational interactions and processes with their users. In accordance with one or more examples, a method includes, at an electronic device with one or more processors and memory: providing a program the capability to conduct speech-enabled conversational interactions with a user; loading, interpreting and processing configurable structured data which drive the execution of speech-enabled interactions between a program and a user; listening to and processing real time events and requests from a program, electronic device or other programs executing on the device; and, making real-time adaptations to conversational interactions. A program executing on an electronic device and using the invention frameworks and interfaces, specifies, and without limitation: the configured data structures for the frameworks in the invention to process; and a plurality of conversational speech capabilities to request from the frameworks of the invention.

The embodiment of the present application discloses a conversation processing method, device, terminal and storage medium based on emotion recognition. In the process of communication between an agent and a customer based on a business scenario, this solution collects the customer's first voice information and the agent's second voice information, identifies the customer's emotion based on the first voice information, and if the customer's emotion is negative, generates a conversation voice based on the first voice information and the second voice information according to the time point when the customer's negative emotion appears, then performs voice analysis on the conversation voice to obtain a voice analysis result, and performs text analysis on the conversation voice to obtain a text analysis result, and generates customer soothing strategy information based on the voice analysis result and the text analysis result, so that the agent can soothe the customer's emotion according to the customer soothing strategy information, thereby improving the customer's business experience.

The invention provides a personality prediction method and device based on voice conversation, electronic equipment and a medium. The method comprises the following steps: acquiring conversation voice information between a to-be-predicted user and an intelligent agent; extracting a target dialogue feature and a dialogue log of the to-be-predicted user from the dialogue voice information; according to the dialogue log and the target dialogue feature, updating the dialogue log and dialogue summary information of the to-be-predicted user; based on the fused target dialogue features, the updated dialogue log and the dialogue summary information, obtaining at least one prediction label of the to-be-predicted user; and inputting the user standardized text description information obtained based on the at least one prediction label fusion into a pre-trained large language model, so that the large language model outputs a personality prediction result of the user to be predicted. Therefore, the accuracy of personality prediction of the to-be-predicted user can be improved.

The invention relates to the technical field of intelligent robots, in particular to a robot self-adaptive interaction method and system. The robot adaptive interaction system comprises a voice data acquisition module, a dialogue voice data construction module and a dialogue text generation model updating module. In the interaction process of the robot and the person, the voice data of the user is obtained, the text data converted from the voice data is processed through the dialogue text generation model, the dialogue text data used for constructing the dialogue voice data is generated, the robot replies based on the dialogue voice data, interaction of the robot is achieved, and the interaction efficiency of the robot is improved. In the dialogue text generation model, semantic feature vectors are extracted based on the speaking style of the user, and the semantic feature vectors are further updated through multiple rounds of dialogues, so that dialogue text data generated through the text data and the standard semantic feature vectors can conform to the speaking habits of the user; and the experience of the user during interaction is improved.

The invention provides a service demand analysis method and device and a computer readable storage medium, and the method comprises the steps: obtaining all dialogue voice data discussed by a service demand, and converting all dialogue voice data into corresponding dialogue text documents; generating a preliminary demand document based on all dialogue text documents; performing information extraction on the preliminary demand document by using a big and small language model according to a set demand template to obtain specific information, and filling the specific information to a position corresponding to the set demand template to obtain a demand document; and performing function point analysis on the demand document by using the big and small language models to generate a function demand specification. The problem that in the prior art, work such as collection and summarization, key point extraction, induction analysis and content checking of massive multi-source heterogeneous original documents consumes a large amount of time cost is solved.

The invention discloses an immersive psychotherapy VR system based on dialogue real-time generation, and the system comprises a voice recognition module which is used for collecting dialogue voice in a consultation process, and transcribing the dialogue voice into a text in real time; the natural language processing module is used for performing semantic understanding on the transcribed dialogue text and extracting scene elements; the scene generation module is used for dynamically generating a corresponding three-dimensional virtual scene according to the scene elements and adjusting scene details in real time along with updating of the dialogue content; the graphic rendering module is used for rendering the three-dimensional virtual scene in real time and then outputting the three-dimensional virtual scene to the VR equipment; and the user interaction module is used for realizing interaction operation among the patient, the therapist and the system. According to the invention, a modular system architecture is adopted, technologies such as speech recognition, large language model understanding, three-dimensional scene generation and graphic rendering are organically combined, and real-time conversion from dialogue content to a virtual scene is realized.

A noise canceling disablement system is provided to enables a user to hear select conversational speech directed at the user while wearing a noise cancelling hearable device. The disablement system automatically at least partial disables the noise canceling feature of the hearable device in response to recognizing conversational speech of a speaking person within a detected conversation zone of the user. In some cases, triggering of the noise canceling disablement further requires the speaking person to be identified by the system as significant person of the user.

The invention relates to television equipment and a session processing method. Wherein the television device comprises: a display component; a remote control signal receiving assembly; an audio output component; a network communication device; a voice acquisition assembly; the controller is configured to perform voiceprint recognition on the voice of the current user to determine a voiceprint identifier corresponding to the current user, and display a voice text; extracting user feature information from the knowledge graph based on the voiceprint identifier; obtaining a dialogue text based on a generative model in a first server of the user feature information; dialogue voice data are acquired; and displaying the dialogue text through the first interface, outputting the dialogue voice data through the audio output component, and driving a preset digital human image to make an action corresponding to the dialogue voice data through the digital human driving system. The television equipment and the session processing method can provide a non-Chinese voice dialogue function with better quality.

The invention discloses a dialogue voice generation method and system based on an emotion perception adapter and large model reasoning. The dialogue voice generation method adopted by the invention comprises the following steps: extracting voice emotion characteristics in original dialogue voice data by using a voice encoder and a time and hierarchical attention network; aligning the speech emotion features with text features of the large language model through an emotion perception coding module based on a query converter network, and generating emotion embedding compatible with the large language model; generating text embedding from statements of the input dialogue text by using a word segmentation device of a large language model; performing emotion embedding and text embedding by adopting an emotion adapter and a text adapter based on a partial low-rank adaptive network, and reasoning a text reply and a reply emotion state of the dialogue; and in combination with the text reply and the reply emotional state, generating a target voice conforming to an emotional context by using a voice generation model. According to the invention, the difference between the emotion and the text is effectively reduced, and the target voice with emotion consistency is generated.

The invention discloses a medical record generation method, a related device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the voice recognition based on the doctor-patient conversation voice in an inquiry process, and obtaining a doctor-patient conversation text; performing information extraction based on the doctor-patient dialogue text to obtain a time information element, a medical event corresponding to a time interval and a spatial information element; constructing a symptom evolution time sequence chain based on the time information element and the medical event corresponding to the time interval, and constructing a symptom spatial map based on the spatial information element; performing feature extraction based on the symptom evolution time sequence chain to obtain a first feature, performing feature extraction based on the symptom space map to obtain a second feature, and performing feature extraction based on the doctor-patient dialogue text to obtain a third feature; and generating an electronic medical record text based on a fusion feature of the first feature, the second feature and the third feature. According to the scheme, dynamic information of disease evolution can be reflected in medical record generation.

The invention discloses a data output method and system based on timbre and emotion simulation, and relates to the technical field of data processing, and the method comprises the steps: receiving role playing data and timbre data, carrying out the preprocessing of the role playing data and the timbre data, and obtaining a role playing data set and a timbre data set; inputting the role playing data set into a pre-established lama3 model for training, outputting to obtain a role playing model, inputting the tone data set into a pre-established GPT-SoVITS model for training, and outputting to obtain a tone model; real-time dialogue voice data of the user are obtained, noise removal processing is carried out on the real-time dialogue voice data of the user, phoneme and Chinese character conversion is carried out on the processed real-time dialogue voice data of the user based on a CTC greedy search algorithm, and a recognition text is obtained; the recognition text is input into a pre-established word segmentation model, a parameter file is obtained through a sub-word marking strategy and a byte pair coding method, the recognition text is sliced, the sliced text is input into a lama3 model, prediction is conducted in combination with the parameter file, and a prediction text is obtained through output; and inputting the predicted text into the timbre model to obtain a voice output result, and returning the voice output result to the user.

The voice quality inspection method and device, the electronic equipment and the computer readable storage medium provided in the application are related to the artificial intelligence technical field and are suitable for the financial technology field. The method comprises the following steps: obtaining target conversation voice; performing text conversion on the target conversation voice to obtain target conversation text; performing semantic division on the target conversation text to obtain target semantic blocks and semantic block categories; performing information searching on a preset knowledge graph according to the target semantic blocks to obtain entity triple text; performing sentence reading on a preset semantic sentence database according to the semantic block categories to obtain standard semantic sentences; performing text fusion according to the semantic block categories, the standard semantic sentences, the target semantic blocks and the entity triple text to obtain target quality inspection prompt text; and performing quality inspection on the target quality inspection prompt text to obtain a voice quality inspection result. The application embodiment can improve the voice quality inspection accuracy.

The embodiment of the invention belongs to the technical field of financial science and technology, is applied to an identity verification scene of both parties of a claim settlement service dialogue, and relates to an identity verification method, device and equipment and a storage medium thereof. Carrying out merging processing to obtain merged voices corresponding to all the voice objects respectively; according to the combined voice, performing identity category prediction on all the voice objects to obtain an identity category prediction result; and performing identity authenticity verification on all the voice objects in combination with the identity category prediction result to obtain a verification result. The identity verification method is applied to a financial claim settlement service dialogue two-party identity verification scene, especially during insurance claim settlement, an artificial intelligence prediction model mode is adopted firstly, the identities of customer service and customers are predicted in combination with dialogue voices of the two parties, and then identity authenticity verification is carried out in combination with an identity prediction result; the security of the financial claim settlement service is ensured, and the risk control of the claim settlement service is improved.

The invention discloses a multi-round dialogue state tracking system for an intelligent follow-up voice robot. The multi-round dialogue state tracking system comprises a hierarchical semantic state decoder module, a context disambiguation state optimization model module, an intention evolution state tracking algorithm module, a follow-up dialogue streaming analysis platform, a multi-round dialogue state storage module and a robot interaction control module. The modules work cooperatively, dialogue voice signals are analyzed through the decoder to output semantic features, the semantic features are processed through the disambiguation model, an intention evolution trajectory is constructed through a tracking algorithm, dialogue state features are extracted through the streaming analysis platform, the storage module stores data in a classified mode and supports the calling and control module to generate interaction signals. The system can deeply integrate semantic processing and historical data, meanwhile, efficient cooperation of state tracking and data management is achieved through bidirectional interaction of modules, tracking deviation and lag are eliminated, follow-up conversation interaction coherence and information accuracy are guaranteed, the intelligent requirement of medical follow-up is met, and the follow-up working efficiency is improved.

A noise canceling disablement system is provided to enable a user to hear select conversational speech directed at the user while wearing a noise cancelling hearable device. The disablement system automatically at least partially disables the noise canceling feature of the hearable device in response to recognizing conversational speech of a speaking person within a detected conversation zone of the user. In some cases, triggering of the noise canceling disablement further requires the speaking person to be identified by the system as a significant person of the user.

To provide a voice data analysis apparatus configured to accurately analyze voice of a store clerk while reducing the influence of noise.SOLUTION: A voice data analysis apparatus 1 includes: a conversation sound data acquisition unit (device attachment / detachment unit 13, control unit 23 and communication unit 27) for acquiring conversation sound data generated by recording voice of conversation; a conversation text generation unit (control unit 23) which generates conversation text data which is text data of the content of conversation included in the conversation sound data; and a conversation content analysis unit (control unit 23) which analyzes, using the conversation text data, the content of conversation to obtain an analytical result.SELECTED DRAWING: Figure 1

The invention relates to the technical field of artificial intelligence, the scheme can be applied to the fields of finance and medical treatment, and the invention provides a dialogue voice generation method, device and equipment and a medium, and the method comprises the steps: converting an input text abstract into a dialogue type text structure with a multi-role interaction feature through a large language model; distributing a unique label feature for each proxy role in the dialogue text structure; automatically matching acoustic characteristic parameters conforming to the agent roles from a preset voice library according to the label characteristics; and converting the dialogue text structure into dialogue voice through a voice synthesis model according to the acoustic characteristic parameters of each agent role, and outputting the dialogue voice. According to the embodiment of the invention, the input text abstract can be converted into the dialogue type text structure with the multi-role interaction characteristic, the requirements of audiences for deep discussion and professional insight are met, and the dialogue type text structure can be converted into dialogue voice with content depth and expressive force according to the acoustic characteristic parameter of each agent role.

This invention discloses a speech prosody recognition method, system, device, and storage medium. First, the voice from a customer service call is captured to obtain a dialogue speech signal. Then, the dialogue speech signal is preprocessed to obtain a preprocessed dialogue speech file. Next, the preprocessed dialogue speech file is vectorized to obtain a corresponding feature matrix. The feature matrix is ​​input into a trained prosody model to obtain the model calculation result. Then, based on Mandarin and dialect templates, corresponding template thresholds are obtained. Using the model calculation result and template thresholds, the prosody recognition result of the feature matrix is ​​obtained. Finally, based on the prosody recognition result, the feature matrix is ​​processed by text mapping to obtain the dialogue word order text. This invention effectively improves the recognition accuracy and efficiency for speech containing dialects.

The application is suitable for the technical field of language synthesis, and provides a novel content dubbing method, which comprises the following steps: obtaining a novel text to be dubbed, preprocessing the novel text, identifying role dialogue sentences, environment description sentences and mixed sentences; extracting dialogue content and performing language emotion analysis to obtain language emotion labels; assigning corresponding general timbre embedding vectors to different roles, tracking state changes of the roles in plot development, and generating timbre gradient control parameters; based on the general timbre embedding vectors, the timbre gradient control parameters and the language emotion labels, performing voice synthesis on each dialogue content to generate dialogue voice waveforms; extracting environment semantic labels and intensity parameters from the environment description sentences to generate environment sound effect signals; mixing the dialogue voice waveforms and the environment sound effect signals to generate a dubbing audio file, so that the emotional expression of the text context and the smooth evolution of the same role in different age stages can be taken into account.

We provide the system. [Solution] A motion detection means for detecting the user's actions, The motion detection means detects the user's actions and initiates a conversation, and the voice acquisition means acquires voice information. A data management system that digitizes acquired voice information and compares it with accumulated past conversation data, A response generation means that generates an appropriate response based on past conversation data, A response providing means that provides the generated response to the user, An abnormality notification means that notifies of an abnormality if no operation is detected for a predetermined period of time, A system that includes this.

The invention belongs to the technical field of child dolls, and particularly discloses a child physiological education doll, a method and a program product, and the method comprises the steps: collecting the conversation voice of a child through the doll, preprocessing the conversation voice when the conversation voice triggers a conversation activation state, and uploading the preprocessed conversation voice to a cloud platform, the pre-trained large model is called through the cloud platform to carry out voice analysis and intelligent dialogue answering, corresponding physiological knowledge answering information is obtained and played to the child, and meanwhile, when the child touches the sensing device of the corresponding part of the doll, touch feedback voice information is played according to the corresponding part, so that early education of the physiological knowledge of the child is achieved. The child physiological knowledge education doll fills the blank of child physiological knowledge education dolls, dialogue education and touch feedback education of child physiological knowledge can be intelligently and visually achieved in the form of the dolls, and the child can effectively receive related physiological knowledge conveniently.

Described herein are systems and methods for identifying the severity of a mental health condition or symptoms of same by listening to a human-to-human conversation by receiving conversation data, processing the conversation data to generate a language model output and / or an acoustic model output using one or more language models and / or acoustic models. Further described herein are systems and methods for automatically tracking and providing analytics on self-report questionnaires administered during the conversation.

The invention relates to an audio processing method, which comprises the following steps of: receiving first and second mixed audios which are respectively acquired by a first microphone and a second microphone of wearable equipment for conversation voice, the dialogue voice comprises a first voice signal sent by a first speaker wearing the wearable device, a second voice signal sent by a second speaker having a dialogue with the first speaker, and a third voice signal of text-to-voice played by the electronic device; inputting the reference audio, the first mixed audio and the second mixed audio of the electronic equipment into a trained separation model to obtain a first mask and a second mask of the first speaker and the second speaker; selecting one of the first mixed audio and the second mixed audio as a mixed audio to be processed, and obtaining a first separated voice signal and a second separated voice signal from the mixed audio to be processed by using the first mask and the second mask; translating the first and second separated voice signals to obtain first and second translated texts, and playing the first translated text on the electronic equipment; the second translated text is sent to the wearable device for display thereof.