240 results about "Speaker identification" patented technology

A user electronic device comprising: one or more microphones configured to capture raw audio data; and one or more processors and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising: receiving the raw audio data captured by the one or more microphones; processing the raw audio data using a speech transcriber to generate a live transcription of the raw audio data that comprises a plurality of text tokens; processing the raw audio data to generate a speaker identification output that identifies, for each of the text tokens, a respective speaker for each of the text tokens in the live transcription; and processing a first input comprising (i) a first input prompt and (ii) an input text generated from the live transcription using a language model neural network to generate a modified transcription.

A portable information handling system speaker mount has standardized contacts and mounting points to accept plural speaker types with different speaker characteristics to generate audible sounds driven by an audio subsystem with audio driver settings, such as speaker-type gains. When a speaker is inserted, the audio subsystem communicates a coil characterization signal to the speaker and then analyzes the coil response to identify the type of the speaker, such as by determining the resistance of the coil to a direct current signal or the impedance of the coil from a frequency-based signal. In one example embodiment, the coil characterization signal generates audible noise from the speaker that is detected by a microphone and analyzed to determine the speaker type identity.

The invention discloses a voiceprint clustering method guided by a speaker recognition pre-training model based on short voices, and the method comprises the following steps: obtaining an original voice signal, and randomly combining a plurality of enhancement strategies to achieve data enhancement; performing voice segmentation on the voice signal after data enhancement based on a uniform segmentation mode; extracting voiceprint features of the segmented voice based on an attention mechanism of global time-frequency domain context modeling; and obtaining a clustering result based on K-means clustering and spectral clustering, matching the clustering result with a real speaker tag, performing reverse transmission based on angle-dependent AAM-Softmax loss, and outputting a voiceprint clustering result. According to the method, the influence of environmental interference on feature extraction can be overcome, feature dimensions which are more effective for identity identification can be screened, a clustering output effect which is superior to that of a mainstream algorithm can be obtained with a relatively low parameter quantity, and the robustness under a noise interference condition is improved.

The invention relates to a simulation digital human real-time intelligent voice interaction system and a simulation digital human real-time intelligent voice interaction method based on vision and a large model, and aims to solve the problems of inaccurate target speaker recognition, high response delay and the like in digital human voice interaction in a complex scene. The system circles an effective recognition range through a camera, triggers audio collection in combination with face detection, locks a target speaker and reduces noise by using lip movement recognition and sound image fusion technologies, converts the target speaker into a text through voice wake-up, generates an answer by means of a large language model (LLM) and knowledge retrieval enhancement (RAG) technologies, generates low-delay voice through a voice synthesis technology accelerated by the vLLM, and performs voice recognition on the target speaker. And driving the preloaded digital human image to synthesize a video stream and pushing the video stream to a front end for rendering in real time. Accurate pickup, low-delay interaction and rapid digital human image switching in a complex environment are realized, the accuracy and real-time performance of intelligent voice question answering are improved, and the method is suitable for government affair halls, exhibition halls and other scenes.

The invention discloses a zero-configuration adaptive speaker recognition method and system, and relates to the technical field of voice signal processing. The method comprises the following steps: receiving an audio stream, carrying out voice activity detection, obtaining a single-person voice segment, extracting a voiceprint embedding vector of the single-person voice segment, and carrying out online clustering to generate a speaker identity pool; and the identity pool is updated by calculating the multi-dimensional fusion similarity between the remaining single-person voice segments and the voice model, and temporary identity tags corresponding to the single-person voice segments are output. According to the speaker recognition method provided by the invention, a voiceprint template does not need to be registered in advance, and the flexibility and real-time performance of the system are improved.

This disclosure relates generally to systems, methods, and computer readable media for providing improved insights and annotations to enhance recorded audio, video, and / or written transcriptions of testimony. For example, in some embodiments, a method is disclosed for correlating non-verbal cues recognized from an audio and / or video recording of testimony to the corresponding testimony transcript locations. In other embodiments, a method is disclosed for providing testimony-specific artificial intelligence-based insights and annotations to a testimony transcript, e.g., based on the use of machine learning, natural language processing, and / or other techniques. In still other embodiments, a method is disclosed for providing smart citations to a testimony transcript, e.g., which track the location of semantic constructs within the transcript over the course of various modifications being made to the transcript. In yet other embodiments, a method is disclosed for providing intelligent speaker identification-related insights and annotations to an audio recording of a testimony transcript.

The invention relates to the technical field of voiceprint recognition, and discloses an air-ground conversation speaker recognition method for short voice and complex noise, which dynamically suppresses background noise through a self-adaptive filter in combination with a minimum mean square algorithm, and improves the voice signal quality. A multi-scale feature fusion technology is adopted, short-time Fourier transform, filter bank energy features and multi-scale convolution are combined, a random time and frequency shielding data enhancement strategy is introduced, and the short speech feature expression ability is enhanced; bi-GRU is integrated in the ECAPA-TDNN model, and context information of multiple rounds of conversations is captured through context time sequence modeling, so that the recognition stability in a dynamic scene is improved; and an AAM-Softmax loss function is adopted to strengthen the distinguishing capability of the model, and finally identity judgment is realized through cosine similarity matching. According to the method, the voiceprint recognition precision and robustness under complex noise and short voice conditions are remarkably improved, and the safety risk caused by identity misjudgment in aviation communication is effectively reduced.

A system for automated processing and analysis of audio files for large data sets in a cloud environment. A unified analytic environment can integrate audio machine learning models for processing and analysis with a knowledge management system, including graph presentations of tracked entities, linked to audio files and / or associated translations and transcripts. Entities within such data can be searched or filtered and proposed for tracking, or identified as tracked objects. These features can allow triage and prioritization of audio files for analysis. User interfaces can facilitate feedback on transcription and translation outputs, thereby improving present outputs and future inputs and outputs. Entities speaking or referred to can be found, tagged, and distinguished in audio files (e.g., using speaker identification in audio files, text searching in transcripts, etc.) Users can provide feedback and input on various aspects of a system, to enhance or adjust initial automated or other machine learning outputs.

The invention discloses a bipartite graph matching-based speaker recognition method and electronic equipment, and belongs to the technical field of audio recognition. The method comprises the following steps: acquiring an audio stream, and segmenting the audio stream into continuous target duration audio clips in real time; determining a voiceprint embedding vector corresponding to each audio clip of the target duration; determining an embedding matrix based on the voiceprint embedding vector; determining a target voiceprint feature corresponding to each target duration audio clip according to a bipartite graph method; calculating the similarity between the voiceprint embedding vectors; and grouping the voiceprint embedding vectors based on the similarity between the voiceprint embedding vectors, and clustering the voiceprint embedding vectors corresponding to the same speaker to obtain a clustering result and generate a target recognition report. According to the invention, the calculation complexity can be reduced and the identification precision can be improved.

The invention relates to a speaker voice recognition method, and relates to the technical field of telephone voice signal processing. The method comprises the following steps: acquiring a to-be-identified call audio in real time, and segmenting the to-be-identified call audio into a plurality of audio blocks; for each audio block, extracting voice features of the audio block, and inputting the voice features into a pre-trained speaker voice recognition model; outputting the affiliation probability that the audio block belongs to the target speaker through the speaker speech recognition model; and if the affiliation probability of the audio block belonging to the target speaker is greater than a preset speaker affiliation probability threshold, judging that the audio block belongs to the target speaker. According to the invention, target speaker identification in a complex scene can be realized.

The invention relates to the technical field of speaker recognition, and discloses a speaker recognition method and system for a real scene, and the method comprises the steps: obtaining external sound information, carrying out the processing through a multi-resolution convolution kernel, extracting features in a time domain, and carrying out the feature fusion only in the time domain; after feature fusion in the time domain, features are extracted in the frequency domain by using grouping convolution, processing is carried out, and feature fusion is carried out only in the frequency domain; and after the frequency domain features are fused, performing mask processing, and finally outputting an identification result. Through a noise mask module and multi-resolution feature extraction, extraction of features of a target speaker is enhanced, and the influence of noise on an identification result is reduced. Meanwhile, in a complex noise environment, the system can effectively focus on the target speaker, and the recognition stability and reliability are improved. More comprehensive feature information is provided through multi-scale feature extraction of a time domain and a frequency domain, and fine differences of speakers can be captured.

Provided is a simultaneous interpretation system that performs machine translation processing and speaker identification processing in real time. In the simultaneous interpretation system, the segment processing unit of the simultaneous interpretation device performs high-speed and highly accurate segment processing to obtain sentence data and also obtains a time range in which a word sequence included in the sentence data was uttered, thus, allowing for performing machine translation processing and speaker identification processing in real time. In other words, in the simultaneous interpretation system, the machine translation processing unit performs machine translation processing on sentence data obtained through high-speed and highly accurate segment processing, and performs, in parallel, processing for predicting a speaker who spoke during the period specified by the time range data based on the inputted video stream and the time range data, thus allowing for performing machine translation processing and speaker identification processing in real time.

The invention discloses a speech enhancement training method and device based on speaker perception, equipment and a medium, and relates to the technical field of artificial intelligence, and the method comprises the steps: inputting a first noisy speech sample into an initial speech enhancement joint training system, so as to enable a pre-training speech enhancement module to carry out the denoising of the first noisy speech sample, outputting a first enhanced voice sample, and determining voice enhancement loss; extracting a first speaker sensitive feature of the first enhanced voice sample through a pre-training sharing encoder, carrying out speaker ID classification on the first speaker sensitive feature through a pre-training speaker identification module to obtain a speaker ID classification prediction result, and calculating a speaker identification loss; and judging whether the sensitive features of the first speaker have noise or not through a confrontation training discriminator, and adjusting confrontation loss according to a noise judgment result, so as to update system parameters based on each loss, and obtain a trained target speech enhancement combined training system. And the conflict between the two tasks of speech enhancement and speaker recognition is coordinated.

The invention belongs to the technical field of speech recognition, and particularly discloses a multi-task speech emotion recognition method based on a parallel processing hybrid expert network, and the method comprises the steps: carrying out the feature extraction of an input original speech, and obtaining a shared feature; constructing a parallel processing hybrid expert network, inputting the shared features into the parallel processing hybrid expert network, carrying out sentiment classification and speaker recognition on the shared features in parallel, and respectively outputting a predicted sentiment value and a predicted speaker; inputting the shared features into a full connection layer for voice recognition processing to obtain a text prediction value; and obtaining a loss function according to the predicted emotion value, the predicted speaker and the text predicted value in combination with the corresponding labels, and optimizing the model parameters according to the loss function to obtain the parallel processing hybrid expert network after optimization training. According to the invention, the speech emotion recognition performance and recognition accuracy can be improved.

The invention provides a conference summary generation method and device, and the method comprises the steps: obtaining an audio and video file of a target conference, and the audio and video file comprises an audio file and / or a video file; performing voice activity detection processing, text conversion processing and speaker recognition processing on the audio and video file to obtain a target dialogue text; constructing prompt words based on the application scene of the target conference and the target dialogue text; and inputting the cue word into a conference summary generation large model, and generating a conference summary corresponding to the target conference. According to the invention, the problem of low conference summary generation efficiency is solved, and more time is saved; the generation result of the conference summary generation large model is optimized by adopting a prompt word engineering mode, so that the accuracy of generating the conference summary can be further improved; the conference summary is generated by adopting the conference summary generation large model, compared with a traditional neural language programming technology, feature engineering construction is omitted, and the performance is better.

The invention discloses a speaker recognition method in a medical real-time speech recognition scene, and the method specifically comprises the steps: carrying out the parallel distribution of a received PCM audio stream through an audio diverter in a gateway layer, and transmitting the audio stream to an automatic speech recognition link and a speaker separation link; in the automatic speech recognition link, outputting a recognition text and Token-level timestamps corresponding to each minimum semantic unit in the recognition text; in the speaker separation link, extracting a corresponding speaker embedding vector based on a preloaded speaker embedding model, and performing online clustering processing on the embedding vector to generate a speaker identity identifier; token-level boundary adsorption labeling processing is executed based on the Token-level timestamp and an online clustering result, so that a speaker switching position is determined; and carrying out one-to-one mapping on the speaker tags and the recognition text according to the Token-level timestamps, merging Tokens with the same speaker tags continuously, and outputting a transliteration text with the speaker tags.

A method includes receiving audio data corresponding to an utterance spoken by a particular user and captured in streaming audio by a user device. The method also includes performing speaker identification on the audio data to identify an identity of the particular user that spoke the utterance. The method also includes obtaining a keyword detection model personalized for the particular user based on the identity of the particular user that spoke the utterance. The keyword detection model is conditioned on speaker characteristic information associated with the particular user to adapt the keyword detection model to detect a presence of a keyword in audio for the particular user. The method also includes determining that the utterance includes the keyword using the keyword detection model personalized for the particular user.

The invention provides a speaker recognition method and system, a terminal and a medium, and the method comprises the steps: constructing and training a voice feature extraction depth model through employing a first time-frequency fusion residual network, and constructing a voice feature extraction lightweight model through employing a second time-frequency fusion residual network; and taking the voice feature extraction depth model as teacher network training to obtain a convergent voice feature extraction lightweight model, so as to further perform feature extraction on the to-be-recognized voice data subjected to logarithm Mel spectrum feature extraction to generate a corresponding to-be-recognized voice feature vector, comparing the target speech feature vector with each template speech feature vector in a speech library, and determining a target speech feature vector and a target speaker; according to the speech feature extraction lightweight model, the calculation cost of the model and the occupied equipment memory are greatly reduced, the frequency domain information and the time domain information in the speech data to be recognized can be comprehensively and accurately captured, and the speech feature extraction lightweight model has high recognition precision and strong anti-noise capability.

To make an electronic device take an appropriate action in response to an action of a user.SOLUTION: An action control system disclosed herein comprises: a condition recognition unit for recognizing the user condition including an action of a user, and the condition of an electronic device; an emotion determination unit for determining the emotions of the user or the emotions of an avatar representing an agent for interacting with the user; an action determination unit configured to use at least one of the user condition, the condition of the electronic device, the emotions of the user, and the emotions of the avatar to determine an action to be taken by the avatar; and an action control unit for displaying the avatar in an image display area of the electronic device. When taking meeting minutes is determined as an action to be taken by the avatar, the action determination unit acquires speech content of the user through voice recognition, identifies a speaker through voiceprint authentication, acquires the emotions of the speaker based on a determination result of the emotion determination unit, and generates meeting minutes data representing a combination of the speech content of the user, a speaker identification result, and the emotions of the speaker.SELECTED DRAWING: Figure 15

The invention provides a speaker recognition method and system based on a time-frequency domain dynamic feature matrix, and the method comprises the steps: mapping a time dynamic feature sequence of an original voice into a two-dimensional image, calculating the similarity through a similarity matrix, and enhancing the time domain dynamic features in the time dynamic feature sequence through a self-adaptive weighting method; performing short-time Fourier transform on the original voice to obtain a frequency spectrum value, calculating a frequency domain dynamic characteristic, and dynamically adjusting a similarity threshold value; training in a convolutional neural network model CNN, and extracting acoustic features in a traditional mode to obtain initial speaker features of the original speech; and the feature fusion classifier calculates the category probability distribution of the speaker according to the weighted adaptive fusion feature vector of the full connection layer, and takes the category with the maximum probability as a final result. According to the invention, the accuracy and robustness of speaker identification in a complex scene are improved, the adaptability to different voice scenes is enhanced, and the information for identifying the identity of the speaker in the voice signal is better reserved.

The invention discloses an audio speaker recognition method and system, a storage medium and electronic equipment, and belongs to the field of audio processing and artificial intelligence, and the method comprises the steps: carrying out the preprocessing of an input audio, extracting the sound channel information of the input audio, and judging whether the audio type is a single sound channel or a double sound channel; for the dual-channel audio, judging whether the audio type is a pseudo dual-channel or a true dual-channel by comparing at least two acoustic characteristic parameters of a left channel and a right channel; selecting a processing strategy according to the audio type; sequentially performing noise reduction preprocessing, voice activity detection, speaker segmentation, content recognition and punctuation recovery on the selected sound channel; performing speaker role marking on an audio content recognition result by adopting a large language model; and combining the content fragments of the same speaker role to generate structured output. Through multidimensional acoustic feature analysis and cooperation of the deep learning model and the large language model, the recognition accuracy and the automation degree are improved, and the method can adapt to various complex audio scenes.

The invention relates to a speech synthesis system-oriented model watermarking method and device, computer equipment and a storage medium, and the method comprises the steps: constructing an intra-domain watermark triggering sample based on a pre-trained speech synthesis model and a fine-tuned speaker recognition model; constructing a corresponding watermark implantation data set based on the watermark triggering sample; based on a fine-tuned speaker recognition model, implanting the watermark implantation data set into the speech synthesis model to obtain a marked model; and screening out a target watermark triggering sample based on the marking model. Through the method and the device, the problem that the watermark is easy to lose in a model fine tuning process due to the fact that the relevance between the watermark and the speech synthesis main task is not strong in the prior art is solved, strong coupling between the watermark triggering task and the model main task is forced from a data level by utilizing the watermark triggering sample in the construction domain, the robustness of the watermark in the marked model is improved, and the speech synthesis efficiency is improved. And the target watermark trigger sample keeps stable and effective.

The invention relates to a speaker recognition method based on multi-domain acoustic feature fusion. The speaker recognition method comprises the following steps: acquiring voice data to be recognized; respectively extracting a spectrogram and a score spectrogram of each piece of voice data; enabling the spectrogram and the fractional spectrogram to pass through a filter bank to respectively obtain a first Fbank feature and a second Fbank feature, and combining the first Fbank feature and the second Fbank feature into an acoustic feature; fusing the acoustic features by adopting a feature fusion method; inputting the fused acoustic features into a speaker recognition network model to obtain voiceprint features of the voice of the speaker to be recognized; and obtaining a recognition result according to the voiceprint features of the voice of the speaker to be recognized. According to the method, high-precision and high-discrimination voiceprint features are obtained, and the speaker recognition accuracy is improved.

A noise canceling disablement system is provided to enables a user to hear select conversational speech directed at the user while wearing a noise cancelling hearable device. The disablement system automatically at least partial disables the noise canceling feature of the hearable device in response to recognizing conversational speech of a speaking person within a detected conversation zone of the user. In some cases, triggering of the noise canceling disablement further requires the speaking person to be identified by the system as significant person of the user.

The invention provides an automatic speech recognition result optimization system and method, a medium and equipment, and the system comprises an ASR preprocessing module which carries out the initial ASR recognition of an original audio, obtains a preliminary recognition text, carries out the named entity recognition of the preliminary recognition text, enables a recognition result to be matched with a hot word with similar pronunciation in a hot word library, and carries out the recognition of the hot word; inputting the hot words into an ASR model for secondary identification; the ASR text post-processing module is used for carrying out semantic error correction on the text output by the ASR model by utilizing a large language model and verifying the reasonability of the text; and the ASR speaker recognition module is used for segmenting and numbering the audio by using a speaker separation technology, and mapping the number with a specific name. According to the invention, by adopting a mode of entity word extraction and hot word matching, the problem that a speech recognition system cannot screen related hot words in advance is solved, and the recognition effect of an ASR system is improved.

The invention provides an intelligent conference summary generation method and device, equipment and a storage medium, and relates to the technical field of natural language processing. According to the method provided by the invention, clear capture and accurate identification of audios are realized by using the multi-channel microphone array; and inputting the audio with the speaker identifier into the speech recognition model, and converting the audio into a structured initial summary text with a timestamp. Performing semantic analysis on the initial summary text through a large language model, and extracting key text information; a rule engine and a large language model are combined for combined judgment, so that the information accuracy is ensured; the initial summary text is converted into a first summary text in a preset text style, so that the text specialty is improved; humanized feature injection enhances the language naturalness of the second summary text; and the second summary text is converted into the structured target summary text, so that the conference summary better meets the requirements of professional scenes such as financial risk control conferences and medical consultation conferences, and the accuracy and availability of intelligent generation of the conference summary are improved.

The invention discloses a speaker recognition feature extraction method and system based on self-supervised multi-task learning, and belongs to the technical field of biological recognition. In order to solve the problems that the cost is high when a data set with a label is manufactured, and the specific speaker information is difficult to judge under the condition of no supervision information prompt because a voice signal contains various kinds of complex information and also has information of a special hierarchical structure. According to the method, a multi-task learning encoder is adopted to extract a feature sequence, and the feature sequence is used for speaker identification; in the encoder training process, feature sequences corresponding to audios in a training set are simultaneously sent to a plurality of processing tasks for processing, and the processing tasks comprise an original waveform task, a logarithmic power spectrum task, a filter bank feature task and a Mel-frequency cepstrum coefficient task. And a local information LIM identity prediction task and a global information GIM identity prediction task. And performing back propagation by using the loss average value of all the tasks to complete training.

The invention provides a voice recognition method and device, electronic equipment and a storage medium, and belongs to the technical field of financial science and technology. The method comprises the following steps: acquiring target voice data containing a plurality of speakers; coding the target voice data based on a voice recognition model to obtain voice coding features, the voice recognition model comprising a voice recognition network and a speaker recognition network; performing content recognition on the voice coding features based on a voice recognition network to obtain voice text content corresponding to the target voice data; speaker recognition is carried out on the target voice data and the voice coding features based on a speaker recognition network, and speaker voiceprint features corresponding to the target voice data are obtained; and based on the voiceprint features of the speakers, each text character in the voice text content is classified to obtain target voice content generated by each speaker, and the target voice content is composed of a plurality of text characters. According to the method and the device, the recognition accuracy of voices containing a plurality of speakers can be improved.

This invention discloses a method for generating non-learnable speech data against model fine-tuning attacks, comprising: constructing a proxy speaker recognition model based on a pre-trained speech representation network and a differentiable classifier head; initializing perturbation variables and calculating a temporal saliency mask; determining target identity labels for source samples using a candidate buffer pool and cosine similarity rules; simulating an attacker in the inner layer optimization, and fine-tuning the model using protected speech and real speaker labels; in the outer layer optimization, using the model parameters obtained from the inner layer optimization as a temporary model, calculating the outer layer loss for the target identity labels, and solving the gradient of the perturbation according to a first-order approximation strategy; updating the perturbation and performing projection and spectral difference constraints; and outputting protected speech through repeated iterations. This invention improves the effectiveness against target identity attacks, enhances identity obfuscation capabilities, reduces optimization waste caused by invalid targets, and improves the stability and practicality of the speech identity protection process.