Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

145 results about "Speech spectrum" patented technology

Speech spectrum - the average sound spectrum for the human voice. acoustic spectrum, sound spectrum - the distribution of energy as a function of frequency for a particular sound source.

Audio processing method and system for speech spectrum reconstruction

The invention relates to the technical field of audio processing, and discloses an audio processing method and system for speech spectrum reconstruction, and the method comprises the steps: carrying out the preprocessing of an original speech signal collected by a vehicle-mounted microphone, and obtaining a speech signal time-frequency matrix; performing singular value decomposition on the voice signal time-frequency matrix to obtain a sparse matrix representing voice components and a low-rank matrix representing noise components, and establishing a frequency band characteristic incidence matrix through a mutual information entropy calculation method; inputting the sparse matrix into a selection forgetting extreme learning machine for voice feature prediction to obtain predicted voice feature data; and based on the predicted voice feature data and the frequency band feature incidence matrix, performing voice probability calculation and feature interpolation on each time frequency point by adopting a logarithmic frequency spectrum amplitude calculation method to obtain reconstructed frequency spectrum data, thereby improving the accuracy of voice recognition and meeting the requirement of real-time processing in a vehicle-mounted environment at the same time.
Owner:DONGGUAN HUAZE ELECTRONIC TECH CO LTD

Method, system, and device for classifying feeding intensity of fish school

Provided are a method, system and device for classifying feeding intensity of fish school, relating to the field of aquaculture. The method includes: extracting features of an audio clip to be detected to determine a Mel spectrum-based fish school feeding depth speech spectrum feature vector, a CQT-based fish school feeding depth speech spectrum feature vector, and an STFT-based fish school feeding depth speech spectrum feature vector; fusing the Mel spectrum-based fish school feeding depth speech spectrum feature vector, the CQT-based fish school feeding depth speech spectrum feature vector and the STFT-based fish school feeding depth speech spectrum feature vector to generate a fused feature spectrogram; and inputting the fused feature spectrogram into a deep convolutional neural network model constructed by historical audio clips corresponding to different types of feeding intensities to determine a feeding intensity type corresponding to the audio clip to be detected.
Owner:CHINA AGRI UNIV

User psychological state monitoring method and system based on voice and semantic recognition

The invention relates to a user psychological state monitoring method and system based on voice and semantic recognition, and the method comprises the steps: firstly obtaining voice data and corresponding text data of a user, and respectively extracting a voice spectrum feature vector and a text feature vector; then, inputting the two features into a cross-modal joint coding network model, and aligning a speech spectrum with a text embedding space by using a multi-head attention mechanism to obtain a joint feature; thirdly, confidence coefficients of the joint features are extracted through a Bayesian network model, weighted features are obtained, a Gaussian mixture model is used for fitting an emotion fluctuation trend, and an emotion distribution probability is calculated; the confidence coefficient weight is dynamically adjusted according to the emotion distribution probability, new weighted features are obtained, and after time sequence alignment processing, local information is extracted by using a convolutional neural network and the features are fused; and finally, calculating a classification probability through a softmax function, and determining a psychological state classification result of the user.
Owner:JINHUA INST FOR ADVANCED STUDY (OFFICE OF THE LEADING GRP FOR THE PREPARATORY WORK OF JINHUA INST OF TECH)

Classroom behavior analysis system based on adaptive algorithm

The invention relates to the technical field of classroom behavior analysis, and discloses a classroom behavior analysis system based on an adaptive algorithm, which comprises a detection module, a parameter extraction module, a feature integration module and a decision generation module. The detection module collects classroom multi-modal behavior data and identifies active student terminals; the parameter extraction module obtains a real-time posture vector, a voice spectrum feature, an interaction response time delay and a teaching content semantic tag of a target student; the feature integration module performs cross-modal fusion on the data to generate attitude, voice, interactive fusion features and semantic association features; and the decision generation module performs hierarchical association modeling and dynamic priority ranking through a multi-head attention mechanism, generates a behavior matching degree and determines a target analysis object. The system realizes multi-modal data fusion by means of algorithms such as space-time decomposition and dynamic density clustering, improves the accuracy and real-time performance of classroom behavior analysis, and provides support for teaching optimization.
Owner:JIAN YINGJIA ELECTRONICS TECH

Speech brain-computer interface neural decoding systems based on chinese language and implementation methods thereof

A speech brain-computer interface neural decoding system based on Chinese language, a method for controlling the speech brain-computer interface neural decoding system, and a method for implementing the speech brain-computer interface neural decoding system are disclosed. The speech brain-computer interface neural decoding system includes an electroencephalography (EEG) data acquisition module, a significance feature screening and verification module, a speech imagery EEG data decoding module, and an understandable speech synthesis module. The speech brain-computer interface neural decoding system integrates EEG data collection, EEG feature extraction, EEG feature screening, EEG signal decoding for reconstructing speech spectrum information and understandable speech synthesis. After obtaining reconstructed spectrogram features, a Pearson correlation analysis may be performed with original spectrogram features, with a correlation generally being ≥80%. The decoding performance of the speech brain-computer interface neural decoding system is superior to traditional decoding models, effectively improving communication between patients with speech disorders and the outside world.
Owner:TIANJIN UNIV

Wireless audio equipment low-power-consumption communication method and device, SoC chip and storage medium

ActiveCN119649835ASolve the problem of collaborative transmissionReduce data redundancySpeech analysisHigh level techniquesSource encodingData stream
The invention relates to the technical field of wireless communication, and discloses a low-power-consumption communication method and device for wireless audio equipment, an SoC chip and a storage medium. The method comprises the following steps: sampling acoustic characteristics of heterogeneous audio data of a plurality of target audio devices, calculating a voice spectrum corresponding to device characteristics, and extracting multi-device acoustic characteristics, performing multi-frequency sub-band speech enhancement, heterogeneous segmentation and grouping of multi-target audio equipment, verification value calculation and differential coding on each extracted acoustic feature sequence to obtain a multi-source coding speech segment; performing transmission unit division and cooperative signal modulation, cooperative resource allocation and data stream transmission of each transmission unit on the multi-source coding voice segment to obtain a transmission voice data stream; and obtaining a transmission voice data stream transmitted with low power consumption and performing audio recovery on the obtained data to obtain a target audio data stream transmitted by the multi-target audio equipment. The communication power consumption of the multiple target audio devices is reduced, and the audio transmission quality is ensured.
Owner:SHENZHEN HESHENGCHENG TECH CO LTD

Speech synthesis method and device based on conditional matching stream, equipment and medium

The invention relates to the field of financial science and technology speech conversion, and discloses a speech synthesis method, device and equipment based on a conditional matching stream and a medium, and the method comprises the steps: preprocessing an input text, and converting the input text into an embedded vector; based on a stream matching model, the input text is combined with the embedded vector and mapped to the intermediate representation space, and the input text in the intermediate representation space gradually generates speech spectrum features; on the basis of a zero sample learning mechanism, generating a voice spectrum meeting requirements from the voice spectrum features; and restoring the voice spectrum into a voice signal and outputting the voice signal. By introducing a stream matching model and a zero sample learning mechanism, speech with emotions or a specific style can be directly generated without emotional data training, the dependence of a traditional speech technology on large-scale data with emotional labels is broken through, and the application range of the speech technology is greatly expanded. The method is applied to application scenes such as financial science and technology voice conversion.
Owner:PING AN TECH (SHENZHEN) CO LTD

Speech recognition method and system based on artificial intelligence

The invention relates to the technical field of artificial intelligence, and particularly provides an artificial intelligence-based speech recognition method, which comprises the following steps of: acquiring multiple paths of speech signals through a microphone array; performing noise reduction processing on each path of voice signal, removing background noise, enhancing the voice signal by adopting an adaptive beam forming algorithm, and extracting a target voice signal; performing short-time Fourier transform on the preprocessed voice signals, extracting voice spectrum features, and extracting high-level semantic features of the voice through a deep learning model; inputting the extracted speech features into a speech recognition model based on an attention mechanism, generating text transcription of target speech, dynamically adjusting model parameters through an adaptive learning module, and optimizing a recognition result; according to the method, the recognition result is corrected according to the real-time feedback of the user, the corrected data is used for online updating of the model, the robustness and adaptability of the system are improved, and the method has the effects that training and evaluation are conducted through high-quality data, and delay is reduced in real-time processing.
Owner:BEIJING HURRICANE SOFTWARE CO LTD

Intelligent financial customer service interaction optimization method and system

The invention relates to the technical field of financial science and technology, and discloses an intelligent financial customer service interaction optimization method and system, and the method comprises the steps: collecting a real-time session data flow and a session path when a target customer carries out the session interaction with an intelligent customer service system, calculating a satisfaction degree attenuation value of the intelligent customer service system, and evaluating an interaction quality index of the session path; extracting speech spectrum features and text semantic vectors in the real-time session data stream, drawing an emotion fluctuation curve of the target customer in the session process, extracting a wave crest semantic fragment corresponding to an emotion wave crest in the emotion fluctuation curve, and calculating an emotion entropy value of the target customer; calculating the service integrating degree of the intelligent customer service system in the interaction channel; generating a session strategy optimization scheme of the target customer; and executing interaction processing about the target client, calculating a client journey conversion rate corresponding to the session strategy optimization scheme, and performing optimization adjustment on the session strategy optimization scheme to obtain a final session strategy. According to the invention, the accuracy of financial customer service interaction optimization can be improved.
Owner:TIBET DOLPHIN INFORMATION TECHNOLOGY CO LTD

Key information extraction method and system based on multi-modal large model

The invention discloses a key information extraction method and system based on a multi-modal large model, and belongs to the technical field of information processing.The key information extraction method and system based on the multi-modal large model comprise the following specific steps that firstly, input heterogeneous modal data are subjected to standardized preprocessing, and the preprocessed data are subjected to data preprocessing; comprising text vectorization, image feature coding and speech spectrum analysis; 2, establishing an inter-modal incidence matrix through a cross-modal attention mechanism, and dynamically adjusting the feature weight of each modal; and 3, sequentially executing context semantic understanding, entity relationship modeling and core information positioning by adopting a hierarchical feature extraction architecture. According to the method, intelligent selection of inter-modal features is realized through dynamic weight distribution, the key information recall rate is greatly improved in a noise interference scene, and after a feature distillation loss function is introduced and redundant features are eliminated, the error propagation rate is effectively reduced in a noisy voice and low-resolution image coexistence scene.
Owner:SHANGHAI XIAOGONGYI E-COMMERCE CO LTD

Information processing method and system for voice conversion

The invention relates to the technical field of voice signal processing and synthesis, and particularly discloses an information processing method and system for voice conversion, and the method comprises the steps: extracting a language feature vector of each word from an input text; calculating posterior probabilities of the words in different languages by combining a Bayesian reasoning mechanism, and generating language attribution confidence coefficient characteristic values; a Monte Carlo sampling method is adopted to carry out multiple times of context sensitive simulation, and pronunciation path selection probability distribution characteristic values are generated; further fusing the feature values into a multi-language pronunciation decision vector, inputting the multi-language pronunciation decision vector into a multi-language end-to-end speech synthesis model, calling a phoneme mapping rule of a corresponding language and an acoustic parameter prediction module, and generating a high-quality target speech spectrogram; and finally, dynamically adjusting Bayesian prior distribution and a language recognition threshold according to the output speech spectrogram.
Owner:SHANDONG POLYTECHNIC COLLEGE

Speech generation model training method and device, equipment and medium

The invention belongs to the field of artificial intelligence, and relates to a voice generation model training method comprising the following steps: obtaining a reference tone frequency spectrum, phoneme information and a voice frequency spectrum of a target object; based on the reference tone frequency spectrum, the phoneme information and the voice frequency spectrum, training a preset initial voice generation model to obtain model parameters; and based on the model parameters, respectively adjusting parameters of a multi-timbre feature extraction network, a phoneme feature extraction network, a rhythm feature discretization network, a time sequence alignment module, an attention fusion module and a voice reconstruction decoding network of the initial voice generation model so as to construct the voice generation model. The invention further provides a device, equipment and a medium. In addition, the invention also relates to a block chain technology, and voice training data and model parameters can be stored in a block chain. According to the method and the device, the tone and the rhythm information can be decoupled, and the tone and the rhythm information can be flexibly adjusted so as to generate synthetic speech with diversity and flexibility.
Owner:PING AN TECH (SHENZHEN) CO LTD

Ultra-lightweight speech enhancement neural network and method based on network architecture search

The invention discloses an ultra-lightweight speech enhancement neural network and method based on network architecture search. The neural network comprises an encoder, an enhancer and a decoder, and the encoder comprises a frequency spectrum compression module used for compressing a noisy speech frequency spectrum in a frequency dimension; the down-sampling convolution module is used for performing feature extraction and frequency dimension down-sampling on the feature map; the grouping depth separation convolution module is used for performing feature extraction and feature enhancement on the feature map; the intensifier comprises a two-way packet recurrent neural network which is used for carrying out time-frequency domain modeling on a feature map; the decoder comprises a grouping depth separation convolution module which is used for performing feature extraction and feature enhancement on the feature map; the up-sampling convolution module is used for performing feature reconstruction and frequency dimension up-sampling on the feature map; and the frequency spectrum expansion module is used for expanding the frequency dimension of the feature map. According to the invention, high-performance speech enhancement can be realized with relatively low calculation overhead.
Owner:NANJING UNIV +1

Online conference transcription method and system capable of realizing intelligent conference summary

The invention relates to the technical field of voice communication, and provides an online conference transcription method capable of realizing intelligent conference summary, which comprises the following steps: collecting audio data of each speaker in a conference process in real time through a microphone array, and carrying out primary processing on the collected audio signals; performing sound source positioning on the audio signal and determining a source direction of the audio signal according to a sound source positioning result; performing voiceprint recognition on the audio signal to extract voice spectrum features of the speaker, and marking the voiceprint of the speaker according to a voiceprint recognition result; and the weighted audio signal is used for character transcription, and the speaker is positioned to generate a complete conference summary. The problems that in a traditional audio transfer system, multiple speakers cannot be accurately recognized, speech content cannot be distinguished, and manual proofreading work cannot be reduced are effectively solved, and the accuracy and efficiency of conference recording are improved.
Owner:SHANGHAI SHENSILICON SEMICON CO LTD

Ultra-lightweight speech enhancement neural network system and method based on adaptive convolution

The invention discloses an ultra-lightweight speech enhancement neural network system and method based on adaptive convolution. The system comprises an encoder; a frequency spectrum compression module, which is used for carrying out dynamic range and frequency dimension compression on a noisy speech frequency spectrum; the self-adaptive convolution attention module is used for carrying out frequency dimension downsampling and feature extraction analysis on the compressed feature map through a self-adaptive convolution layer and time channel attention, and then sending the feature map into an intensifier; the intensifier is a dual-path packet recurrent neural network and is used for modeling sub-band time features and intra-frame frequency features of the voice; the decoder comprises a self-adaptive transpose convolution attention module which is used for performing frequency dimension upsampling and feature reconstruction on the feature map output by the enhancer; and the frequency spectrum expansion module is used for expanding the frequency dimension of the feature map output by the self-adaptive transpose convolution attention module. According to the invention, high-performance speech enhancement can be realized with extremely low calculation complexity.
Owner:NANJING UNIV +1

Multi-modal data transmission method and system based on dynamic priority

The invention discloses a multi-modal data transmission method and system based on dynamic priority, and the method comprises the steps: respectively extracting image, voice and text feature data from image, voice and text data in collected multi-modal data of a service, respectively adding corresponding modal embedding vectors, and then carrying out the splicing; inputting the spliced feature data into a cross attention mechanism, and adding the attention scores of the feature data of each modal to obtain the attention score of the multi-modal fusion feature data of the service; performing joint evaluation on the attention score of the multi-modal fusion feature data of the service and a priority preset for the service to obtain a dynamic priority of the service; and preferentially transmitting the data of the service with high dynamic priority. According to the invention, transmission of data with high dynamic priority can be guaranteed preferentially, and key and important data can be guaranteed to be transmitted preferentially.
Owner:FIBRLINK NETWORKS

Electric power emerging business risk keyword identification and early warning method, system and device based on NLP technology and medium

The invention discloses an electric power emerging business risk keyword identification and early warning method, system and device based on an NLP technology and a medium, and belongs to the technical field of electric power risk, and the method comprises the steps: obtaining multi-source customer service text data, and extracting risk keywords and corresponding voice spectrum data from the multi-source customer service text data; inputting the risk keyword into a power service knowledge graph, and generating a first risk research and judgment result through knowledge reasoning, the first risk research and judgment result comprising a risk traceability path; performing acoustic feature analysis on the speech spectrum data, extracting acoustic feature parameters, calculating an emotional excitation index, and generating a second risk identification result; performing weighted fusion on the first risk research and judgment result and the second risk identification result to generate a comprehensive risk score; and when the comprehensive risk score reaches a preset threshold value, generating a structured early warning work order, and carrying out data binding on the structured early warning work order, the original customer service work order and the call record. According to the invention, the efficiency of risk management and control is improved.
Owner:GUIZHOU POWER GRID CO LTD

A formant extraction method for continuous speech based on peak selection

ActiveCN115064180BSpeech analysisFrequency spectrumFormant
The present invention discloses a continuous speech formant extraction method based on peak selection, comprising: performing a preprocessing operation on a single frame of input speech; using a linear prediction method to preliminarily estimate the peak value in the spectral envelope of the speech frame; establishing a reference point and a formant trough, and then using a peak selection method to establish a mapping relationship between the peak value and the reference point; using the mapping relationship between the peak value and the reference point and the formant trough to determine the formant of the speech frame; and performing formant estimation on the continuous speech: dividing the continuous speech into frames according to different frame numbers, using the above algorithm to loop 100 times to obtain the formant parameters under different frame number tests, averaging the results after 100 loops, and obtaining the final result after smoothing. The method of the present invention can eliminate the influence of merged peaks and false peaks, and has a fast convergence speed and strong robustness.
Owner:NANJING UNIV OF POSTS & TELECOMM

Voice coding and decoding method, device, equipment and medium

ActiveCN121054006ASpeech analysisProduct quantizationDecoding methods
The invention relates to the technical field of artificial intelligence, can be applied to the fields of financial science and technology and medical science and technology, and discloses a voice coding and decoding method, device, equipment and medium. A continuous vector is obtained by encoding the data through an encoder trained by a first-stage mirror image architecture; segmenting a continuous vector into sub-vectors, matching the sub-vectors with corresponding sub-coding dictionaries through a quantizer to obtain sub-indexes, and combining the sub-indexes to generate an overall index; analyzing the overall index to obtain sub-indexes, calling sub-discrete vectors and splicing the sub-discrete vectors into a discrete vector; and reconstructing the discrete vector through a decoder trained by a second-stage non-mirror-image architecture to obtain a target speech spectrum feature, and converting the target speech spectrum feature into a target speech signal. According to the method, double-stage training is adopted, the first-stage mirror image architecture guarantees the coding stability, the second-stage non-mirror image architecture improves the decoding flexibility, and the product quantization technology is combined, so that the calculation efficiency and the storage overhead are balanced, and meanwhile, the voice reconstruction quality is improved.
Owner:平安科技(上海)有限公司

Voice enhancement method based on AI echo cancellation

The invention discloses a speech enhancement method based on AI echo cancellation, and relates to the technical field of speech processing. According to the voice enhancement method based on AI echo cancellation, voice data sets in different echo environments are obtained through a recording device, time-frequency conversion is carried out on voice signals, and voice spectrum features are extracted. Time-frequency features are extracted through a convolutional neural network, and an echo cancellation model is constructed by combining a time sequence dependency relationship of a long and short term memory network capture signal. And according to the echo type label and the echo cancellation model, target echo signal characteristics are extracted, and echo-removed signal estimation is generated in combination with an adaptive filter. According to the method, the echo cancellation effect index is calculated by comprehensively analyzing the signal quality and echo residual characteristics after the echo is removed, the filter parameters are dynamically adjusted, voice enhancement is further carried out on the signal after the echo is removed through the deep convolution auto-encoder, and dual improvement of echo cancellation and voice enhancement is achieved.
Owner:SHENZHEN ZHILIAN TECH CO LTD

Audio feature extraction method based on cranial nerve model

The invention discloses an audio feature extraction method based on a cranial nerve model, and the method comprises the steps: obtaining voice signal data, carrying out the preprocessing of a voice signal, and segmenting the voice signal into N voice segments; extracting acoustic features representing emotional conditions from each voice segment, normalizing the acoustic features, and synthesizing the acoustic features into a multi-channel voice spectrogram; and inputting the multi-channel speech spectrogram into the RBA-FE model, outputting a BDI score, carrying out depression degree prediction classification according to the BDI score, adjusting parameters of each network layer in the RBA-FE model according to the difference between prediction classification and actual classification, and obtaining an optimal RBA-FE model to carry out depression degree detection. According to the method, the cell selectivity in the auditory cortex of the human brain is simulated, the problems of overfitting and non-noise resistance of the LSTM are solved by adopting a self-adaptive activation mechanism, and precise recognition of the depression voice under different noise interferences is realized.
Owner:SOUTH CHINA UNIV OF TECH +1

Speech recognition method, system and device based on artificial intelligence and medium

The invention provides a voice recognition method, system and device based on artificial intelligence and a medium. The method comprises the steps of obtaining a to-be-recognized voice signal; performing keyword extraction on an initial voice text corresponding to the voice signal based on a pitch period determined by an amplitude deviation between adjacent voice amplitudes in the voice signal and a voice spectrogram of the voice signal to obtain a plurality of voice keywords; determining a homonym group of each voice keyword, and performing recognition verification on each voice keyword based on context semantic information of each voice keyword in the initial voice text and semantic features of homonyms in each homonym group to obtain recognition ambiguity of each voice keyword; and recognizing text probability distribution of the voice signal according to the recognition ambiguity and the homonym group corresponding to each voice keyword, and analyzing the text probability distribution to obtain a text recognition result of the voice signal. According to the scheme, based on the text probability distribution, the speech recognition accuracy can be improved under homonym confusion.
Owner:IFLYTEK LINGZHI (JIANGSU) TECH CO LTD

Large-model high-quality reasoning method and system supporting edge computing device

The invention relates to the technical field of large model data processing, in particular to a large model high-quality reasoning method and system supporting edge computing equipment, and the method comprises the steps: obtaining a voice collection vector; obtaining a time-frequency characteristic value of each element at each frequency at a corresponding moment according to a frequency domain information stability condition and a self-similar characteristic comparison condition of all elements in time windows with different lengths by taking each element in the voice acquisition vector as a center; according to the distribution discrete condition of the time-frequency characteristic values and the energy amplitudes of all the elements at all the frequencies at the corresponding moments, the emotion significance at all the frequencies is obtained; according to the emotion saliency at each frequency, the energy amplitude of each frequency in the voice spectrum of the voice acquisition vector is filtered and then inversely transformed, and a filtered voice acquisition vector is obtained; and carrying out large model reasoning on the filtered voice acquisition vector by adopting edge computing equipment. According to the invention, the accuracy of large model reasoning calculation can be improved.
Owner:LANKING INFORMATION TECH NANJING CO LTD

Voice signal processing method and device, electronic equipment and readable storage medium

The invention relates to a voice signal processing method and device, electronic equipment and a readable storage medium. Under the condition that a part of sound signals of a user object are collected, corresponding intermediate feature representation is extracted from the part of sound signals, supplementary sound features corresponding to the user object are determined, synthesis processing is performed on the intermediate feature representation and the supplementary sound features, and a complete speech spectrum corresponding to the part of sound signals is obtained. And carrying out acoustic code conversion on the complete speech spectrum to obtain a converted audio signal. Since the intermediate feature representation is text content extracted from a part of sound signals, and the supplementary sound features describe the sound characteristics and styles of the user object, the intermediate feature representation of the part of sound signals of the user object and the supplementary sound features of the user object are synthesized, so that the sound characteristics and styles of the user object are obtained. Therefore, the finally obtained audio signal is not interfered by environmental noise, and the quality of the audio signal can be ensured.
Owner:LUXSHARE PRECISION TECH(NANJING) CO LTD

Speech spectrum reconstruction method and system combining time domain half-wave rectification and weighted Gaussian mixture model decoder, terminal and medium

The invention discloses a speech spectrum reconstruction method and system combining time-domain half-wave rectification and a weighted Gaussian mixture model decoder, a terminal and a medium, and relates to the technical field of speech signal processing, the method comprises the following steps: acquiring a low-resolution audio, executing time-domain half-wave rectification, and executing weighted Gaussian mixture model decoding; obtaining a mixed amplitude spectrum based on the amplitude spectrum of the low-resolution audio and the amplitude spectrum of the rectification signal; outputting GRU features based on an encoder, inputting the GRU features into a weighted Gaussian mixture model decoder, and generating a plurality of groups of Gaussian component parameters through three parallel linear layers and applying three constraint designs; and calculating a frame-level frequency distribution weight, combining the frame-level frequency distribution weight with the mixed amplitude spectrum to obtain a model output amplitude spectrum, inputting the model output amplitude spectrum and the amplitude spectrum of the low-resolution audio into a frequency band guide masking module to obtain a final amplitude spectrum, and reconstructing an audio time domain waveform based on the final amplitude spectrum and the phase of the low-resolution audio. According to the method, high-fidelity and high-frequency reconstruction can be realized while the complexity of the model is greatly reduced.
Owner:ELEVOC TECH CO LTD

Artificial intelligence psychological assessment method and device based on multiple modes

The invention discloses an artificial intelligence psychological assessment method and equipment based on multiple modes, particularly relates to the technical field of psychological assessment analysis, and aims to solve the problem of high detection error rate caused by biological characteristic distortion due to privacy desensitization in existing psychological assessment. The method comprises the following steps of: dynamically generating an evaluation instruction matched with a user behavior, collecting a facial micro-expression video, segmenting and quantifying a privacy interference level based on region pixels, and fuzzifying a non-sensitive region while keeping key micro-expression region characteristics; synchronously acquiring a voice spectrum waveform and reconstructing voiceprint tone modification and fundamental frequency waveform; extracting text sentiment keywords to construct a cross-stage sentiment association chain to repair semantic fracture caused by local desensitization; and according to the privacy interference level, dynamically adjusting the fusion weight of the video and the voice to generate a stage evaluation parameter and a time sequence label, and finally constructing a psychological state evolution graph and outputting an evaluation report, so that the emotional feature fidelity and the psychological state analysis precision are remarkably improved.
Owner:HANGZHOU XINWA TECHNOLOGY CO LTD

Speech synthesis processing method and device and related equipment

The invention belongs to the technical field of financial science and technology, provides a speech synthesis processing method and device and related equipment, and aims to solve the problem of low similarity between a synthesized speech and a real person speech in the traditional technology, the speech synthesis processing method comprises the following steps: obtaining a text to be converted into a speech, obtaining a prompt text, and determining a discrete semantic token; establishing an alignment relationship between the text and the discrete semantic token based on a preset text speech big language model according to the prompt text to obtain a target discrete semantic token corresponding to the text, determining a speech spectrum feature corresponding to the target discrete semantic token based on a preset condition flow matching model, and synthesizing a speech spectrum feature corresponding to the target discrete semantic token based on a preset speech synthesis decoder. And generating the voice spectrum characteristics into the voice signals to obtain the voice, so that the similarity between voice synthesis and real person voice can be improved, for example, for self-service voice service of insurance business or banking business, the voice is synthesized in the mode, and the synthesized voice and the real person voice can have relatively high similarity.
Owner:PING AN TECH (SHENZHEN) CO LTD

Bluetooth earphone call intelligent noise reduction method based on cloud collaboration

The invention discloses a Bluetooth earphone call intelligent noise reduction method based on cloud cooperation, and the method comprises the following steps: S1, obtaining a call voice signal and an environment state parameter, carrying out the preprocessing, and constructing a voice spectrum sequence and an environment feature sequence; s2, performing noise estimation and suppression processing on the speech spectrum sequence by using a DCCRN model to obtain a spectrum feature sequence; s3, constructing a cooperative processing sequence based on the environment feature sequence and the spectrum feature sequence; s4, using a Conv-TasNet model to execute speech enhancement on the co-processing sequence, and generating a target spectrum sequence; s5, performing phase reconstruction and inverse frequency spectrum transformation based on the target frequency spectrum sequence to generate a target voice signal; and S6, constructing a loss function according to the target voice signal, and updating the Conv-TasNet model. According to the method, the DCCRN model and the like are fused, and the method has the advantages of high noise reduction precision, high environment adaptability and sustainable optimization.
Owner:深圳市美迪声科技有限公司

Radio analog telephone communication encryption method, device, equipment and medium

The invention discloses a radio analog telephone communication encryption method, device and equipment and a medium, and the method comprises the steps: generating a frequency spectrum segment number and a pseudo-random sorting sequence through a preset encryption algorithm; and carrying out controllable segmentation on the total spectrum of the analog voice according to a continuous sequence from low frequency to high frequency, carrying out sequence recombination on each sub-spectrum according to a pseudo-random sequence, finally combining and outputting encrypted voice, and recovering the original voice by utilizing the same pseudo-random sequence reverse recombination at a receiving end. Therefore, the time-frequency continuity and statistical characteristics of the voice spectrum in the traditional radio analog communication are fundamentally changed. According to the method, frequency spectrums are recombined as a whole according to a pseudo-random rule, so that an eavesdropper can only obtain disordered voice signals after the frequency spectrums are rearranged even if the eavesdropper intercepts the signals, and the difficulty of passive cracking means such as frequency spectrum analysis, filtering reduction and voice recognition is remarkably increased; the problem that in the prior art, radio analog telephone communication is insufficient in encryption and easy to crack is solved.
Owner:SHENZHEN TIANHAI COMM CO LTD

Single-channel human-computer interaction speech separation method, device, computer equipment and medium

The present application relates to a single-channel human-computer interaction speech separation method, device, computer equipment and storage medium. The method comprises: training a first time-frequency mask for extracting a machine speech spectrum and a second time-frequency mask for extracting a real person speech spectrum through a time-series recurrent neural network; performing speech separation processing on the target human-computer interaction speech to be separated according to the first time-frequency mask and the second time-frequency mask trained by the time-series recurrent neural network, and obtaining the machine speech and real person speech separated from the target human-computer interaction speech. The embodiment of the present application can significantly reduce the training data required for deep learning and shorten the training time without losing the separation accuracy of the monophonic human-computer interaction speech, while also improving the speech separation speed.
Owner:SHANGHAI SHUHE INFORMATION TECH CO LTD