98 results about "Vocal pitch" patented technology

The invention provides a multi-language cross-culture communication assisting method and system based on a large model. The method comprises the following steps: receiving a source language audio stream during a call, calling a multi-language sound frequency harmonic modulation feature library to extract fundamental frequency harmonic intensity distribution and tone turning features, and generating a cultural acoustic fingerprint vector; based on the vector, controlling a microphone array phase difference, directionally enhancing a fundamental frequency harmonic component of a speaker and suppressing noise, and outputting a high signal-to-noise ratio spectrogram; analyzing the pronunciation rhythm and tone turning characteristics of the spectrogram, capturing the pitch jump and duration of the syllable boundary, and generating an acoustic culture label; associating the spectrogram with a target semantic library, matching harmonic distribution and a cultural context rule based on a large model, and outputting a cultural interpretation prompt containing an ambiguity resolution suggestion; and generating a calibration result according to the acoustic tag and the semantic prompt, and overlapping the dynamic floating subtitles to the face area of the speaker in the video conference picture. According to the invention, cultural tone ambiguity in multi-language communication is eliminated.

The invention relates to the technical field of voice processing, can be applied to business scenes such as financial science and technology, medical health and the like, and discloses a cross-language voice migration synthesis method, device, equipment and medium. And training an acoustic model by adopting a hierarchical self-adaptive fine tuning strategy, fusing the phoneme sequence for reasoning and the tone mark to generate a representation sequence, and finally synthesizing a target language speech signal. According to the method, a sharing and separation parallel cross-language modeling structure is constructed, the accuracy of phoneme and tone modeling in a low-resource language is effectively improved, the target language acoustic model has higher generalization ability and migration efficiency in combination with a multi-stage self-adaptive fine tuning and training data enhancement strategy, and the method is suitable for being applied to the field of multi-language modeling. And finally, synchronous improvement of the voice naturalness and the tone fidelity is realized.

The invention belongs to the field of intelligent voice, and particularly relates to an intelligent health robot combining intelligent dialogue and health intervention, which comprises a voice recognition module and a rehabilitation guidance module, and is characterized in that the voice recognition module comprises a voice acquisition unit, a voice compensation unit and a multi-mode recognition unit; the method comprises the following steps: acquiring user voice by a voice acquisition unit, compensating formant features and pause discrimination by a discrimination filter, and obtaining a to-be-recognized voice feature space; correcting voice missing words and tones through a voice compensation unit to obtain a corrected to-be-recognized voice feature space; the multi-modal recognition unit outputs the voice text and the demand intention space according to the voice text and the demand intention space, and obtains an intention emotion state space by combining a preset evaluation interval; and finally, the rehabilitation guidance module calls an enhanced reasoning strategy library to generate a rehabilitation strategy intervention scheme according to the demand intention space and the emotional state space, and performs real-time voice output to realize intelligent dialogue and health intervention.

The invention discloses a natural statement decoding method and device based on high-density electrocorticogram. The method comprises the following steps: acquiring an electroencephalogram signal acquired based on the high-density electrocorticogram; different frequency band signals are extracted from the electroencephalogram signals; the signals of different frequency bands comprise high gamma frequency band signals and at least one frequency band signal with the frequency lower than that of the high gamma frequency band signals; acquiring a voice starting point corresponding to each frequency band signal, and determining a target voice starting point based on the voice starting point corresponding to each frequency band signal; after the target voice starting point, acquiring a syllable classification result and a tone decoding result corresponding to each frequency band signal, determining a target syllable classification result based on the syllable classification result corresponding to each frequency band signal, and determining a target tone decoding result based on the tone decoding result corresponding to each frequency band signal; and determining a target tone language corresponding to the electroencephalogram signal based on the target syllable classification result and the target tone decoding result. According to the scheme, the natural statement decoding accuracy can be improved.

The invention provides a Suzhou dialect medical voice electronic medical record conversion system and method, and the system comprises an acoustic feature extraction module which is used for extracting the acoustic features of an input voice signal; the dialect tone recognition module is used for recognizing a multi-tone system of Suzhou dialects; the voiced sound processing module is used for detecting voiced sound initial consonants in Suzhou dialects and performing acoustic feature mapping; the medical term mapping module comprises a corresponding relation library of dialect medical vocabularies and standard medical terms and a context-based ambiguity resolution unit; the speech recognition engine comprises an acoustic model, a pronunciation dictionary and a language model; and the medical record generation module is used for converting the identification result into a structured electronic medical record. According to the method, a sliding window processing strategy is adopted, continuous voice input of a doctor can be effectively processed, a long-time voice input scene is supported, and various requirements in actual clinical application are met.

The invention relates to the technical field of speech recognition, in particular to a Chinese learner-oriented tone evaluation and improvement method, which comprises the following steps of: extracting a fundamental frequency F0 curve and sound channel parameters of a speech signal, constructing a turbid and clear adaptive fusion model, and fusing to generate fundamental frequency related characteristics and fundamental frequency unrelated characteristics; constructing a tone error corpus, carrying out tone classification labeling, generating a multi-level tone feature set through a turbid and clear adaptive fusion model, aligning a voice signal with a reference voice time domain, and extracting and decoupling a tone shape feature vector and a tone domain feature vector; and based on the decoupled feature vectors, establishing a dual-channel evaluation path, hierarchically calculating the tone type distance and the tone domain distance of the tones, carrying out weighted fusion, generating a final evaluation score, and finally generating feedback information for the Chinese learner. According to the method, a complete method from feature decoupling to two-channel evaluation is constructed, the pronunciation problem of the learner is quantitatively diagnosed, and the pertinence and efficiency of Chinese tone learning are improved.

A tone evaluation rehabilitation training device and system, the device comprises a flexible cap body and a bandage, the cap body is integrated with a 10-channel electrode plate to accurately cover language brain areas on both sides, electroencephalogram signals are transmitted in real time through Bluetooth 5.0, and a noise reduction earphone is used for providing sound output for a patient. The microphone is used for collecting audio of a patient and transmitting the audio to the processing module for analysis, the system dynamically regulates acoustic stimulation based on the neural activation feedback module, high-precision tone recognition is achieved in combination with audio preprocessing, SpecAugment data enhancement, a CNN-Transform mixed model and an attention mechanism, and training efficiency is optimized through pre-training model fine tuning and Warmup learning rate scheduling. An initial consonant-vowel-tone three-dimensional confusion probability table is introduced to divide interference intensity grades, high and low interference task paths are dynamically switched through a semantic error rate, and an evaluation module generates a four-tone accuracy rate, an F0 curve comparison graph and a personalized rehabilitation scheme. The recognition precision is improved, the training period of special crowds is shortened, and full-period self-adaptive rehabilitation is provided for preschool children to speech disorder patients.

The invention provides a Suzhou dialect speech recognition system and method based on a tone track neural field, and the system comprises a tone track neural field module which is used for modeling the tone change of Suzhou dialects into a continuous space-time neural field; the bidirectional semantic memory network module comprises a forward prediction memory bank and a backward correction memory bank; the phoneme-font coupling error corrector is used for realizing polyphone disambiguation and homonym error correction by establishing association mapping between a phoneme sequence and a font sequence; the semantic entropy calculation module is used for evaluating the uncertainty of the recognition result; and the self-adaptive fusion decision module is used for generating a final recognition text. According to the invention, through an online learning mechanism, the system can continuously accumulate experience from actual use, automatically discover a new language mode and update an identification strategy. The self-improvement capability enables the system to adapt to the dynamic change of languages, and the performance is continuously improved along with the increase of the use time. Each use of the user helps the system to become more intelligent and accurate.

The invention relates to the technical field of voice processing, in particular to a Chinese tone error correction system and method for cross-modal adversarial generation, and the system comprises a multi-channel tone spectrum specialized decomposition module which is used for processing voice signals in parallel and extracting multi-scale tone features; the self-adaptive spectrum attention mask module is used for generating a spectrum enhancement mask and carrying out dynamic enhancement on a frequency region related to the tone characteristics; the tone characterization module is used for generating tone characterization vectors through comparative learning; the tone error detection module is used for analyzing the tone representation vector to determine a tone error type and an error mode; the multi-mode feedback module is used for generating tone pronunciation and tongue position action comprehensive guidance feedback based on tone error types and error modes, the tone error detection accuracy is improved, the system improves the tone error detection rate to 95% and the accuracy rate to 92% through the multi-channel tone frequency spectrum specialized decomposition and self-adaptive frequency spectrum attention mask technology, and the tone error detection accuracy is improved. And particularly, the detection accuracy of the third sound is remarkably improved.

The present invention relates to the field of speech processing technology, and in particular to a Chinese tone error correction system and method for cross-modal adversarial generation. The system includes a multi-channel tone spectrum-specific decomposition module for processing speech signals in parallel and extracting multi-scale tone features; an adaptive spectrum attention mask module for generating a spectrum enhancement mask and dynamically enhancing frequency regions related to tone features; a tone representation module for generating a tone representation vector through contrastive learning; a tone error detection module for analyzing the tone representation vector to determine the type and pattern of tone errors; and a multi-modal feedback module for generating comprehensive guidance feedback on tone pronunciation and tongue position based on the type and pattern of tone errors, thereby improving the accuracy of tone error detection. The system uses multi-channel tone spectrum-specific decomposition and adaptive spectrum attention mask technology to increase the tone error detection rate to 95% and the accuracy to 92%, and in particular significantly improves the detection accuracy of the third tone.

The invention discloses an emotion category determination method and device, equipment, a storage medium and a product. The method comprises the following steps: acquiring audio data; extracting an MFCC feature of the audio data and a first feature of a pinyin syllable; converting the audio data into a text, and determining an intonation embedding feature of each word in the text, and a word embedding feature, a position embedding feature and a segment embedding feature of the text; fusing the MFCC feature, the first feature, the intonation embedding feature, the character embedding feature, the position embedding feature and the segment embedding feature to obtain a second feature; and inputting the second feature into an emotion recognition model, and determining a target emotion category corresponding to the second feature according to relationship information between a preset feature and a preset emotion category in the emotion recognition model. Various features such as voice features, text features, intonation features and tone features based on human auditory characteristics are fused, and the accuracy of determining the emotion category of the audio data is improved.

The invention discloses a cross-language speech recognition method, system and device and a storage medium, and the method comprises the steps: carrying out the preprocessing of training speech, and obtaining a training speech frame sequence; extracting content characterization, speaker characterization and pitch characterization from the training voice frame sequence; performing voice reconstruction according to the content representation, the speaker representation and the pitch representation to obtain a target language voice; based on the training voice, constructing a target language voice recognition model according to the target language voice; in response to the target language recognition instruction, obtaining a target voice; and inputting the target voice into the target language voice recognition model to obtain a recognition result output by the target language voice recognition model, so that accurate modeling of dialect acoustic characteristics can be realized under the condition of extremely low annotation data through cross-language feature decoupling and a self-supervised migration mechanism. The recognition robustness of the complex tones and the characteristic vocabularies of the Guiwili is remarkably improved, and efficient generalization application in a dialect scene is achieved.

The application belongs to the technical field of audio processing, and specifically provides a melody note sequence generation method and system based on tone features and machine learning, an electronic device, and a storage medium. The method comprises obtaining a tone sequence based on an original Chinese text; constructing a rich context feature vector; pre-training a gradient boosting model; inputting the context feature vector into the pre-trained gradient boosting model to obtain the probability distribution of each category under the melody mode; concatenating the probability distribution of each category under the melody mode in order to generate a melody note sequence separated by spaces; and obtaining slow, clear, and rhythm-exaggerated singing audio suitable for aphasia MIT rehabilitation based on the melody note sequence and the Chinese text. The application automatically extracts Chinese tone features and predicts the melody mode with context awareness, thereby realizing high-quality generation from Chinese text to natural melody note sequence.

This invention belongs to the field of audio processing technology and provides an intelligent accompaniment singing method and system. The method can collect the user's vocal pitch and voiceprint information, then divide the song selected based on the song selection command into vocal data and accompaniment data. The pitch of the accompaniment data is adjusted by comparing the vocal data with the user's vocal pitch, and the audio is played based on the adjusted accompaniment data. The user's singing data is continuously acquired and monitored, and when the user's singing data meets preset conditions, accompaniment vocals generated using the voiceprint information and vocal data are added to the audio. This proposed method can tailor the song's pitch to the user's individual needs, adjusting the accompaniment pitch to a suitable range for the user, ensuring easier singing. It can also selectively add accompaniment vocals based on the user's singing performance, thereby guiding the user to adjust their singing style, improve their singing level, and enhance their singing experience.

The application discloses an AI generated text detection method, system, device and medium, and relates to the technical field of text processing. The application converts a Chinese text sentence to be detected into a tone category sequence composed of tone categories. In this process, the categories of Chinese tones are used as a quantitative index of phonological structure, and text analysis is converted from a high-dimensional and high-cost semantic space to a low-dimensional and high-efficiency phonological feature space. The application is not dependent on training data of a specific model and is adaptable to text detection of multiple models. Then, N-gram analysis is performed on the generated tone category sequence, and the occurrence frequency of each N-gram combination is calculated to form a feature vector. Finally, an AI generated text is judged through a pre-trained classification model. In this process, the calculation type in processing is mainly string processing and frequency statistics, and the inconsistency problem of the model in multiple model invocations is avoided, so that the AI generated text can be accurately detected.

The invention relates to the technical field of voice data processing, in particular to a video voice recognition method and system for illegal short videos, and the method comprises the steps: obtaining a prohibited lexicon and a to-be-detected video, and converting Chinese characters in the prohibited lexicon and the to-be-detected video into pinyin character strings which do not contain tones; the step of comparing each to-be-detected Chinese character with each forbidden word in the forbidden word bank is as follows: determining the similar weight of the forbidden word of each to-be-detected Chinese character; analyzing the closeness degree of serial numbers of the most similar Chinese characters in the forbidden words of the to-be-detected Chinese characters and the adjacent Chinese characters based on the pinyin character strings, and determining forbidden word matching values of the to-be-detected Chinese characters in combination with the forbidden word similar weights; judging whether each to-be-detected Chinese character is a prohibited Chinese character or not based on the distribution condition of the prohibited word matching value of each to-be-detected Chinese character and the adjacent Chinese character; and taking the to-be-detected video with the prohibited Chinese characters as a violation video. The invention aims to improve the detection accuracy and efficiency of illegal short videos.

The invention discloses a semantic analysis method for voice in a crowded environment. The method comprises the following steps: acquiring voice signal data and lip movement video stream data of a target user; extracting a lip motion feature sequence, and mapping the lip motion feature sequence into a predicted speech feature vector; inputting a voiceprint separation model, separating a voice segment of a target user from the mixed voice signal, and generating pure voice data features; performing time domain segmentation on the pure voice data features to obtain a voice signal time domain waveform of a single character; matching the single character voice signal time domain waveform with an initial consonant and vowel time domain waveform library to obtain pinyin expression corresponding to each character; and carrying out tone combination correlation analysis on the pinyin expressions of the continuous single characters to obtain the meaning of the voice segment of the target user. The method has the advantages that the voice of the target user is effectively extracted by combining the lip movement video stream and the voice signal data and utilizing the deep learning and voiceprint separation technology, and the voice recognition accuracy in the noisy environment is remarkably improved.

The invention provides a Chinese pronunciation defect recognition method and system based on speech recognition, and the method comprises the steps: obtaining a Chinese speech signal, generating an initial time-frequency spectrum through short-time Fourier transform, extracting a frequency feature sequence from the initial time-frequency spectrum, carrying out the segmentation processing of the speech signal through a time-domain signal segmentation technology, and carrying out the recognition of a Chinese pronunciation defect. Preliminary segmentation fragments are obtained; for the abnormal tone distribution diagram and the abnormal airflow distribution diagram, fusing tone duration and breathing rhythm mode features to generate a comprehensive feature matrix, performing boundary optimization on an abnormal interval through tone smoothing processing, and determining feature distribution after smoothing; and positioning a specific pronunciation defect syllable through the defect candidate interval in combination with conjoint analysis of a tone change mode and an airflow amplitude threshold value, tracing correlation characteristics of a frequency abrupt change point location and signal energy distribution, and judging a defect cause combination to obtain a final defect positioning result.

The present application relates to an unsupervised speech recognition modeling method based on phoneme segment level representation discretization, belonging to the field of speech recognition. The present application uses an IFMF model to extract phoneme features from the original audio through a speech feature discretization module, then trains a K-Means clustering algorithm to cluster the audio representation, and obtains the clustering index as a discrete label; through an adversarial learning module, a generator network and a discriminator are trained; through a speech discrete representation decoder module, a language model is used to decode the phoneme discretization-based model output obtained by unsupervised training. The present application fuses multiple speech features, adopts a phoneme segment level representation discretization method, considers the influence of tone information on the Lao language, and as much as possible reduces the influence of information redundancy caused by fine-grained features on cross-modal modeling. The method of the present application achieves competitive results compared with traditional speech recognition methods.

The present invention belongs to the field of intelligent voice, and particularly relates to an intelligent health robot that combines intelligent conversation and health intervention, including a speech recognition module and a rehabilitation guidance module. The speech recognition module includes a speech acquisition unit, a speech compensation unit, and a multi-modal recognition unit. First, the speech acquisition unit collects the user's speech, compensates for the formant features and pause discrimination through a discriminant filter to obtain the speech feature space to be recognized. Then, the speech compensation unit corrects the speech omission words and tones to obtain the corrected speech feature space to be recognized. The multi-modal recognition unit then outputs the speech text and the demand intention space, and combines with a preset evaluation interval to obtain the intention emotion state space. Finally, the rehabilitation guidance module generates a rehabilitation strategy intervention plan according to the demand intention space and the emotion state space, calls the reinforcement inference strategy library, and outputs it in real-time speech, realizing intelligent conversation and health intervention.

The invention relates to the technical field of speech recognition, in particular to a speech recognition method and system based on big data, and the method comprises the steps: collecting each speech signal frame and the fundamental frequency thereof in a target region, obtaining a first matching index of each voice signal frame with a positive tone, a second matching index of each voice signal frame with a negative tone, a third matching index of each voice signal frame with a negative tone, and a fourth matching index of each voice signal frame with a positive tone; taking the maximum value of the first matching index, the second matching index, the third matching index and the fourth matching index corresponding to each voice signal frame as a characteristic value of each voice signal frame, obtaining a label of each characteristic value, and inputting each voice signal frame and the label of the characteristic value into a trained machine learning model, and obtaining the voice content of each voice signal frame. According to the invention, the problem of low voice content recognition accuracy is solved.

This invention proposes an intelligent error correction method and system for ethnic vocal music dialect prosody. The method includes: collecting multimodal data, extracting features to form a training dataset, constructing and updating a dynamic dialect prosody map, and performing cross-modal comparative analysis to obtain a joint representation of cross-modal error features. A neural vocoder direct-connect correction model is constructed, inputting the joint representation to generate a corrected Mel spectrum. A cross-modal generative adversarial network is constructed, including a generator and three discriminators. The generator generates a joint latent representation based on high-fidelity corrected audio and three features. The three discriminators respectively judge the naturalness of the audio, the compliance of the text tone, and the rhythmic coordination of the musical score. This invention solves the problem of manual error correction by constructing a prosody map, overcomes the bottleneck of manual detection by utilizing cross-modal comparative analysis, improves the generalization ability of the model by combining meta-learning algorithms, and optimizes the correction results with the help of adversarial networks, thereby reducing manual costs and improving the error correction efficiency of ethnic vocal music works.

The application discloses a Tibetan speech recognition method fusing tone perception hybrid experts and retrieval error correction, and belongs to the technical field of signal processing in the electronic industry. The specific steps of the recognition method are as follows: I: Tibetan speech signals are acquired, and corresponding log-mel spectrogram features and fundamental frequency contour features are extracted; II: the tone gating weight is calculated based on the fundamental frequency contour features, and is dynamically routed to the corresponding hybrid expert network to acquire dialect-independent acoustic hidden layer features. The application effectively solves the model interference problem caused by the presence or absence of tones among multiple dialects, avoids the parameter conflict between tone dialects and non-tone dialects, significantly improves the recognition performance of multi-dialect hybrid training, corrects the homonym heterograph error commonly existing in Tibetan, improves the performance of multi-dialect Tibetan speech recognition, can be used for converting Tibetan speech into characters, and is helpful for protecting and mining Tibetan culture.

This invention relates to the field of speech recognition technology, specifically a spoken pronunciation correction and evaluation method. The method includes: constructing an audio time-series sequence containing multiple phonemes based on the standard text spoken by the user; comparing the audio features corresponding to different phonemes in the audio time-series sequence based on the standard pronunciation of each phoneme to locate the pronunciation deviation position corresponding to each phoneme; if the current phoneme has a pronunciation deviation position, performing contextual scene analysis on the pronunciation deviation position by combining the duration, interval, and tone of the preceding and following phonemes to determine the deviation type in the current phoneme's context; identifying the user's abnormal pronunciation patterns; and configuring correction weights for each abnormal pronunciation pattern based on the difference feature values ​​between any two abnormal pronunciation patterns, and determining the correction direction corresponding to each phoneme according to the correction weights of the abnormal pronunciation patterns. This achieves targeted and efficient spoken pronunciation correction.

An audio interface comprises a CPU (central processing unit) that includes a DSP (digital signal processor), a MIDI (musical instrument digital interface) processor, and two Voc FX (vocal effects) modules; MIDI IN, MIDI OUT, and MIDI HOST ports connected to the MIDI processor; first and second microphone ports connected to the first and second Voc FX modules, respectively; a plurality of OUTPUT ports connected to the DSP; and first and second HOST ports connected to the DSP; wherein the audio interface provides multi-host redundancy, real-time signal processing and MIDI control,

Provided are a method, apparatus, and medium for recognizing tones of speech. The method comprises: detecting the duration position of a vowel of a vowel in a speech to be recognized; detecting a tone core portion of the speech to be recognized based on the duration position of the vowel of the vowel; and identifying the tone category of the speech to be recognized based on the tone core portion. Thus, according to at least one embodiment of the present disclosure, the tone core portion can be more accurately detected within the duration position of the vowel of the vowel, thereby more accurately identifying the tone category.

The invention relates to the technical field of artificial intelligence, and provides a speech synthesis method, device and equipment and a medium, which are applied to the fields of medical treatment, finance and the like, and the method comprises the following steps: integrating initial speech data to obtain target speech data; extracting the target voice data to obtain target phoneme features; fusing the target voice data and the target phoneme features to obtain target fusion features; and synthesizing the target fusion feature based on a synthesis strategy to obtain a target synthesized speech. According to the embodiment of the invention, the method achieves the integration processing of the initial voice data to obtain the target voice data, carries out the extraction and fusion processing of the target voice data to obtain the target fusion features, and carries out the synthesis processing of the target fusion features based on the synthesis strategy to obtain the target synthesis voice. The tone accuracy and the phoneme alignment accuracy of the synthesized voice are improved, the method has good field adaptability and rhythm continuity, high fidelity of small sample voice cloning is ensured, and therefore the synthesis efficiency is improved.

The invention relates to the technical field of speech recognition, in particular to a spoken language pronunciation correction evaluation method based on deep learning, which comprises the following steps: constructing an audio time sequence containing a plurality of phonemes on the basis of a standard text when a user pronunciates; on the basis of the standard pronunciation of each phoneme, comparing audio features corresponding to different phonemes in the audio time sequence, and positioning a pronunciation deviation position corresponding to each phoneme; if the current phoneme has the pronunciation deviation position, performing context scene analysis on the pronunciation deviation position by combining the duration, interval and tone of the previous and next phonemes, and determining the deviation type of the current phoneme in the scene; identifying an abnormal pronunciation mode of the user; and based on the difference characteristic value between any two abnormal pronunciation modes, the correction weight of each abnormal pronunciation mode is configured, and the correction direction corresponding to each phoneme is determined according to the correction weight of the abnormal pronunciation mode. The pertinence and the processing efficiency of spoken language pronunciation correction are realized.

The invention discloses a Korean Chinese character input system and a marking method thereof, and relates to the technical field of Chinese character input systems. The problem that an existing Chinese character Korean pronunciation input system cannot achieve the effect that one Chinese character corresponds to one Korean pronunciation character is solved. The Korean syllable consonant module comprises a tone module, a Korean syllable consonant module and a Korean syllable consonant module, the Korean syllable consonant module comprises a single syllable consonant unit and a compound syllable consonant unit, the Korean syllable consonant module comprises a single syllable consonant unit, a compound syllable consonant unit and a tail syllable consonant unit, and the Korean syllable consonant module and the Korean syllable consonant module comprise a left-right structure and an up-down structure. According to the method, pronunciation and tones of Chinese characters are accurately marked through continuous use and recombination of existing Korean letters, the Chinese characters can be directly learned and input through pronunciation of the Korean letters, and the Chinese characters can be accurately spelling and read according to Korean sound marks; corresponding Chinese characters can be input and typed according to the pronunciation of the Chinese characters and the Korean pronunciation spelling method, so that the Chinese learning efficiency is improved.

The invention discloses a song recognition method, electronic equipment, a storage medium and a product. The method comprises the following steps: acquiring first audio data; determining first syllable information and first tone information based on the first audio data; determining a first syllable duration based on the first syllable information; determining second audio data corresponding to the first audio data based on the first tone information, the first syllable duration and a database; the database comprises at least one piece of second audio data and second tone information and second syllable duration corresponding to the second audio data; the first syllable duration represents the duration of each syllable in the first audio data, and the second syllable duration represents the duration of each syllable in the second audio data. The song is searched by using the tone in the audio and the duration of each syllable, so that the song identification flexibility is improved, and the identification accuracy is improved.