Audio content real-time detection device

Abstract

The invention provides an audio content real-time detection device, which comprises an input module, an audio distribution module and a play control module, and is characterized in that the input module is used for receiving input initial audio data; the audio distribution module is used for generating comparison audio data and output audio data according to the initial audio data, and is used for generating a switching signal according to the comparison audio data and preset entry data; the playing control module is used for receiving the output audio data and the switching signal sent by the audio distribution module, outputting the audio data in an audio mode and outputting preset warning voice when the switching signal is received.

Description

Technical Field

[0001] The present application relates to the field of speech recognition technology, and in particular to a device for real-time detection of audio content. Background Art

[0002] At present, audio recognition technology occupies an important position in the field of modern information processing. Its core is to extract information from audio signals and identify specific content or features. Among many audio recognition applications, speech recognition technology is the most widespread and well-known. Its main function is to convert human speech into text or instructions and perform corresponding operations based on the recognition results. There are many products based on speech recognition on the market, such as speech recognition switches, voice remote controls, etc. These devices can be controlled by voice commands, which greatly improves the user experience.

[0003] However, existing speech recognition technology also has some limitations. First, current speech recognition applications are mainly aimed at the execution of a single task, with relatively fixed functions and a lack of diversity and flexibility. This means that in a specific environment, these devices can only complete limited preset tasks and cannot meet the diverse needs of users. Secondly, existing speech recognition systems usually only respond to known voice commands and cannot recognize and process unknown audio source content. This limitation makes the existing system show certain limitations when facing changing environments or complex audio signals, and it is impossible to achieve comprehensive and accurate audio recognition. Summary of the invention

[0004] The present application provides a real-time audio content detection device for dual processing of audio data. While outputting the audio data, it switches to output a preset warning audio according to the detection result of the text content of the audio data, so as to be suitable for changeable and complex audio data, thereby realizing comprehensive and accurate audio recognition.

[0005] In a first aspect, an embodiment of the present application provides a device for real-time detection of audio content, characterized in that the device for real-time detection of audio content comprises: An input module, the input module is used to receive input initial audio data; an audio distribution module, the audio distribution module being used to generate comparative audio data and output audio data according to the initial audio data, and to generate a switching signal according to the comparative audio data and preset entry data; A playback control module, the playback control module is used to receive the output audio data and the switching signal sent by the audio distribution module, and is used to play the output audio data, and is also used to output a preset warning voice when receiving the switching signal.

[0006] In some embodiments, the audio distribution module includes: an audio distribution unit, the audio distribution unit being configured to generate the comparison audio data and the output audio data according to the initial audio data, and send the output audio data to the playback control module; a speech-to-text conversion unit, the speech-to-text conversion unit being used to generate transcribed text data according to the comparison audio data; A register unit, the register unit being used to receive and store the transcribed text data; A word library unit, the word library unit is used to store the preset word data, the preset word data includes a plurality of warning words; A comparison unit, wherein the comparison unit is used to perform a detection operation based on the transcribed text data and the preset entry data, and if the warning entry is detected in the transcribed text data, the switching signal is generated and sent to the playback control module.

[0007] In some embodiments, the audio distribution module further includes: A noise reduction unit, wherein the noise reduction unit is used to pre-process the comparative audio data and send the pre-processed comparative audio data to the speech-to-text conversion unit, wherein the pre-processing includes: filtering processing and denoising processing.

[0008] In some embodiments, the speech-to-text conversion unit is configured with a pre-trained natural language model, and the speech-to-text conversion unit is used to perform the step of generating transcribed text data according to the comparison audio data, specifically to perform: Based on the natural language model, extracting effective features of the comparative audio data, the effective features comprising: Mel frequency cepstral coefficients and linear prediction cepstral coefficients; The transcribed text data is generated according to the effective features.

[0009] The embodiment of the present application provides a real-time detection device for audio content, which includes: an input module, an audio distribution module and a playback control module, wherein the input module is used to receive input initial audio data; the audio distribution module is used to generate comparative audio data and output audio data according to the initial audio data, and is used to generate a switching signal according to the comparative audio data and preset entry data; the playback control module is used to receive the output audio data and the switching signal sent by the audio distribution module, and is used to output the audio data, and is also used to output a preset warning voice when the switching signal is received. Through the above method, the initial audio data is distributed as the same comparative audio data and output audio data through the audio distribution module, so that data multi-channel output is realized, and then the comparative audio data and the preset entry data are matched through the audio distribution module, and if the match is successful, a switching signal is generated, and finally the output audio data is directly played through the playback control module, and when the switching signal is received, it is switched to play the preset warning voice, thereby realizing the dual processing of the initial audio data, which does not affect the output of the initial voice data, and when sensitive content is detected in the initial voice data in real time, a warning is issued, so as to be applicable to variable and complex audio data, thereby realizing comprehensive and accurate audio recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0011] Figure 1 A schematic diagram of a first audio content real-time detection device provided in an embodiment of the present application; Figure 2 A schematic block diagram of a second device for real-time audio content detection provided in an embodiment of the present application.

[0012] Attached pictures example: 100. Real-time audio content detection device; 11. Input module; 12. Audio distribution module; 121. Audio distribution unit; 122. Voice-to-text conversion unit; 123. Register unit; 124. Entry library unit; 125. Comparison unit; 126. Noise reduction unit; 13. Playback control module. DETAILED DESCRIPTION

[0013] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0014] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0015] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0016] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0017] See also Figure 1 , Figure 1 FIG. 1 is a schematic diagram of a first audio content real-time detection device provided by an embodiment of the present application. Figure 1 As shown, the audio content real-time detection device 100 includes: an input module 11, an audio distribution module 12 and a playback control module 13.

[0018] The input end of the input module 11 is used to receive a sound signal, convert it into initial audio data, and send the initial audio data to the audio distribution module 12 .

[0019] The audio distribution module 12 is used to generate comparative audio data and output audio data according to the initial audio data, and to generate a switching signal according to the comparative audio data and preset entry data.

[0020] The playback control module 13 is used to receive the output audio data and the switching signal sent by the audio distribution module 12, and to play the output audio data. It is also used to output a preset warning voice when receiving the switching signal.

[0021] It should be noted that the audio content real-time detection device 100 can be configured in a server.

[0022] Among them, the server can be an independent server or a server cluster, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN) and big data and artificial intelligence platforms.

[0023] The embodiment of the present application provides a real-time detection device for audio content, which includes: an input module, an audio distribution module and a playback control module, wherein the input module is used to receive input initial audio data; the audio distribution module is used to generate comparative audio data and output audio data according to the initial audio data, and is used to generate a switching signal according to the comparative audio data and preset entry data; the playback control module is used to receive the output audio data and the switching signal sent by the audio distribution module, and is used to output the audio data, and is also used to output a preset warning voice when the switching signal is received. Through the above method, the initial audio data is distributed as the same comparative audio data and output audio data through the audio distribution module, so that data multi-channel output is realized, and then the comparative audio data and the preset entry data are matched through the audio distribution module, and if the match is successful, a switching signal is generated, and finally the output audio data is directly played through the playback control module, and when the switching signal is received, it is switched to play the preset warning voice, thereby realizing the dual processing of the initial audio data, which does not affect the output of the initial voice data, and when sensitive content is detected in the initial voice data in real time, a warning is issued, so as to be applicable to variable and complex audio data, thereby realizing comprehensive and accurate audio recognition.

[0024] In order to more clearly introduce the technical solution of the present application, the technical solution of the present application will be introduced through specific embodiments below. It should be noted that the specific embodiments are used to expand the technical solution of the present application, but are not intended to limit the present application.

[0025] In some embodiments, see Figure 2 , Figure 2 FIG. 1 is a schematic diagram of a second audio content real-time detection device provided by an embodiment of the present application. Figure 2As shown, the audio distribution module 12 includes: an audio distribution unit 121, a speech-to-text conversion unit 122, a register unit 123, a vocabulary unit 124 and a comparison unit 125. Among them, the input end of the audio distribution unit 121 is connected to the input module 11, and the output end of the audio distribution unit 121 is respectively connected to the output end of the speech-to-text conversion unit 122 and the first input end of the playback control module 13. The output end of the speech-to-text conversion unit 122 is connected to the input end of the register unit 123. The output end of the register unit 123 is connected to the first input end of the comparison unit 125. The vocabulary unit 124 is connected to the second input end of the comparison unit 125. The output end of the comparison unit 125 is connected to the second input end of the playback control module 13.

[0026] The audio distribution unit 121 is used to generate comparative audio data and output audio data according to the initial audio data, and send the output audio data to the playback control module 13 .

[0027] Exemplarily, the initial audio data is transmitted to the audio distribution unit 121 for multi-channel output. The audio distribution unit 121 distributes the input single-channel audio signal into multiple channels of identical audio signals (i.e., comparison audio data and output audio data) for output to meet the needs of different modules within the device. Specifically, part of the multi-channel audio output will be used for subsequent content recognition processing, while the other part will be used directly in the audio output channel of the playback control module 13. This process ensures that each module in the system can simultaneously obtain synchronized audio source signals and provide the necessary audio data source for subsequent steps.

[0028] The speech-to-text conversion unit 122 is used to generate transcribed text data according to the compared audio data.

[0029] Exemplarily, the distributed comparative audio data is input to the speech-to-text conversion unit 122 for text transcription. The speech-to-text conversion unit 122 uses advanced algorithms to conduct in-depth analysis of the audio signal, such as MFCC (Mel frequency cepstral coefficients) and LPCC (linear prediction cepstral coefficients) to capture the language feature vectors in the comparative audio data. These language feature vectors will be used in a pre-trained natural language model to identify specific text content in the audio. The recognition result generated in this step will be output in the form of text and used as input to the register unit 123 to provide basic data for the next step of text comparison.

[0030] The register unit 123 is used to receive and store the transcribed text data.

[0031] Exemplarily, the register unit 123, as an information storage medium, plays a key role in the entire audio recognition process. It not only saves all the transcribed text data generated by audio recognition, but also provides the system with data access support at any time. The key to this step is to provide a stable and reliable source of text information for the subsequent text comparison process, so that the system can quickly access and process this data when needed.

[0032] The term library unit 124 is used to store preset term data, and the preset term data includes a variety of warning terms.

[0033] The comparison unit 125 is used to perform a detection operation according to the transcribed text data and the preset word data. If a warning word is detected in the transcribed text data, a switching signal is generated and sent to the playback control module 13 .

[0034] The comparison unit 125 performs a text comparison operation, using a specific comparison algorithm to check whether the transcribed text data stored in the register unit 123 matches the warning word in the word library unit 124. If a match is detected, the comparison unit 125 will generate a switching signal and transmit this signal to the playback control module 13 so that appropriate audio output switching can be performed according to the matching result. If no match is detected, no switching signal is generated, and the system continues the current audio output state.

[0035] In some embodiments, Figure 2 As shown, the audio distribution module 12 further includes a noise reduction unit 126. The noise reduction unit 126 is connected between the audio distribution unit 121 and the speech-to-text conversion unit 122.

[0036] The noise reduction unit 126 is used to pre-process the comparative audio data and send the pre-processed comparative audio data to the speech-to-text conversion unit 122 . The pre-processing includes filtering and noise reduction.

[0037] The noise reduction unit 126 receives the comparative audio data and performs preliminary preprocessing on it, including noise reduction and filtering. The noise reduction algorithm can effectively remove background noise to ensure the clarity and purity of the comparative audio data; the filtering process is used to eliminate unnecessary frequency band interference and retain the audio frequency bands that are meaningful for subsequent recognition and processing. The preprocessed comparative audio data generated in this step will serve as the basis for subsequent audio allocation and recognition processing, providing clean and effective audio data input for the next step.

[0038] In some embodiments, the speech-to-text conversion unit 122 is configured with a pre-trained natural language model. When the speech-to-text conversion unit 122 is used to generate transcribed text data based on the comparative audio data, it is specifically used to perform: based on the natural language model, extracting effective features of the comparative audio data, the effective features including: Mel-frequency cepstral coefficients, linear prediction cepstral coefficients; generating transcribed text data based on the effective features.

[0039] The pre-trained natural language model can more accurately and comprehensively recognize the text content in the initial voice data.

[0040] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A real-time audio content detection device, characterized in that: The audio content real-time detection device comprises: An input module, the input module is used to receive input initial audio data; an audio distribution module, the audio distribution module being used to generate comparative audio data and output audio data according to the initial audio data, and to generate a switching signal according to the comparative audio data and preset entry data; A playback control module, the playback control module is used to receive the output audio data and the switching signal sent by the audio distribution module, and is used to play the output audio data, and is also used to output a preset warning voice when receiving the switching signal.

2. The audio content real-time detection device according to claim 1, characterized in that: The audio distribution module comprises: an audio distribution unit, the audio distribution unit being configured to generate the comparison audio data and the output audio data according to the initial audio data, and send the output audio data to the playback control module; a speech-to-text conversion unit, the speech-to-text conversion unit being used to generate transcribed text data according to the comparison audio data; A register unit, the register unit being used to receive and store the transcribed text data; A word library unit, the word library unit is used to store the preset word data, the preset word data includes a plurality of warning words; A comparison unit, wherein the comparison unit is used to perform a detection operation based on the transcribed text data and the preset entry data, and if the warning entry is detected in the transcribed text data, the switching signal is generated and sent to the playback control module.

3. The audio content real-time detection device according to claim 2, characterized in that: The audio distribution module also includes: A noise reduction unit, wherein the noise reduction unit is used to pre-process the comparative audio data and send the pre-processed comparative audio data to the speech-to-text conversion unit, wherein the pre-processing includes: filtering processing and denoising processing.

4. The audio content real-time detection device according to claim 2, characterized in that: The speech-to-text conversion unit is configured with a pre-trained natural language model. When the speech-to-text conversion unit is used to generate the transcribed text data according to the comparison audio data, it is specifically used to perform: Based on the natural language model, extracting effective features of the comparative audio data, the effective features comprising: Mel frequency cepstral coefficients and linear prediction cepstral coefficients; The transcribed text data is generated according to the effective features.

Images