An intelligent audio system

通过智能音频系统的多维度数据采集和评估判断模型,结合深度学习优化,解决了音频系统在长期传输中质量不符的问题,实现了音频数据的高效评分和优化,适应不同场景需求,降低了时间 Cost and distortion value.

CN117975979BActive Publication Date: 2024-12-17JIANGSU YUEMU YINCHUANG MEDIA TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311703852.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-13
Publication Date
2024-12-17
Estimated Expiration
2043-12-13

AI Technical Summary

Technical Problem

Existing audio systems may have problems during long-term transmission, lack of self-test, resulting in the collected audio not meeting the requirements, increasing time costs, and being unable to adapt to the needs of different scenarios.

Method used

An intelligent audio system was designed, including an acquisition module, an analysis unit, a processing unit and an optimization unit. Through multi-dimensional audio data acquisition, analysis and evaluation judgment, the evaluation and judgment model and deep learning optimization are used to optimize repeatedly until the output requirements are met, and the output requirements are reduced. Audio distortion value.

Benefits of technology

实现了对音频数据的有效评分和优化,确保音频传输质量,适应不同场景需求,降低了时间成本和失真值。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117975979B_ABST
    Figure CN117975979B_ABST
Patent Text Reader

Abstract

The present invention discloses an intelligent audio system, which relates to the field of audio processing, including collecting data information of a sound receiving device, obtaining multi-dimensional audio data, analyzing a multi-dimensional audio data set, obtaining an audio parameter set, setting an output evaluation and judgment set according to the audio parameter set, substituting the audio parameter set into the output evaluation and judgment set, obtaining output evaluation and judgment parameters, and directly outputting the obtained output evaluation and judgment parameters if the output evaluation and judgment parameters meet the output requirements; if the output evaluation and judgment parameters do not meet the output requirements, the embodiment of the present application obtains multi-dimensional audio data by collecting data information of a sound receiving device, and then analyzes the multi-dimensional audio data set to obtain an audio parameter set; if the requirements are met, the audio is output; if not, a recheck is performed until the requirements are met, and the audio parameter set is optimized to obtain the optimal audio processing effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of audio processing, and in particular to an intelligent audio system. Background Art

[0002] With the development of the Internet, the way of data transmission is becoming simpler and simpler, and the film, television and music industries have also developed accordingly. Regardless of whether it is in the film and television industry or the music industry, audio needs to be collected. At this time, a stable audio system is needed to collect the sound, and even the audio needs to be processed to ensure the best audio output and the quality of subsequent film, television and music playback.

[0003] An audio system is a system that processes and transmits sound signals. It includes multiple components, such as audio sources (such as microphones, CD players, etc.), audio processors (such as mixers, effects, etc.), power amplifiers, and speakers (speakers). The audio system is a complex system that involves the coordinated work of multiple devices and components to achieve high-quality audio processing and transmission. However, in the process of audio transmission, the collected audio may not meet the actual required standards due to problems with the data cable or site interference.

[0004] The existing method of processing audio data is generally to replace better data lines to enhance the ability to resist external interference during data transmission, and to transcode the audio to allow the audio data to be transmitted with higher quality to ensure the quality of the final collected audio data.

[0005] However, when audio is transmitted now, although the quality and stability of the audio are enhanced through external means, audio problems may still occur in long-term audio transmission. The lack of self-inspection of the audio causes the collected audio to not meet the requirements, and re-sampling is performed, increasing the time cost. At the same time, there is a lack of audio optimization and it cannot adapt to different scenarios. Summary of the invention

[0006] The present application provides an intelligent audio system for solving the problem that, during the existing audio transmission, although the quality and stability of the audio are enhanced through external means, audio problems may still occur in the case of long-term audio transmission. The lack of self-checking of the audio causes the collected audio to not meet the requirements, and re-sampling is performed, which increases the time cost. At the same time, there is a lack of audio optimization and the technical problem of being unable to adapt to different scenarios.

[0007] In view of the above problems, the present application provides an intelligent audio system.

[0008] In a first aspect of the present application, an intelligent audio system is provided, comprising:

[0009] The acquisition module is used to collect data information of the sound receiving device and obtain multi-dimensional audio data;

[0010] An analysis unit, used for analyzing a multi-dimensional audio data set to obtain an audio parameter set;

[0011] A processing unit, configured to set an output evaluation judgment set according to an audio parameter set, substitute the audio parameter set into an evaluation judgment model, and obtain output evaluation judgment parameters;

[0012] If the output evaluation judgment parameter meets the output requirement, the obtained output evaluation judgment parameter is directly output; if the output evaluation judgment parameter does not meet the output requirement, a re-inspection request is issued at the same time;

[0013] A first optimization unit, configured to obtain optimized deep learning data according to the audio parameter set and the optimized output evaluation parameter of the first processing unit;

[0014] The second optimization unit is used to use the optimized output evaluation parameters to participate in the re-examination of the output evaluation judgment model, and evaluate and judge whether to output based on the optimized output evaluation parameters. By repeatedly executing the above steps, the output evaluation judgment parameters meet the output requirements, and the processor in the audio system synchronizes the optimization value to optimize the audio parameter set, thereby obtaining the best audio processing effect.

[0015] By repeatedly executing the above steps, the output evaluation judgment parameters meet the output requirements, and the audio parameter set is optimized by the processor in the audio system and the optimization value is synchronized to obtain the best audio processing effect.

[0016] One or more technical solutions provided in this application have at least the following technical effects or advantages:

[0017] The embodiment of the present application acquires multi-dimensional audio data by collecting data information of a sound receiving device, then analyzes a multi-dimensional audio data set to acquire an audio parameter set, and then sets an output evaluation and judgment set according to the audio parameter set, substitutes the audio parameter set into an evaluation and judgment model, and acquires output evaluation and judgment parameters. If the output evaluation and judgment parameters meet the output requirements, the obtained output evaluation and judgment parameters are directly outputted; if the output evaluation and judgment parameters do not meet the output requirements, a re-examination request is issued at the same time. Through such a setting, the collected audio file can be scored. If the requirements are met, the audio file is outputted; if not, a re-examination is performed until the requirements are met.

[0018] The embodiment of the present application obtains the evaluation judgment parameters of the last calculation by setting two optimization values ​​in the judgment formula. When rechecking, it splits it into the judgment formula, and then optimizes the audio data, thereby reducing the distortion value of the sound screen, and repeats the above steps until it meets the output requirements, thereby achieving the best audio transmission effect.

[0019] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 A schematic diagram of the structure of an intelligent audio system provided in this application. DETAILED DESCRIPTION

[0022] The present application provides an intelligent audio system for solving the problem that, during the existing audio transmission, although the quality and stability of the audio are enhanced through external means, audio problems may still occur in the case of long-term audio transmission. The lack of self-checking of the audio causes the collected audio to not meet the requirements, and re-sampling is performed, which increases the time cost. At the same time, there is a lack of audio optimization and the technical problem of being unable to adapt to different scenarios.

[0023] In response to the above technical problems, the overall idea of ​​the technical solution provided by this application is as follows:

[0024] The embodiment of the present application obtains multi-dimensional audio data by collecting data information of the sound receiving device, and then analyzes the multi-dimensional audio data set to obtain an audio parameter set, and then sets an output evaluation and judgment set according to the audio parameter set, substitutes the audio parameter set into the evaluation and judgment model, and obtains output evaluation and judgment parameters. If the output evaluation and judgment parameters meet the output requirements, the obtained output evaluation and judgment parameters are directly outputted; if the output evaluation and judgment parameters do not meet the output requirements, a re-inspection request is issued at the same time. Through such a setting, the collected audio file can be scored. If the requirements are met, the audio is output; if not, a re-inspection is performed until the requirements are met. At the same time, the evaluation and judgment parameters of the last calculation are obtained by setting two optimization values ​​in the judgment formula. When re-inspecting, the evaluation and judgment parameters are split into the judgment formula, and the audio data is optimized to reduce the distortion value of the sound screen. The above steps are repeated until the output requirements are met to achieve the optimal audio transmission effect.

[0025] After introducing the basic principles of the present application, the technical solutions in the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments of the present application. It should be understood that the present application is not limited to the example embodiments described here. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application. It should also be noted that, for the convenience of description, only the parts related to the present application are shown in the accompanying drawings, rather than all of them.

[0026] Embodiment 1

[0027] like Figure 1 As shown, the present application provides an intelligent audio system, comprising:

[0028] The acquisition module is used to collect data information of the sound receiving device and obtain multi-dimensional audio data;

[0029] In the embodiment of the present application, the above-mentioned collection of sound receiving device data information refers to the collection of information of the sound receiving device. Specifically, when collecting sound, it is necessary to detect whether the sound receiving device is working, whether it works normally, and the type of audio it collects, so as to facilitate the subsequent intelligent audio system to optimize it;

[0030] For example, in actual use, the sound receiving device is placed at the position closest to the sound source to facilitate the collection of sound. At the same time, the working status of the sound receiving device is collected to ensure that it is in normal working condition and to ensure that the collected audio will not cause problems with audio quality and stability due to its working status.

[0031] Among them, the radio device can use the AAC encoding format to transmit audio data. It is more efficient than MP3 and can provide better sound quality and smaller file size. To match it, corresponding transcoding equipment should be set up.

[0032] An acquisition module in an intelligent audio system provided in an embodiment of the present application includes:

[0033] The operation status collection unit is used to collect information about whether the radio equipment is turned on normally and obtain the operation status parameters of the radio equipment;

[0034] The device voltage collection unit collects the voltage information of the radio equipment and obtains the voltage stability parameters of the radio equipment;

[0035] The device status collection unit collects the receiving status information of the receiving device and obtains the receiving status parameters of the receiving device;

[0036] The high-band audio acquisition unit is used to collect external high-frequency information and obtain high-band audio;

[0037] The mid-band audio acquisition unit is used to collect the external mid-frequency information and obtain the mid-frequency audio;

[0038] Low-band audio acquisition unit, used to collect low-frequency information from the outside world and obtain low-frequency audio

[0039] In an embodiment of the present application, the operating status parameters of the radio device, the voltage stability parameters of the radio device, the radio status parameters of the radio device, the high-frequency audio information parameters, the medium-frequency audio information parameters, and the low-frequency audio information parameters are output as multi-dimensional audio data. By collecting whether the radio device is running, it is judged whether the overall structure can perform the radio operation normally. The voltage stability of the radio device is collected to ensure that the radio device does not produce noise due to voltage instability when receiving sound. By collecting the radio status of the radio device, it is ensured whether the radio device can perform the radio operation normally. Then, the audio of the three high, medium and low sound segments of the external sound source are collected respectively, which is convenient for subsequent judgment and optimization.

[0040] An analysis module, used to analyze a multi-dimensional audio data set to obtain an audio parameter set;

[0041] In the embodiment of the present application, the above-mentioned analysis of the multi-dimensional audio data set refers to parsing the three frequency bands of high, medium and low frequencies of the collected audio, and specifically collecting the audio data of each frequency band to facilitate the subsequent adjustment of the audio. For example, in actual use, the sound receiving device collects audio, the system analyzes the composition of the audio, and calculates its specific value, and then transmits the audio and data, which is used as a reference for the subsequent judgment and processing of the audio.

[0042] An analysis module in an intelligent audio system provided in an embodiment of the present application includes:

[0043] A high frequency band audio analysis unit, used for analyzing high frequency band audio information parameters to obtain high frequency audio information parameters;

[0044] The intermediate frequency audio analysis unit is used to analyze the intermediate frequency audio information parameters and obtain the intermediate frequency audio information parameters.

[0045] The low-frequency audio analysis unit is used to obtain low-frequency audio information parameters.

[0046] In an embodiment of the present application, the high-frequency audio information parameters, the intermediate-frequency audio information parameters and the low-frequency audio information parameters are output as an audio parameter set, and the three-segment audio information is collected. At this time, when the audio is subsequently optimized, a reference value is provided. At the same time, when the optimization is completed, the three-band audio can be adjusted, thereby achieving a more detailed adjustment of the audio and obtaining a more stable and better quality audio.

[0047] A processing module, used to set an output evaluation judgment set according to an audio parameter set, substitute the audio parameter set into an output evaluation judgment model, and obtain output evaluation judgment parameters;

[0048] In an embodiment of the present application, through the set evaluation and judgment set, in actual use, the audio parameter set mentioned above is evaluated by the evaluation parameter set to score the entire transmitted audio. When the score is closer to the set standard value, the quality of the transmitted audio is higher, and vice versa. The score calculated is then used as a distortion value and re-substituted into the evaluation and judgment set for scoring. It is adjusted based on the original audio data. At the same time, the corresponding audio value is adjusted by the processor to continuously optimize the evaluation score, thereby continuously optimizing the audio quality. For example, in actual use, the collected audio information is substituted into the audio parameter set, and the audio information is scored by the set judgment model. Then, according to the score, it is determined whether to output the audio information. If it meets the requirements, it is output. If not, it is re-checked. At this time, the evaluation and judgment parameters obtained last time are collected, split and substituted into the formula for calculation again, so that the score is close to the set output value. At the same time, the corresponding position of the audio is enhanced or weakened by processing it, thereby achieving the purpose of improving the audio quality.

[0049] A processing module in an intelligent audio system provided in an embodiment of the present application includes:

[0050] A weight allocation processing unit: according to the audio parameter set, obtains the audio segment to construct a weight allocation model and obtains a weight coefficient;

[0051] Output standard unit: setting the audio output standard according to the audio parameter set and the weight coefficient;

[0052] Judgment model building unit: building an evaluation judgment model according to the audio output standard;

[0053] The audio parameter set is imported into the evaluation judgment model, arranged according to the judgment formula, and the judgment result is obtained, and the judgment result is output as the evaluation judgment parameter, wherein the judgment formula is:

[0054]

[0055] Z E is the evaluation judgment parameter output for the Eth time, n is the weight coefficient obtained above, T i is the decision value set according to whether the radio receiver is operating normally. i and u i The error ratio set by the operator, γ i is the root mean square error, which is used to measure the error between the judgment signal and the original signal, β i is the error bit rate, which is used to measure the distortion of the audio signal, ρ i and α i The original audio signal and the standard bit rate can be set by the staff, or the audio data and line bit rate can be collected to obtain the error value between the input audio and the set standard output and the degree of speech distortion, and then determine whether the audio meets the output requirements. i and F i The two values ​​(D i +F i =Z E-1 ), where (0≤θ i ≤0.5, 0≤α i ≤0.5 and (γ i +D i )+(β i +F i )≤1), in actual use, the user sets θ i and u i The error ratio coefficient set by the operator controls the ratio of bit rate and root mean square error in this audio transmission process. By adjusting different ratios, different audio effects can be obtained. Then, the audio score value of this audio transmission, i.e., the distortion value, can be calculated by combining the benchmark value set by the system. If it is not satisfied, the evaluation judgment parameter Z of the previous operation will be used in the next operation. E-1 , so that the next time the score is calculated, the score will be improved, and the processor will make corresponding adjustments to the audio to achieve the effect of optimizing the audio;

[0056] A first optimization unit, configured to obtain optimized deep learning data according to the audio parameter set and the optimized output evaluation parameter;

[0057] In the embodiment of the present application, the deep learning data is optimized by comparing the original audio data with the optimized audio data, recording the parameters that need to be adjusted in different scenarios, and recording them through the deep learning algorithm, and in the next calculation, the similar processing operation is preferentially called to obtain the fastest processing efficiency and improve the processing effect of the audio. Exemplarily, in actual use, the original audio data and the optimized audio data are compared to obtain the current adjustment data. The next time similar audio data of a similar frequency band is encountered, the processor can make a priority adjustment to the audio and then perform the calculation, and output the audio that meets the conditions at the fastest speed, thereby greatly speeding up the processing rate of the audio.

[0058] The second optimization unit is used to participate in the re-examination of the output evaluation judgment model by using the optimized output evaluation parameters, and to evaluate and judge whether to output according to the optimized output evaluation parameters;

[0059] In an embodiment of the present application, the optimized output evaluation parameters are used to participate in the re-examination of the output evaluation judgment model. The optimized data can be substituted into the formula for calculation to obtain a better scoring result, and then the audio is optimized based on the current scoring result.

[0060] Although the present application has been described in conjunction with specific features and embodiments thereof, it is obvious that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the accompanying drawings are merely exemplary illustrations of the present application and are deemed to have covered any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, a person skilled in the art may make various modifications and variations to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the present application and its equivalents, the present application is intended to include these modifications and variations.

Claims

1. An intelligent audio system, characterized in that: The intelligent audio system comprises: The acquisition module is used to collect data information of the sound receiving device and obtain multi-dimensional audio data; An analysis module, used for analyzing a multi-dimensional audio data set to obtain an audio parameter set, including: a high-frequency band audio analysis unit, used for obtaining high-frequency audio information parameters, a mid-frequency band audio analysis unit, used for obtaining mid-frequency audio information parameters, and a low-frequency band audio analysis unit, used for obtaining low-frequency audio information parameters, and outputting the high-frequency audio information parameters, the mid-frequency audio information parameters, and the low-frequency audio information parameters as an audio parameter set; The processing module includes: a weight distribution processing unit: used to obtain the audio segmentation to construct a weight distribution model according to the audio parameter set, and obtain the weight coefficient; an output standard unit: used to set the audio output standard according to the audio parameter set and the weight coefficient; a judgment model construction unit: used to construct an evaluation judgment model according to the audio output standard; import the audio parameter set into the evaluation judgment model, arrange them according to the judgment formula, obtain the judgment result, and output the judgment result as the evaluation judgment parameter, wherein the judgment formula is: Z F is the evaluation judgment parameter output for the Eth time, n is the weight coefficient obtained above, T i The decision value is set according to whether the radio receiver is operating normally. i and u i The error ratio set by the operator, γ i is the root mean square error, which is used to measure the error between the judgment signal and the original signal, β i is the error bit rate, which is used to measure the distortion of the audio signal, ρ i and α i The original audio signal and the standard bit rate can be set by the staff, or the audio data and line bit rate can be collected to obtain the error value between the input audio and the set standard output and the degree of speech distortion, and then determine whether the audio meets the output requirements. i and F i The two values ​​(D i +F i =Z e-1 ), where (0≤θ i ≤0.5, 0≤α i ≤0.5 and (γ i +D i )+(β i +F i )≤1); If the output evaluation judgment parameter meets the output requirement, the obtained output evaluation judgment parameter is directly output; if the output evaluation judgment parameter does not meet the output requirement, a re-inspection request is issued at the same time; A first optimization unit, used to obtain optimized deep learning data according to the audio parameter set and the optimized output evaluation parameter, including: a first optimization processing unit, which obtains a first optimization parameter according to the audio parameter set; a second optimization processing unit, which obtains a second optimization parameter according to the evaluation judgment parameter; an optimal processing result is obtained according to the first optimization parameter and the second optimization parameter, and the optimal processing result is output as the optimized deep learning data; The second optimization unit is used to participate in the re-examination of the output evaluation judgment model by using the optimized output evaluation parameters, and to evaluate and judge whether to output according to the optimized output evaluation parameters.

2. The intelligent audio system according to claim 1, characterized in that: The acquisition module comprises: An operating status acquisition unit, used to obtain operating status parameters of the radio equipment; The device voltage acquisition unit is used to obtain the voltage stability parameters of the radio equipment; A device status acquisition unit, used to obtain the receiving status parameters of the receiving device; A high-band audio acquisition unit, used to obtain high-band audio; A mid-band audio acquisition unit, used to obtain mid-frequency audio; A low-band audio acquisition unit, used to obtain low-frequency audio; The operating state parameters of the radio equipment, the voltage stability parameters of the radio equipment, the radio state parameters of the radio equipment, the high-frequency audio information parameters, the intermediate-frequency audio information parameters, and the low-frequency audio information parameters are output as multi-dimensional audio data.