Auditory Enhancement Method, System, Readable Storage Medium, and Computer Device
By testing and compensating the frequency points in the initial audio data, the auditory gain value is generated, which solves the problem of sound quality drop and ear discomfort after increasing the volume in the prior art, and realizes that without changing the overall sound size, the perception of sound quality and listening effect is enhanced, and the sound quality and listening effect is improved.
Patent Information
- Application Number
- CN202211456189.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-21
- Publication Date
- 2025-06-17
- Estimated Expiration
- 2042-11-21
AI Technical Summary
In the prior art, in order to increase the sensitivity to sounds in certain frequency bands, people usually need to increase the volume of the headphones, but this will cause the sound details to be masked, reduce the sound quality, and long-term high volume will affect the comfort of the human ear.
Several frequency points in the initial audio data are extracted through preset extraction rules, and test short-term audio of different intensity is assigned to each frequency point, creating a user's auditory test environment, collecting test results feedback from users, combining user identity information and difficulty analysis, the auditory compensation values of each frequency point are calculated, and corresponding auditory gain values are generated to enhance user's auditory sensitivity.
Without changing the overall sound size, users can enhance the user's sense of sound in insensitive frequency bands, so that users can enjoy more music in the frequency range, while improving sound quality and listening effects, protecting the comfort of the human ears.
Smart Images

Figure CN115831143B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of voice digital signal processing, and particularly relates to an auditory enhancement method, system, readable storage medium and computer device. Background Art
[0002] With the rapid development of technology and the improvement of people's living standards, people's requirements for the quality of life are also getting higher and higher. More people will improve the quality of life by wearing headphones to listen to music. Therefore, people's requirements for sound quality are also getting higher and higher.
[0003] In life, due to different people's sensitivities to sounds in different frequency bands, some people are sensitive to high frequencies but not to low frequencies, while some people are not sensitive to high frequencies but are sensitive to low frequencies. In view of the above situation, in order to more easily hear the sound in a certain frequency band, people can only increase the headphone volume. However, increasing the volume will more easily mask the details of the sound, reduce the sound quality and affect people's listening experience, and long-term high volume will also affect the comfort of the human ear. Summary of the Invention
[0004] Based on this, the purpose of the present invention is to provide an auditory enhancement method, system, readable storage medium and computer device to at least solve the above deficiencies in the technology.
[0005] The present invention provides an auditory enhancement method, which is characterized by including:
[0006] Extracting a number of frequency points from the initial audio data according to a preset extraction rule, and allocating test short-time audio with different intensities to each of the frequency points to obtain test audio data;
[0007] Creating an auditory test environment for the user, playing the test audio data for the user in the auditory test environment, and collecting the test results fed back by the user based on the test audio data;
[0008] Obtaining the identity information of the user, and inputting the identity information and the test results into an auditory test mathematical model to obtain the auditory compensation values corresponding to the frequency points in the test audio data;
[0009] Generating corresponding auditory gain values according to the auditory compensation values, so that the user can enhance the auditory sensitivity according to the auditory gain values.
[0010] Further, the step of creating an auditory test environment for the user includes:
[0011] Obtaining the environmental audio data of the current environment, and determining whether the environmental audio data exceeds the environmental audio threshold;
[0012] If the environmental audio data does not exceed the environmental audio threshold, an auditory test environment for the user is created based on the current environment.
[0013] Further, the identity information includes age information and gender information. The step of inputting the identity information and the test result into the auditory test mathematical model to obtain the auditory compensation value corresponding to each frequency point in the test audio data includes:
[0014] Performing a difficulty analysis on each of the test short-time audios based on a difficulty database to obtain the difficulty coefficient corresponding to each of the test short-time audios;
[0015] Calculating the corresponding age coefficient and gender coefficient respectively according to the age information and the gender information;
[0016] Calculating the weight values of the difficulty coefficient, the age coefficient, the gender coefficient, and the test result respectively, and calculating the auditory compensation value corresponding to each frequency point according to the difficulty coefficient, the age coefficient, the gender coefficient, the weight value of the difficulty coefficient, the weight value of the age coefficient, the weight value of the gender coefficient, the test result, the weight value of the test result, and the auditory test mathematical model.
[0017] Further, the step of generating a corresponding auditory gain value according to the auditory compensation value so that the user enhances the auditory sensitivity according to the auditory gain value includes:
[0018] Mapping the auditory compensation value to the corresponding user terminal to obtain the corresponding terminal mapping value;
[0019] Generating an auditory gain value corresponding to the terminal mapping value so that the user enhances the auditory sensitivity according to the auditory gain value.
[0020] Further, the expression formula of the auditory compensation value is:
[0021] ;
[0022] ;
[0023] S = B * (Wt * D * T + Wa * A * Tave w + Wg * G * Tave w );
[0024] In the formula, represents the test average value of several frequency points, represents the number of frequency points, It represents the test value at each frequency point, S represents the auditory compensation value, B represents the auditory compensation reference value, Wt represents the weight value of the test result, D represents the difficulty coefficient, T represents the test result, Wa represents the weight value of the age coefficient, and Tave s It represents the sample average value of the frequency points, Tave W It represents the ratio of the test average value of the frequency points to the sample average value of the frequency points. Wg represents the weight value of the gender coefficient, and G represents the gender coefficient.
[0025] The present invention also proposes an auditory enhancement system, including:
[0026] A test audio construction module, configured to extract several frequency points from the initial audio data according to a preset extraction rule, and assign test short-time audio with different intensities to each of the frequency points to obtain test audio data;
[0027] A test environment creation module, configured to create an auditory test environment for the user, play the test audio data for the user in the auditory test environment, and collect the test results fed back by the user based on the test audio data;
[0028] A compensation value calculation module, configured to obtain the identity information of the user, and input the identity information and the test results into an auditory test mathematical model to obtain the auditory compensation values corresponding to the respective frequency points in the test audio data;
[0029] A gain value calculation module, configured to generate corresponding auditory gain values according to the auditory compensation values, so that the user can enhance the auditory sensitivity according to the auditory gain values.
[0030] Further, the test environment creation module includes:
[0031] An environmental audio acquisition unit, configured to acquire the environmental audio data of the current environment and determine whether the environmental audio data exceeds the environmental audio threshold;
[0032] A test environment creation unit, configured to create an auditory test environment for the user based on the current environment if the environmental audio data does not exceed the environmental audio threshold.
[0033] Further, the identity information includes age information and gender information, and the compensation value calculation module includes:
[0034] A difficulty analysis unit, configured to perform a difficulty analysis on each of the test short-time audio based on a difficulty database to obtain the difficulty coefficients corresponding to the respective test short-time audio;
[0035] A coefficient calculation unit, configured to calculate the corresponding age coefficient and gender coefficient according to the age information and the gender information respectively;
[0036] A compensation value calculation unit, configured to calculate the weight values of the difficulty coefficient, the age coefficient, the gender coefficient, and the test result respectively, and calculate the auditory compensation value corresponding to each frequency point according to the difficulty coefficient, the age coefficient, the gender coefficient, the weight value of the difficulty coefficient, the weight value of the age coefficient, the weight value of the gender coefficient, the test result, the weight value of the test result, and the auditory test mathematical model.
[0037] Further, the gain value calculation module includes:
[0038] A compensation value mapping unit, configured to map the auditory compensation value to the corresponding user terminal to obtain a corresponding terminal mapping value;
[0039] A gain value calculation unit, configured to generate an auditory gain value based on the terminal mapping value, so that the user can enhance the auditory sensitivity according to the auditory gain value.
[0040] The present invention also provides a readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned auditory enhancement method is implemented.
[0041] The present invention also provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the above-mentioned auditory enhancement method is implemented.
[0042] In the auditory enhancement method, system, readable storage medium and computer device of the present invention, by extracting a plurality of frequency points, and allocating test audio with different intensities at each frequency point, the auditory compensation value of each frequency point is obtained according to the feedback result of the user and the user's identity information, and a corresponding auditory gain value is generated based on the auditory compensation value, so that the user can enhance the auditory sensitivity according to the auditory gain value, and then, without changing the overall sound volume, enhance the user's sound perception intensity for the insensitive frequency bands, so that the user can enjoy music in a wider frequency range. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figure 1 It is a flowchart of the auditory enhancement method in the first embodiment of the present invention;
[0044] Figure 2 is Figure 1 a detailed flowchart of step S102 in
[0045] Figure 3 is Figure 1 a detailed flowchart of step S103 in
[0046] Figure 4 is Figure 1Detailed flowchart of step S104 in
[0047] Figure 5 Structural block diagram of the auditory enhancement system in the second embodiment of the present invention;
[0048] Figure 6 Structural block diagram of the computer device in the third embodiment of the present invention.
[0049] Description of main component symbols:
[0050]
[0051] The following specific embodiments will further illustrate the present invention in conjunction with the above-mentioned drawings. Specific embodiments
[0052] To facilitate the understanding of the present invention, the present invention will be described more comprehensively below with reference to the relevant drawings. Several embodiments of the present invention are shown in the drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, these embodiments are provided to make the disclosure of the present invention more thorough and comprehensive.
[0053] It should be noted that when an element is referred to as being "fixedly provided on" another element, it can be directly on the other element or there may also be an intermediate element. When an element is considered to be "connected" to another element, it can be directly connected to the other element or there may be an intermediate element at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only.
[0054] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field to which the present invention belongs. The terms used in the description of the present invention herein are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.
[0055] Embodiment 1
[0056] Please refer to Figure 1 , which shows the auditory enhancement method in the first embodiment of the present invention. The auditory enhancement method specifically includes steps S101 to S104:
[0057] S101, extracting a plurality of frequency points from the initial audio data according to a preset extraction rule, and allocating test short-time audio with different intensities to each of the frequency points to obtain test audio data;
[0058] The auditory enhancement method in this embodiment is applied to sound - producing devices with high - quality sound such as headphones and speakers. In specific implementation, initial audio data is obtained. This initial audio data is usually the audio data used to adjust the perceived intensity of user frequency bands before testing. The initial audio data contains audio information of each frequency band. In the entire sound spectrum, sampling is performed at a preset frequency to obtain corresponding multiple frequency points. In this embodiment, the preset frequency uses 10 frequency points (i.e., frequency dots), which are as follows: 20Hz, 50 Hz, 100 Hz, 200 Hz, 400 Hz, 800 Hz, 1600 Hz, 3200 Hz, 6400 Hz, 12800 Hz.
[0059] After obtaining the above 10 frequency points, different - intensity test short - time audio is respectively allocated to each frequency point, and the test short - time audio is fused with each frequency point of the entire sound spectrum to obtain test audio data. In this embodiment, the test short - message audio is short - time audio with 4 sound intensities, and the sound intensities are respectively: 67dB, 60 dB, 55 dB, 50dB. The short - time audio is audio with a duration less than or equal to 1s and can be distinguished from the above - mentioned sound spectrum, such as the sound of "beep - beep".
[0060] S102, create a user's auditory test environment, play the test audio data for the user in the auditory test environment, and collect the test results feedback by the user based on the test audio data;
[0061] Further, please refer to Figure 2 , the step S102 specifically includes steps S1021~S1022:
[0062] S1021, obtain the environmental audio data of the current environment, and judge whether the environmental audio data exceeds the environmental audio threshold;
[0063] S1022, if the environmental audio data does not exceed the environmental audio threshold, create a user's auditory test environment based on the current environment.
[0064] In specific implementation, obtain the environmental audio data of the current environment, and judge the environmental sound intensity of the current environment according to the environmental audio data. Among them, when the environmental audio data is greater than the environmental audio threshold (in this embodiment, the environmental audio threshold is 30dB), it means that the sound intensity of the environmental audio data is relatively high, and conducting an auditory test in this environment will affect the test effect. Therefore, it is necessary to change to another environment for testing. When the environmental audio data is not greater than the environmental audio threshold, it means that the sound intensity of the environmental audio data is relatively low, meeting the test environment for auditory testing, and create a user's auditory test environment based on the current environment.
[0065] In this embodiment, when the environmental audio data is greater than the environmental audio threshold, a prompt signal will be output to the user, and at the same time, the corresponding noise reduction mode signal will be triggered, and a buffer pulse will be output in the reverse direction to reduce the sound intensity of the environmental audio data, so that the environmental audio data meets the requirements of the test environment.
[0066] After obtaining the environmental audio data that meets the requirements, the current environment corresponding to the environmental audio data is used as the auditory test environment.
[0067] Further, after creating the user's auditory test environment, the obtained test audio data is played to the user in this auditory test environment. When the user is listening to the test audio data, if the user hears the test short-time audio (i.e., the "beep" sound with sound intensities of 67 dB, 60 dB, 55 dB, and 50 dB), a signal indicating that it has been heard is fed back. If the user does not hear the test short-time audio, a signal indicating that it has not been heard is fed back. At this time, the above two signals are collected in real time, and the sound intensities corresponding to the signals are recorded to generate the corresponding test results.
[0068] S103. Obtain the identity information of the user, and input the identity information and the test result into the auditory test mathematical model to obtain the auditory compensation values corresponding to each frequency point in the test audio data;
[0069] Further, the identity information includes age information and gender information. Please refer to Figure 3 The step S103 specifically includes steps S1031 to S1033:
[0070] S1031. Perform a difficulty analysis on each test short-time audio based on the difficulty database to obtain the difficulty coefficient corresponding to each test short-time audio;
[0071] S1032. Calculate the corresponding age coefficient and gender coefficient according to the age information and the gender information respectively;
[0072] S1033. Calculate the weight values of the difficulty coefficient, the age coefficient, the gender coefficient, and the test result respectively, and calculate the auditory compensation values corresponding to each frequency point according to the difficulty coefficient, the age coefficient, the gender coefficient, the weight value of the difficulty coefficient, the weight value of the age coefficient, the weight value of the gender coefficient, the test result, the weight value of the test result, and the auditory test mathematical model.
[0073] In specific implementation, the difficulty coefficient is constructed according to the sensitive intensity of the human body to each sound frequency, and the corresponding difficulty coefficient and sound intensity are used to construct the difficulty database. By way of example but not limitation, Table 1 is a partial example of the sound intensity - difficulty coefficient mapping table:
[0074] Table 1
[0075]
[0076] In Table 1, the highest difficulty coefficient is 1 and the lowest is 0. The larger the difficulty coefficient, the more difficult it is to capture the sound of that sound frequency. Among them, the ultra-low frequency sound of 20 Hz is the most difficult to capture, so its difficulty coefficient is set to 1.0. Secondly, the low frequency of 50 Hz and the high frequency of 12,800 Hz are relatively difficult to capture, so their difficulty coefficients are set to 0.9. The frequencies of 800 Hz, 1,600 Hz, and 3,200 Hz are the most sensitive parts of the human ear, so the difficulty coefficients are relatively small.
[0077] Furthermore, the sensitivities of users of different ages to different sound frequencies are collected, and the collected data is used to construct an age information database. The age information in the identity information of the above users is input into the age information database to obtain the corresponding age coefficient for that user. Table 2 shows some examples of the age information - age coefficient mapping table:
[0078] Table 2
[0079]
[0080] As can be seen from Table 2, the auditory sensitivities of users under 20 years old are relatively high and no compensation is required, so their corresponding age coefficients are 0; when the age ranges from 20 to 30 years old, the hearing sensitivities of the human ear show a downward trend. Therefore, their corresponding age coefficients are set to 0.1 and 0.3 respectively. When the age reaches 40 years old, the hearing ability of the human ear has been solidified, so the corresponding age coefficient is set to 0.45.
[0081] Furthermore, by randomly selecting people in the same age group and conducting sound sensitivity tests on this group of people, a gender - gender coefficient mapping table is obtained:
[0082] Table 3
[0083]
[0084] By randomly surveying people in the same age group, generally, the sensitivities of men to high-frequency and ultra-low frequency sounds are less than those of women. Therefore, the gender coefficients of men and women are set to 0.2 and 0.1 respectively.
[0085] In this embodiment, according to the sound intensity test table (Table 4), the test results of different frequency points at different sound intensities in the above test results are corresponded. Among them, the sound intensity test table is as follows:
[0086] Table 4
[0087]
[0088] In Table 4 above, "1" indicates that the sound can be heard, "0" indicates that the sound cannot be heard, and "x" indicates that the result is meaningless.
[0089] After obtaining the corresponding difficulty coefficient, age coefficient, gender coefficient, and test results, calculate the average value of the test results at each frequency point according to the following formula:
[0090] ;
[0091] In the formula, represents the test average of several frequency points, represents the number of frequency points, represents the test value at each frequency point.
[0092] For example: When the test results of the first frequency point 20Hz at four sound intensities of 67dB, 60 dB, 55 dB, and 50 dB are all 1, the test results of the second frequency point 50Hz are all 0.9, the test results of the third frequency point 100Hz are all 0.5, the test results of the fourth frequency point 200Hz are all 0.5, the test results of the fifth frequency point 400Hz are all 0.25, the test results of the sixth frequency point 800Hz are all 0, the test results of the seventh frequency point 1600Hz are all 0, the test results of the eighth frequency point 3200Hz are all 0, the test results of the ninth frequency point 6400Hz are all 0.25, and the test results of the tenth frequency point 12800Hz are all 0.5, then the test average is 0.375.
[0093] Calculate the corresponding sample average Tave based on the test results of the sample data in the above sound intensity test table s , for example: In Table 4 above, the test results are 0, 0.25, 0.5, 0.75, 1, and the corresponding sample average Tave s is 0.5.
[0094] Furthermore, according to the weight distribution rule, assign corresponding weight values to the above test average , sample average Tave s , age coefficient A, and gender coefficient G. Among them, the weight value Tave of the test average W is 0.75, the weight value Wt of the sample average is 0.7, the weight value Wa of the age coefficient A is 0.2, and the weight value Wg of the gender coefficient G is 0.1. The above weight values can be calculated through the corresponding weight formula and the corresponding weight database, or can be set by the user themselves.
[0095] Input the obtained weight values of the difficulty coefficient, age coefficient, gender coefficient, and test result into the auditory test mathematical model to calculate the auditory compensation values corresponding to each frequency point:
[0096] ;
[0097] S = B * (Wt * D * T + Wa * A * Tave w + Wg * G * Tave w );
[0098] In the formula, represents the test average value of several frequency points, represents the number of frequency points, represents the test value at each frequency point, S represents the auditory compensation value, B represents the auditory compensation reference value, Wt represents the weight value of the test result, D represents the difficulty coefficient, T represents the test result, Wa represents the weight value of the age coefficient, Tave s represents the sample average value of the frequency point, Tave W represents the ratio of the test average value of the frequency point to the sample average value of the frequency point, Wg represents the weight value of the gender coefficient, and G represents the gender coefficient.
[0099] S104. Generate a corresponding auditory gain value according to the auditory compensation value so that the user can enhance the auditory sensitivity according to the auditory gain value.
[0100] Further, please refer to Figure 4 , the step S104 specifically includes S1041 to S1042:
[0101] S1041. Map the auditory compensation value to the corresponding user terminal to obtain the corresponding terminal mapping value;
[0102] S1042. Generate an auditory gain value corresponding to the terminal mapping value so that the user can enhance the auditory sensitivity according to the auditory gain value.
[0103] In specific implementation, input the obtained auditory compensation value into the user terminal (such as a mobile phone and other terminal devices with communication functions). Through the user terminal, it is mapped into a terminal mapping value corresponding to it, and is transmitted to the earphone based on this mapping value. The earphone generates a corresponding auditory gain value through the filter, so that the user can use the earphone and the corresponding auditory gain value to enhance the auditory sensitivity, so that the user can perceive the sound intensity of the insensitive frequency band and hear music in a wider frequency range.
[0104] In summary, in the above-described embodiments of the present invention, the auditory enhancement method extracts a plurality of frequency points, assigns test audio with different intensities to each frequency point, obtains the auditory compensation value of each frequency point according to the feedback result of the user and the identity information of the user, generates a corresponding auditory gain value based on the auditory compensation value, so that the user can enhance the auditory sensitivity according to the auditory gain value, and further enhance the sound perception intensity of the user for the insensitive frequency band without changing the overall sound volume, enabling the user to appreciate music in a wider frequency range.
[0105] Embodiment 2
[0106] On the other hand, the present invention also proposes an auditory enhancement system. Please refer to Figure 5 , which shows the auditory enhancement system in the second embodiment of the present invention. The system includes:
[0107] A test audio construction module 11, configured to extract a plurality of frequency points from the initial audio data according to a preset extraction rule, and assign test short-time audio with different intensities to each of the frequency points to obtain test audio data;
[0108] A test environment creation module 12, configured to create an auditory test environment for the user, play the test audio data for the user in the auditory test environment, and collect the test results fed back by the user based on the test audio data;
[0109] Further, the test environment creation module 12 includes:
[0110] An environmental audio acquisition unit, configured to acquire environmental audio data of the current environment and determine whether the environmental audio data exceeds an environmental audio threshold;
[0111] A test environment creation unit, configured to create an auditory test environment for the user based on the current environment if the environmental audio data does not exceed the environmental audio threshold.
[0112] A compensation value calculation module 13, configured to acquire the identity information of the user, and input the identity information and the test results into an auditory test mathematical model to obtain the auditory compensation value corresponding to each of the frequency points in the test audio data;
[0113] Further, the identity information includes age information and gender information. The compensation value calculation module 13 includes:
[0114] A difficulty analysis unit, configured to perform difficulty analysis on each of the test short-time audio based on a difficulty database to obtain the difficulty coefficient corresponding to each of the test short-time audio;
[0115] A coefficient calculation unit, configured to calculate a corresponding age coefficient and gender coefficient respectively according to the age information and the gender information;
[0116] A compensation value calculation unit, configured to calculate the weight values of the difficulty coefficient, the age coefficient, the gender coefficient, and the test result respectively, and calculate the auditory compensation value corresponding to each frequency point according to the difficulty coefficient, the age coefficient, the gender coefficient, the weight value of the difficulty coefficient, the weight value of the age coefficient, the weight value of the gender coefficient, the test result, the weight value of the test result, and the auditory test mathematical model.
[0117] A gain value calculation module 14, configured to generate a corresponding auditory gain value according to the auditory compensation value, so that a user can enhance auditory sensitivity according to the auditory gain value.
[0118] Further, the gain value calculation module 14 includes:
[0119] A compensation value mapping unit, configured to map the auditory compensation value to a corresponding user terminal to obtain a corresponding terminal mapping value;
[0120] A gain value calculation unit, configured to generate an auditory gain value corresponding to the terminal mapping value, so that a user can enhance auditory sensitivity according to the auditory gain value.
[0121] The functions or operation steps implemented when the above-mentioned modules and units are executed are substantially the same as those in the above method embodiment, and will not be described in detail here.
[0122] The auditory enhancement system provided by the embodiment of the present invention has the same implementation principle and technical effects as those in the foregoing method embodiment. For a brief description, for the parts not mentioned in the system embodiment, reference may be made to the corresponding content in the foregoing method embodiment.
[0123] Embodiment III
[0124] The present invention also provides a computer device. Please refer to Figure 6 , which shows the computer device in the third embodiment of the present invention, including a memory 10, a processor 20, and a computer program 30 stored on the memory 10 and executable on the processor 20. When the processor 20 executes the computer program 30, the above-mentioned auditory enhancement method is implemented.
[0125] Among them, the memory 10 includes at least one type of storage medium, and the storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory, etc.), magnetic memory, magnetic disk, optical disc, etc. The memory 10 can be an internal storage unit of a computer device in some embodiments, such as the hard disk of the computer device. The memory 10 can also be an external storage device in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. Further, the memory 10 can also include both an internal storage unit of a computer device and an external storage device. The memory 10 can be used not only to store application software installed in the computer device and various types of data, but also to temporarily store data that has been output or will be output.
[0126] Among them, the processor 20 can be an Electronic Control Unit (ECU, also known as a vehicle computer), a Central Processing Unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips in some embodiments, and is used to run the program code stored in the memory 10 or process data, such as executing an access restriction program, etc.
[0127] It should be noted that Figure 6 The structure shown does not constitute a limitation on the computer device. In other embodiments, the computer device may include fewer or more components than shown in the figure, or combine some components, or have a different component layout.
[0128] An embodiment of the present invention also provides a readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the auditory enhancement method as described above is implemented.
[0129] Those skilled in the art can understand that the logic and / or steps represented in the flowchart or described in other ways herein, for example, can be considered as a definite sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch instructions from the instruction execution system, apparatus, or device and execute the instructions), or used in combination with these instruction execution systems, apparatus, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
[0130] More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection (electronic device) having one or more wirings, a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable media can even be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or otherwise processing as appropriate, and then storing it in a computer memory.
[0131] It should be understood that the various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
[0132] The technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as falling within the scope described in this specification.
[0133] The above-described embodiments merely represent several implementation manners of the present application. Their descriptions are relatively specific and detailed, but should not be construed as limiting the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.
Claims
1. An auditory enhancement method, characterized in that, Including: Extracting several frequency points from the initial audio data according to a preset extraction rule, and assigning test short-time audio with different intensities to each of the frequency points to obtain test audio data; Creating an auditory test environment for the user, playing the test audio data for the user in the auditory test environment, and collecting the test results feedback by the user based on the test audio data; Obtaining the identity information of the user, and inputting the identity information and the test results into an auditory test mathematical model to obtain the auditory compensation values corresponding to the respective frequency points in the test audio data; Generating corresponding auditory gain values according to the auditory compensation values, so that the user can enhance the auditory sensitivity according to the auditory gain values; Wherein, the identity information includes age information and gender information, and the step of inputting the identity information and the test results into an auditory test mathematical model to obtain the auditory compensation values corresponding to the respective frequency points in the test audio data includes: Performing a difficulty analysis on each of the test short-time audio based on a difficulty database to obtain the difficulty coefficients corresponding to each of the test short-time audio; Calculating corresponding age coefficients and gender coefficients respectively according to the age information and the gender information; Calculating the weight values of the difficulty coefficient, the age coefficient, the gender coefficient, and the test results respectively, and calculating the auditory compensation values corresponding to the respective frequency points according to the difficulty coefficient, the age coefficient, the gender coefficient, the weight value of the difficulty coefficient, the weight value of the age coefficient, the weight value of the gender coefficient, the test results, the weight value of the test results, and the auditory test mathematical model. The expression formula of the auditory compensation value is: ; ; S = B * (Wt * D * T + Wa * A * Tave w + Wg * G * Tave w ); In the formula, represents the test average value of several frequency points, represents the number of frequency points, represents the test value at each frequency point, S represents the auditory compensation value, B represents the auditory compensation reference value, Wt represents the weight value of the test result, D represents the difficulty coefficient, T represents the test result, Wa represents the weight value of the age coefficient, A represents the age coefficient, Tave s represents the sample average value of the frequency point, Tave W represents the ratio of the test average value of the frequency point to the sample average value of the frequency point, Wg represents the weight value of the gender coefficient, G represents the gender coefficient.
2. The auditory enhancement method according to claim 1, characterized in that, The step of creating an auditory test environment for the user includes: Obtaining the environmental audio data of the current environment, and determining whether the environmental audio data exceeds an environmental audio threshold; If the environmental audio data does not exceed the environmental audio threshold, creating an auditory test environment for the user based on the current environment.
3. The auditory enhancement method according to claim 1, characterized in that, The step of generating corresponding auditory gain values according to the auditory compensation values, so that the user can enhance the auditory sensitivity according to the auditory gain values includes: Mapping the auditory compensation value to the corresponding user terminal to obtain a corresponding terminal mapping value; Generating an auditory gain value corresponding to the terminal mapping value, so that the user can enhance the auditory sensitivity according to the auditory gain value.
4. An auditory enhancement system, characterized in that, Including: A test audio construction module, configured to extract several frequency points from the initial audio data according to a preset extraction rule, and assign test short-time audio with different intensities to each of the frequency points to obtain test audio data; A test environment creation module, configured to create an auditory test environment for the user, play the test audio data for the user in the auditory test environment, and collect the test results feedback by the user based on the test audio data; A compensation value calculation module, configured to obtain the identity information of the user, and input the identity information and the test results into an auditory test mathematical model to obtain the auditory compensation values corresponding to the respective frequency points in the test audio data; A gain value calculation module, configured to generate a corresponding auditory gain value according to the auditory compensation value, so that the user can enhance the auditory sensitivity according to the auditory gain value; Wherein, the identity information includes age information and gender information, and the compensation value calculation module includes: A difficulty analysis unit, configured to perform a difficulty analysis on each of the test short-time audio based on a difficulty database to obtain a difficulty coefficient corresponding to each of the test short-time audio; A coefficient calculation unit, configured to calculate corresponding age coefficients and gender coefficients respectively according to the age information and the gender information; A compensation value calculation unit, configured to calculate the weight values of the difficulty coefficient, the age coefficient, the gender coefficient, and the test result respectively, and calculate the auditory compensation value corresponding to each frequency point according to the difficulty coefficient, the age coefficient, the gender coefficient, the weight value of the difficulty coefficient, the weight value of the age coefficient, the weight value of the gender coefficient, the test result, the weight value of the test result, and the auditory test mathematical model. The expression formula of the auditory compensation value is: ; ; S = B * (Wt * D * T + Wa * A * Tave w + Wg * G * Tave w ) ; In the formula, represents the test average value of several frequency points, represents the number of frequency points, represents the test value at each frequency point, S represents the auditory compensation value, B represents the auditory compensation reference value, Wt represents the weight value of the test result, D represents the difficulty coefficient, T represents the test result, Wa represents the weight value of the age coefficient, A represents the age coefficient, Tave s represents the sample average value of the frequency point, Tave W represents the ratio of the test average value of the frequency point to the sample average value of the frequency point, Wg represents the weight value of the gender coefficient, G represents the gender coefficient.
5. The auditory enhancement system according to claim 4, characterized in that, The test environment creation module includes: An environmental audio acquisition unit, configured to acquire environmental audio data of the current environment and determine whether the environmental audio data exceeds an environmental audio threshold; A test environment creation unit, configured to, if the environmental audio data does not exceed the environmental audio threshold, create an auditory test environment for the user based on the current environment.
6. A readable storage medium, on which a computer program is stored, characterized in that, When the computer program is executed by a processor, it implements the auditory enhancement method according to any one of claims 1 to 3.
7. A computer device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the auditory enhancement method according to any one of claims 1 to 3.
Citation Information
Patent Citations
Volume compensation method and device, computer equipment and storage medium
CN111031445A
Method and system for enhancing an audio signal
WO2017036940A1