Self-adaptive audio output method and device

Abstract

The invention relates to a self-adaptive audio output method, which is applied to an open earphone, and comprises the following steps: S100, acquiring a first output curve of audio, the first output curve being an audio stream theoretical output curve of the earphone; s200, calculating according to the first output curve and an algorithm model based on environmental noise to obtain a second output curve of the audio, wherein the second output curve is an audio stream theoretical actual output curve of the earphone; s300, calculating a third output curve of the audio according to user expected audio information of the preset frequency band audio and the first output curve, wherein the third output curve is an audio stream output curve expected by a user; and S400, adjusting the second output curve according to the amplitude difference between the second output curve and the third output curve so as to obtain an actual audio output curve meeting the user expectation.

Description

Technical Field

[0001] The present invention relates to the technical field of headphone volume adjustment, and in particular to an adaptive audio output method and device. Background Art

[0002] Open-ear headphones are a type of portable audio output device that conducts sound within a specific range. Compared with traditional in-ear and over-ear headphones, open-ear headphones do not block or cover the ear canal, allowing users to obtain sound information from the external environment while listening to music, improving safety and comfort.

[0003] However, due to their open structure, open-back headphones are more susceptible to external noise interference than traditional headphones and active noise-cancelling headphones. Users need to use a louder volume to get a better listening experience. But how to properly adjust the volume and frequency response to make the audio output better and ensure the user's listening experience is one of the headphone problems that needs to be solved urgently.

[0004] In traditional technical solutions, users are required to manually adjust the volume. In each environment, users need to manually adjust the volume, and can only adjust the volume. If the volume is turned up to the maximum in a particularly noisy environment and the sound of the headphones cannot be heard clearly, there is no other way. In addition, long-term use of high volume will damage hearing. Summary of the invention

[0005] Based on the above situation, the main purpose of the present invention is to provide an adaptive audio output method and device for adaptively adjusting the audio output curve according to different noise environments.

[0006] To achieve the above purpose, the technical solution adopted by the present invention is as follows:

[0007] An adaptive audio output method is applied to open-type headphones, the method comprising the steps of:

[0008] S100, obtaining a first audio output curve, where the first output curve is a theoretical output curve of an audio stream of a headset;

[0009] S200, calculating a second output curve of the audio according to the first output curve and an algorithm model based on ambient noise, where the second output curve is a theoretical actual output curve of the audio stream of the headset;

[0010] S300, calculating a third output curve of the audio according to user expected audio information of the audio in a preset frequency band and the first output curve, wherein the third output curve is an audio stream output curve expected by the user;

[0011] S400: adjusting the second output curve according to the amplitude difference between the second output curve and the third output curve to obtain an actual audio output curve that meets user expectations.

[0012] Preferably, the algorithm model in step S200 is calculated through a neural network based on the environmental noise and the first output curve.

[0013] Preferably, the step S300 includes:

[0014] The preset frequency band audio includes low frequency band audio, mid frequency band audio and mid-high frequency band audio;

[0015] Respectively receiving the low-frequency audio, the mid-frequency audio and the high-frequency audio, and calculating the user's expected low-frequency audio information, the user's expected mid-frequency audio information and the user's expected mid-high frequency audio information according to the user's settings;

[0016] The audio information of the corresponding frequency bands in the first output curve is adjusted according to the user's expected low-frequency audio information, the user's expected mid-frequency audio information, and the user's expected mid-high frequency audio information, respectively, so as to obtain the third output curve.

[0017] Preferably, the low frequency band is an audio frequency band below 200 Hz, the middle frequency band is 200 Hz-1000 Hz, and the middle and high frequency band is 1000 Hz-3000 Hz.

[0018] Preferably, the step S400 includes:

[0019] S401, if the amplitude difference between the second output curve and the third output curve is greater than a preset amplitude threshold, performing compensation calculation on the second output curve according to the amplitude difference, and calculating a coherence value between the compensated second output curve and the third output curve;

[0020] S402: If the coherence value is greater than a preset coherence threshold, the volume value of the first output curve is adjusted according to the amplitude difference to obtain a fourth output curve, and a fifth output curve is calculated based on the algorithm model and the fourth output curve, wherein the fourth output curve is a theoretical output curve of the audio stream after the volume value is adjusted, and the fifth output curve is a theoretical actual output curve of the audio stream after the volume value is adjusted;

[0021] S403, calculating the coherence value between the fifth output curve and the third output curve. If the coherence value is less than the preset coherence threshold, calculating the difference value between each frequency point of the fifth output curve and the third output curve, and calculating the 0dB adjustment margin value of the fourth output curve at each frequency point, as well as the adjustment margin value of the fourth output curve at each frequency point and the frequency point corresponding to the preset hearing protection curve. The adjustable margin value of each frequency point is calculated according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve. The audio information of each frequency point of the fifth output curve is adjusted according to the adjustable margin value of each frequency point to obtain an actual audio output curve that meets the user's expectations.

[0022] Preferably, in step S403, the adjustable margin value of each frequency point is calculated according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve, comprising:

[0023] A smaller value between the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve is selected as the adjustable margin value, and the adjustable margin value is less than or equal to the difference value.

[0024] Preferably, if the amplitude difference between the second output curve and the third output curve is less than a preset amplitude threshold, the volume value of the first output curve is adjusted to a volume value close to a preset hearing protection curve, and the amplitude of the audio is adjusted at a frequency point that affects the hearing sense.

[0025] Preferably, the frequency points affecting hearing perception include 200 Hz, 1500 Hz and 3000 Hz.

[0026] The present invention further discloses a computer-readable storage medium, wherein the storage medium stores a program, wherein the program is used to be executed to implement any one of the adaptive audio output methods of the present invention.

[0027] The present invention also discloses an MCU chip, comprising a processor and a memory, wherein a calculation program is stored in the memory, and the processor can execute the calculation program to implement any one of the adaptive audio output methods described in the present invention.

[0028] The invention also discloses a wireless headset, comprising the MCU chip of the invention.

[0029] The present invention also discloses an adaptive audio output device, which is applied to open headphones. The device includes a first output curve acquisition module, a second output curve calculation module, a third output curve calculation module and an output audio adjustment module:

[0030] The first output curve acquisition module is used to acquire a first output curve of the audio, where the first output curve is a theoretical output curve of the audio stream of the earphone;

[0031] The second output curve calculation module is used to calculate the second output curve of the audio according to the first output curve and the algorithm model, and the second output curve is a theoretical actual output curve of the audio stream of the earphone;

[0032] The third output curve calculation module is used to calculate a third output curve of the audio according to the user expected audio information of the preset frequency band audio and the first output curve, and the third output curve is the audio stream output curve expected by the user;

[0033] The output audio adjustment module is used to adjust the second output curve according to the amplitude difference between the second output curve and the third output curve, so as to obtain an actual audio output curve that meets user expectations.

[0034] Preferably, the algorithm model in the second output curve calculation module is calculated through a neural network based on environmental noise and the first output curve.

[0035] Preferably, the third output curve calculation module includes a user expected audio output unit and a third output curve calculation unit, and the preset frequency band audio includes low frequency band audio, mid frequency band audio and mid-high frequency band audio;

[0036] The user expected audio output unit is used to output user expected low frequency audio information, user expected middle frequency audio information and user expected high frequency audio information according to the user's setting when playing the low frequency band audio, the middle frequency band audio and the high frequency band audio;

[0037] The third output curve calculation unit is used to adjust the audio information of the corresponding frequency bands in the first output curve according to the user's expected low-frequency audio information, the user's expected mid-frequency audio information and the user's expected high-frequency audio information, so as to obtain the third output curve.

[0038] Preferably, the low frequency band is an audio frequency band below 200 Hz, the middle frequency band is 200 Hz-1000 Hz, and the middle and high frequency band is 1000 Hz-3000 Hz.

[0039] Preferably, the output audio adjustment module includes a coherence value calculation unit, an output curve adjustment unit and an adjustable margin calculation unit.

[0040] The coherence value calculation unit is used for performing compensation calculation on the second output curve according to the amplitude difference when the amplitude difference between the second output curve and the third output curve is greater than a preset amplitude threshold, and calculating the coherence value of the compensated second output curve and the third output curve;

[0041] The output curve adjustment unit is used to adjust the volume value of the first output curve according to the amplitude difference when the coherence value is greater than a preset coherence threshold value to obtain a fourth output curve, and calculate a fifth output curve based on the algorithm model and the fourth output curve, wherein the fourth output curve is a theoretical output curve of the audio stream after the volume value is adjusted, and the fifth output curve is a theoretical actual output curve of the audio stream after the volume value is adjusted;

[0042] The adjustable margin calculation unit is used to calculate the coherence value between the fifth output curve and the third output curve. If the coherence value is less than the preset coherence threshold, the difference value of each frequency point between the fifth output curve and the third output curve is calculated, and the 0dB adjustment margin value of the fourth output curve at each frequency point, as well as the adjustment margin value of the fourth output curve at each frequency point and the frequency point corresponding to the preset hearing protection curve are calculated. The adjustable margin value of each frequency point is calculated according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve. The audio information of each frequency point of the fifth output curve is adjusted according to the adjustable margin value of each frequency point to obtain an actual audio output curve that meets the user's expectations.

[0043] Preferably, the adjustable margin calculation unit calculates the adjustable margin value of each frequency point according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve, including:

[0044] A smaller value between the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve is selected as the adjustable margin value, and the adjustable margin value is less than or equal to the difference value.

[0045] Preferably, the coherence value calculation unit is also used to adjust the volume value of the first output curve to a volume value close to a preset hearing protection curve when the amplitude difference between the second output curve and the third output curve is less than a preset amplitude threshold, and adjust the amplitude of the audio at a frequency point that affects the hearing sense.

[0046] Preferably, the frequency points affecting hearing perception include 200 Hz, 1500 Hz and 3000 Hz.

[0047] The present invention also discloses a wireless headset, comprising the adaptive audio output device described in any one of the present inventions.

[0048] Compared with traditional solutions, this solution adaptively adjusts the audio output curve according to different noise environments, reduces the impact of environmental noise on the listening experience of open-back headphones, does not require users to frequently adjust the volume manually, optimizes the user experience, and allows users to hear the audio played by the headphones while effectively protecting their hearing.

[0049] Other beneficial effects of the present invention will be explained in the specific implementation manner through the introduction of specific technical features and technical solutions. Through the introduction of these technical features and technical solutions, those skilled in the art should be able to understand the beneficial technical effects brought about by the technical features and technical solutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The preferred implementation of the adaptive audio output method and device of the present invention will be described below with reference to the accompanying drawings. In the drawings:

[0051] Figure 1 A flowchart of an adaptive audio output method according to a preferred embodiment of the present invention;

[0052] Figure 2 A flow chart of a method for adjusting the second output curve according to an amplitude difference between the second output curve and the third output curve according to a preferred embodiment of the present invention;

[0053] Figure 3 Schematic diagram of audio curves output at different stages according to the technical solution of the present invention;

[0054] Figure 4 The figure is a device block diagram of an adaptive audio output method according to a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0055] The present invention is described below based on embodiments, but the present invention is not limited to these embodiments. In the following detailed description of the present invention, some specific details are described in detail. In order to avoid confusing the essence of the present invention, known methods, processes, procedures, and components are not described in detail.

[0056] In addition, persons of ordinary skill in the art will appreciate that the drawings provided herein are for illustration purposes and are not necessarily drawn to scale.

[0057] Unless the context clearly requires otherwise, throughout the specification and claims, the words "include", "comprising" and similar words should be interpreted in an inclusive sense rather than an exclusive or exhaustive sense; that is, in the sense of "including but not limited to".

[0058] In the description of the present invention, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0059] Figure 1 This is a flow chart of an adaptive audio output method according to a preferred embodiment of the present invention. The method can be applied to open-type headphones, comprising the steps of:

[0060] S100, obtaining a first audio output curve, wherein the first output curve is a theoretical audio stream output curve of the headset. Generally, the theoretical audio stream output curve of the headset refers to an audio signal curve output by an audio playback circuit inside the headset, which does not include environmental noise and is a pure audio signal.

[0061] S200, calculate the second output curve of the audio according to the first output curve and the algorithm model based on the environmental noise, the second output curve is the theoretical actual output curve of the audio stream of the headset. In a specific embodiment, the algorithm model can be calculated by a neural network based on the environmental noise and the first output curve. For example, some typical application environment noises are collected in advance, such as scenes such as airports and subways, and these environmental noises and the audio in step S100 can be played in a test laboratory, and an artificial ear can be used for listening. At the same time, a neural network is used to train an algorithm model based on the first output curve and the played environmental noise. The algorithm model makes the second output curve close to the signal curve actually collected by the artificial ear, that is, the audio curve after noise interference is obtained.

[0062] S300, calculate the third output curve of the audio according to the user's expected audio information of the preset frequency band audio and the first output curve, and the third output curve is the audio stream output curve expected by the user. In specific applications, the APP of the open-type headphones can be installed in the user's electronic device, such as a mobile phone. When the user initially uses the headphones, the audio is played through the app, and the user sets the expected audio information by himself, such as setting the volume that the user considers comfortable. After the headphones receive the user's expected audio information, the information is calculated with the first output curve to obtain the third output curve.

[0063] S400, adjusting the second output curve according to the amplitude difference between the second output curve and the third output curve to obtain an actual audio output curve that meets the user's expectations. The second output curve is a theoretical actual audio stream output curve of the headset, and the third output curve is an audio stream output curve expected by the user. By adjusting the audio stream theoretical actual output curve according to the audio stream output curve expected by the user, an actual audio output curve that best meets the user's expectations can be obtained.

[0064] Compared with traditional solutions, this solution adaptively adjusts the audio output curve according to different noise environments, reduces the impact of environmental noise on the listening experience of open-back headphones, does not require users to frequently adjust the volume manually, optimizes the user experience, and allows users to hear the audio played by the headphones while effectively protecting their hearing.

[0065] In a preferred embodiment, step S300 may include:

[0066] The preset frequency band audio includes low frequency band audio, mid frequency band audio and mid-high frequency band audio;

[0067] Respectively receiving the low-frequency audio, the mid-frequency audio and the high-frequency audio, and calculating the user's expected low-frequency audio information, the user's expected mid-frequency audio information and the user's expected mid-high frequency audio information according to the user's settings;

[0068] The audio information of the corresponding frequency bands in the first output curve is adjusted according to the user's expected low-frequency audio information, the user's expected mid-frequency audio information, and the user's expected mid-high frequency audio information, respectively, so as to obtain the third output curve.

[0069] In a specific implementation, the earphones are used to audition three different sound sources: low frequency, medium frequency, and medium-high frequency, simulating the user adjusting different volume levels in different audition scenarios, so that the earphones can be trained and learned for multi-band user habits, and the user's preferred direction for adjusting the audio volume can be confirmed, such as the following three scenarios:

[0070] Scenario 1: Provide a song with heavy bass and a main frequency below 200Hz as a standard low-frequency sound source, and let the user choose the volume that he or she feels most comfortable with. The user preference curve for low frequencies is calculated, that is, the user's expected low-frequency audio information;

[0071] Scenario 2: Provide a baritone voice audio as a standard intermediate frequency sound source, the frequency range can be 200Hz-1000Hz, preferably 800Hz. Let the user choose the volume that he feels most comfortable with, and calculate the user preference curve of the intermediate frequency, that is, the user's expected intermediate frequency audio information; 200-1000

[0072] Scenario 3: Provide a soprano voice audio as a standard mid-high frequency sound source, the frequency range can usually be 1000Hz-3000Hz, preferably 2000Hz. Let the user choose the volume that he feels most comfortable with, and calculate the user preference curve for mid-high frequencies, that is, the user's expected high-frequency audio information.

[0073] Finally, the audio information of the corresponding frequency band in the first output curve is adjusted according to the user's expected low-frequency audio information, the user's expected medium-frequency audio information, and the user's expected medium-high frequency audio information, so as to obtain the third output curve. For example, if the volume, frequency, amplitude, and other information in the frequency band of the first output curve are lower than the user's expected medium-frequency audio information, the corresponding audio information amount in the first output curve is increased.

[0074] In a preferred embodiment, Figure 2 As shown, step S400 may include:

[0075] S401, if the amplitude difference between the second output curve and the third output curve is greater than the preset amplitude threshold, the second output curve is compensated according to the amplitude difference, and the coherence value between the compensated second output curve and the third output curve is calculated. In a specific embodiment, if the overall RMS (amplitude) difference between the second output curve and the third output curve is greater than the preset amplitude threshold, it means that the amplitude difference between the two is within a relatively ideal adjustment range, and the RMS calculation adjustment of the second output curve and the third output curve can be performed. For example, the RMS of the second output curve is -35dB, and the RMS of the third output curve is -20dB, then the second output curve needs to be increased by 15dB to reach the amplitude of the third output curve, that is, to reach the audio amplitude expected by the user. Among them, the coherence value represents the similarity between the compensated second output curve and the third output curve. The larger the value, the more similar the two are.

[0076] S402: If the coherence value is greater than a preset coherence threshold, the volume value of the first output curve is adjusted according to the amplitude difference to obtain a fourth output curve, and a fifth output curve is calculated based on the algorithm model and the fourth output curve, wherein the fourth output curve is a theoretical output curve of the audio stream after the volume value is adjusted, and the fifth output curve is a theoretical actual output curve of the audio stream after the volume value is adjusted;

[0077] S403, calculating the coherence value between the fifth output curve and the third output curve. If the coherence value is less than the preset coherence threshold, calculating the difference value between each frequency point of the fifth output curve and the third output curve, and calculating the 0dB adjustment margin value of the fourth output curve at each frequency point, as well as the adjustment margin value of the fourth output curve at each frequency point and the frequency point corresponding to the preset hearing protection curve. The adjustable margin value of each frequency point is calculated according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve. The audio information of each frequency point of the fifth output curve is adjusted according to the adjustable margin value of each frequency point to obtain an actual audio output curve that meets the user's expectations.

[0078] In this embodiment, the second output curve is first adjusted by RMS, and then the coherence value between the compensated second output curve and the third output curve is calculated to roughly adjust the output audio, and then the coherence value between the fifth output curve and the third output curve is calculated, and the output audio is accurately adjusted at different frequency points according to the coherence value, so as to obtain audio quality that better meets the user's personal needs and effectively protect the user's hearing.

[0079] In a preferred implementation, calculating the adjustable margin value of each frequency point according to the difference value, the 0dB adjustment margin value, and the adjustment margin value of the frequency point corresponding to the hearing protection curve in step S403 may include: selecting the smaller value between the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve as the adjustable margin value, and the adjustable margin value is less than or equal to the difference value.

[0080] For example, the RMS of the current second output curve at the 200Hz frequency point is -9dB, and the RMS output size of the third output curve (expected curve) is -4dB. At this time, the adjustable range of the adjustment margin value from 0dB is 9dB, and the output size of the hearing protection curve at this frequency point is -2dB, so the allowed adjustable size is 7dB. 7dB<9dB, so at this time, the adjustable size of 7dB is prioritized.

[0081] The RMS of the current second output curve at the 800Hz frequency point is -2dB, and the RMS output size of the third output curve (expected curve) is -1dB. At this time, the adjustable range of the adjustment margin value from 0dB is 2dB. If the output size of the hearing protection curve at this frequency point is 0dB, the allowed adjustable size is 2dB, 2dB=2dB, so at this time, the adjustable size of 2dB is prioritized.

[0082] That is, when the adjustable margin value of the distance hearing protection curve is greater than or equal to the adjustable margin value of the distance 0dB, the adjustable margin value of 0dB is given priority, and when the adjustable margin value of the distance hearing protection curve is less than the adjustable margin value of the distance 0dB, the adjustable margin of the hearing protection curve is given priority. This not only achieves accurate audio adjustment of different frequency points, but also protects the user's hearing.

[0083] In a preferred embodiment, if the amplitude difference between the second output curve and the third output curve is less than a preset amplitude threshold, the volume value of the first output curve is adjusted to be close to the volume value of the preset hearing protection curve, and the amplitude of the audio is adjusted at the frequency point that affects the hearing sense. In a specific embodiment, if the overall RMS difference between the second output curve and the third output curve is less than the preset amplitude threshold, it means that the current environmental noise is too loud and the user cannot hear the headphone sound at all. At this time, based on the first output curve, the volume is adjusted to be close to the hearing protection curve, and the audio amplitude of the frequency points that most affect the hearing sense is adjusted to the greatest extent, for example, the three frequency points of 200Hz, 1500Hz, and 3000Hz.

[0084] In addition, the present invention also provides a computer-readable storage medium, wherein the storage medium stores a program, wherein the program is used to be executed to implement any one of the adaptive audio output methods described in the present invention.

[0085] The present invention also discloses an MCU chip, comprising a processor and a memory, wherein a calculation program is stored in the memory, and the processor can execute the calculation program to implement any one of the adaptive audio output methods described in the present invention.

[0086] The invention also discloses a wireless headset, comprising the MCU chip of the invention.

[0087] Figure 3 It is a schematic diagram of audio curves output at different stages according to the technical solution of the present invention, namely, the first output curve (curve A, the internal electrical signal output curve obtained by the earphone), the second output curve (curve B, the theoretical actual output curve calculated after obtaining the microphone noise, that is, the audio curve after noise interference), the third output curve (curve C, trained in combination with the user's listening preferences, the user expectation curve calculated based on curve A), the fourth output curve (curve D, the local electrical signal curve D obtained after the earphone curve A increases the output signal size), the fifth output curve (curve E, the theoretical actual output curve E calculated from curve D), and the hearing protection curve (curve F, a pre-set hearing protection curve).

[0088] As can be seen from the figure, curve B is the audio signal of curve A interfered by noise, curve C has higher low-frequency energy than curve A, curve D is the amplification of curve A, and curve E is the audio signal of curve B adjusted by RMS difference.

[0089] Combine the following Figure 3An example of the technical solution of the present invention is described in detail. When playing audio, first obtain curve A in the figure, then calculate curve B according to curve A and the algorithm model, calculate curve C according to the user's expected audio information and curve A, and finally compensate curve B according to the amplitude difference between curve B and curve C, and then calculate the coherence value of the compensated curve B and curve C. When the coherence value is greater than the preset coherence threshold, the volume of curve A will be adjusted according to the amplitude difference between curve B and curve C, and curve D will be obtained. Then, curve E is calculated based on the algorithm model and curve D, and finally the coherence value of curve E and curve C is calculated. If the coherence value is less than the preset coherence threshold, the audio information of each frequency point of curve E is accurately adjusted according to the difference value of the frequency points of curve E and curve C, the 0dB adjustment margin value and the hearing protection curve F, so as to obtain an actual audio output curve that meets the user's expectations.

[0090] The present invention also discloses an adaptive audio output device, which is applied to open-type headphones, such as Figure 4 As shown, the device includes a first output curve acquisition module 100, a second output curve calculation module 200, a third output curve calculation module 300 and an output audio adjustment module 400, the first output curve acquisition module 100 is used to obtain the first output curve of the audio, the first output curve is the theoretical output curve of the audio stream of the headset; the second output curve calculation module 200 is used to calculate the second output curve of the audio according to the first output curve and the algorithm model, the second output curve is the theoretical actual output curve of the audio stream of the headset; the third output curve calculation module 300 is used to calculate the third output curve of the audio according to the user's expected audio information of the preset frequency band audio and the first output curve, the third output curve is the audio stream output curve expected by the user; the output audio adjustment module 400 is used to adjust the second output curve according to the amplitude difference between the second output curve and the third output curve, so as to obtain the actual audio output curve that meets the user's expectations.

[0091] In a preferred implementation, the algorithm model in the second output curve calculation module 200 is calculated through a neural network based on the environmental noise and the first output curve.

[0092] In a preferred embodiment, the third output curve calculation module 300 includes a user expected audio output unit and a third output curve calculation unit, and the preset frequency band audio includes low-frequency band audio, mid-frequency band audio and mid-high frequency band audio; the user expected audio output unit is used to output user expected low-frequency audio information, user expected mid-frequency audio information and user expected high-frequency audio information according to the user's settings when playing the low-frequency band audio, mid-frequency band audio and high-frequency band audio; the third output curve calculation unit is used to adjust the audio information of the corresponding frequency band in the first output curve according to the user expected low-frequency audio information, the user expected mid-frequency audio information and the user expected high-frequency audio information, respectively, so as to obtain the third output curve.

[0093] In a preferred implementation manner, the low frequency band is an audio frequency band below 200 Hz, the middle frequency band is 200 Hz-1000 Hz, and the middle and high frequency band is 1000 Hz-3000 Hz.

[0094] In a preferred embodiment, the output audio adjustment module 400 includes a coherence value calculation unit, an output curve adjustment unit and an adjustable margin calculation unit. The coherence value calculation unit is used to compensate the second output curve according to the amplitude difference when the amplitude difference between the second output curve and the third output curve is greater than a preset amplitude threshold, and calculate the coherence value between the compensated second output curve and the third output curve; the output curve adjustment unit is used to adjust the volume value of the first output curve according to the amplitude difference when the coherence value is greater than a preset coherence threshold to obtain a fourth output curve, and calculate a fifth output curve based on the algorithm model and the fourth output curve, the fourth output curve is the theoretical output curve of the audio stream after the volume value is adjusted, and the fifth output curve The line is a theoretical actual output curve of the audio stream after the volume value is adjusted; the adjustable margin calculation unit is used to calculate the coherence value between the fifth output curve and the third output curve. If the coherence value is less than the preset coherence threshold, the difference value of each frequency point between the fifth output curve and the third output curve is calculated, and the 0dB adjustment margin value of the fourth output curve at each frequency point, as well as the adjustment margin value of the fourth output curve at each frequency point and the corresponding frequency point of the preset hearing protection curve are calculated. The adjustable margin value of each frequency point is calculated according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the corresponding frequency point of the hearing protection curve. The audio information of each frequency point of the fifth output curve is adjusted according to the adjustable margin value of each frequency point to obtain the actual audio output curve that meets the user's expectations.

[0095] In a preferred implementation manner, the adjustable margin calculation unit calculates the adjustable margin value of each frequency point according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve, including: selecting the smaller value between the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve as the adjustable margin value, and the adjustable margin value is less than or equal to the difference value.

[0096] In a preferred embodiment, the coherence value calculation unit is also used to adjust the volume value of the first output curve to a volume value close to a preset hearing protection curve when the amplitude difference between the second output curve and the third output curve is less than a preset amplitude threshold, and adjust the amplitude of the audio at a frequency point that affects the hearing sense.

[0097] In a preferred embodiment, the frequency points affecting hearing perception include 200 Hz, 1500 Hz and 3000 Hz.

[0098] The present invention also discloses a wireless headset, comprising the adaptive audio output device described in any one of the present inventions.

[0099] It will be appreciated by those skilled in the art that, under the premise of no conflict, the above-mentioned preferred solutions can be freely combined and superimposed. Among them, the flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings, for example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. The numbering of each step in this article is only for the convenience of description and reference, and is not used to limit the order of execution. The specific execution order is determined by the technology itself, and those skilled in the art can determine various allowable and reasonable orders based on the technology itself.

[0100] It should be noted that the use of step numbers (letters or numbers) to refer to certain specific method steps in the present invention is only for the purpose of convenience and brevity of description, and is by no means intended to limit the order of these method steps by letters or numbers. Those skilled in the art will understand that the order of the relevant method steps should be determined by the technology itself and should not be inappropriately limited by the existence of step numbers. Those skilled in the art can determine various permissible and reasonable step orders based on the technology itself.

[0101] Those skilled in the art will appreciate that, without conflict, the above-mentioned preferred solutions can be freely combined and superimposed.

[0102] It should be understood that the above-mentioned embodiments are merely illustrative and not restrictive. Without departing from the basic principles of the present invention, various obvious or equivalent modifications or substitutions that can be made by those skilled in the art to the above-mentioned details will all be included in the scope of the claims of the present invention.

Claims

1. An adaptive audio output method, applied to open headphones, characterized in that: The method comprises the steps of: S100, obtaining a first audio output curve, where the first output curve is a theoretical output curve of an audio stream of a headset; S200, calculating a second output curve of the audio according to the first output curve and an algorithm model based on ambient noise, where the second output curve is a theoretical actual output curve of the audio stream of the headset; S300, calculating a third output curve of the audio according to user expected audio information of the audio in a preset frequency band and the first output curve, wherein the third output curve is an audio stream output curve expected by the user; S400: adjusting the second output curve according to the amplitude difference between the second output curve and the third output curve to obtain an actual audio output curve that meets user expectations.

2. The adaptive audio output method according to claim 1, characterized in that: The algorithm model in step S200 is obtained by calculating through a neural network based on the environmental noise and the first output curve.

3. The adaptive audio output method according to claim 1, characterized in that: The step S300 includes: The preset frequency band audio includes low frequency band audio, mid frequency band audio and mid-high frequency band audio; Respectively receiving the low-frequency audio, the mid-frequency audio and the high-frequency audio, and calculating the user's expected low-frequency audio information, the user's expected mid-frequency audio information and the user's expected mid-high frequency audio information according to the user's settings; The audio information of the corresponding frequency bands in the first output curve is adjusted according to the user's expected low-frequency audio information, the user's expected mid-frequency audio information, and the user's expected mid-high frequency audio information, respectively, so as to obtain the third output curve.

4. The adaptive audio output method according to claim 1, characterized in that: The low frequency band is an audio frequency band below 200 Hz, the middle frequency band is 200 Hz-1000 Hz, and the middle and high frequency band is 1000 Hz-3000 Hz.

5. The adaptive audio output method according to claim 1, characterized in that: The step S400 includes: S401, if the amplitude difference between the second output curve and the third output curve is greater than a preset amplitude threshold, performing compensation calculation on the second output curve according to the amplitude difference, and calculating a coherence value between the compensated second output curve and the third output curve; S402: If the coherence value is greater than a preset coherence threshold, the volume value of the first output curve is adjusted according to the amplitude difference to obtain a fourth output curve, and a fifth output curve is calculated based on the algorithm model and the fourth output curve, wherein the fourth output curve is a theoretical output curve of the audio stream after the volume value is adjusted, and the fifth output curve is a theoretical actual output curve of the audio stream after the volume value is adjusted; S403, calculating the coherence value between the fifth output curve and the third output curve. If the coherence value is less than the preset coherence threshold, calculating the difference value between each frequency point of the fifth output curve and the third output curve, and calculating the 0dB adjustment margin value of the fourth output curve at each frequency point, as well as the adjustment margin value of the fourth output curve at each frequency point and the frequency point corresponding to the preset hearing protection curve. The adjustable margin value of each frequency point is calculated according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve. The audio information of each frequency point of the fifth output curve is adjusted according to the adjustable margin value of each frequency point to obtain an actual audio output curve that meets the user's expectations.

6. The adaptive audio output method according to claim 5, characterized in that: The step S403 of calculating the adjustable margin value of each frequency point according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve includes: A smaller value between the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve is selected as the adjustable margin value, and the adjustable margin value is less than or equal to the difference value.

7. The adaptive audio output method according to any one of claims 5 to 6, characterized in that: If the amplitude difference between the second output curve and the third output curve is less than a preset amplitude threshold, the volume value of the first output curve is adjusted to be close to the volume value of the preset hearing protection curve, and the amplitude of the audio is adjusted at the frequency point that affects the hearing sense.

8. The adaptive audio output method according to claim 7, characterized in that: The frequency points that affect hearing perception include 200 Hz, 1500 Hz and 3000 Hz.

9. A computer-readable storage medium, characterized in that: The storage medium stores a program, wherein the program is used to be executed to implement the adaptive audio output method according to any one of claims 1 to 8.

10. An MCU chip, comprising a processor and a memory, characterized in that: The memory stores a computational program, and the processor is capable of executing the computational program to implement the adaptive audio output method as described in any one of claims 1-8.

11. A wireless headset, characterized in that: Comprising the MCU chip as claimed in claim 10.

12. An adaptive audio output device, applied to open headphones, characterized in that: The device comprises a first output curve acquisition module, a second output curve calculation module, a third output curve calculation module and an output audio adjustment module: The first output curve acquisition module is used to acquire a first output curve of the audio, where the first output curve is a theoretical output curve of the audio stream of the earphone; The second output curve calculation module is used to calculate the second output curve of the audio according to the first output curve and the algorithm model, and the second output curve is a theoretical actual output curve of the audio stream of the earphone; The third output curve calculation module is used to calculate a third output curve of the audio according to the user expected audio information of the preset frequency band audio and the first output curve, and the third output curve is the audio stream output curve expected by the user; The output audio adjustment module is used to adjust the second output curve according to the amplitude difference between the second output curve and the third output curve, so as to obtain an actual audio output curve that meets user expectations.

13. The adaptive audio output device according to claim 12, characterized in that: The algorithm model in the second output curve calculation module is calculated through a neural network based on environmental noise and the first output curve.

14. The adaptive audio output device according to claim 12, characterized in that: The third output curve calculation module includes a user expected audio output unit and a third output curve calculation unit, and the preset frequency band audio includes low frequency band audio, mid frequency band audio and mid-high frequency band audio; The user expected audio output unit is used to output user expected low frequency audio information, user expected middle frequency audio information and user expected high frequency audio information according to the user's setting when playing the low frequency band audio, the middle frequency band audio and the high frequency band audio; The third output curve calculation unit is used to adjust the audio information of the corresponding frequency bands in the first output curve according to the user's expected low-frequency audio information, the user's expected mid-frequency audio information and the user's expected high-frequency audio information, so as to obtain the third output curve.

15. The adaptive audio output device according to claim 12, characterized in that: The low frequency band is an audio frequency band below 200 Hz, the middle frequency band is 200 Hz-1000 Hz, and the middle and high frequency band is 1000 Hz-3000 Hz.

16. The adaptive audio output device according to claim 12, characterized in that: The output audio adjustment module includes a coherence value calculation unit, an output curve adjustment unit and an adjustable margin calculation unit. The coherence value calculation unit is used for performing compensation calculation on the second output curve according to the amplitude difference when the amplitude difference between the second output curve and the third output curve is greater than a preset amplitude threshold, and calculating the coherence value of the compensated second output curve and the third output curve; The output curve adjustment unit is used to adjust the volume value of the first output curve according to the amplitude difference when the coherence value is greater than a preset coherence threshold value to obtain a fourth output curve, and calculate a fifth output curve based on the algorithm model and the fourth output curve, wherein the fourth output curve is a theoretical output curve of the audio stream after the volume value is adjusted, and the fifth output curve is a theoretical actual output curve of the audio stream after the volume value is adjusted; The adjustable margin calculation unit is used to calculate the coherence value between the fifth output curve and the third output curve. If the coherence value is less than the preset coherence threshold, the difference value of each frequency point between the fifth output curve and the third output curve is calculated, and the 0dB adjustment margin value of the fourth output curve at each frequency point, as well as the adjustment margin value of the fourth output curve at each frequency point and the frequency point corresponding to the preset hearing protection curve are calculated. The adjustable margin value of each frequency point is calculated according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve. The audio information of each frequency point of the fifth output curve is adjusted according to the adjustable margin value of each frequency point to obtain an actual audio output curve that meets the user's expectations.

17. The adaptive audio output device according to claim 16, characterized in that: The adjustable margin calculation unit calculates the adjustable margin value of each frequency point according to the difference value, the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve, including: A smaller value between the 0dB adjustment margin value and the adjustment margin value of the frequency point corresponding to the hearing protection curve is selected as the adjustable margin value, and the adjustable margin value is less than or equal to the difference value.

18. The adaptive audio output device according to claim 16, characterized in that: The coherence value calculation unit is also used to adjust the volume value of the first output curve to a volume value close to a preset hearing protection curve when the amplitude difference between the second output curve and the third output curve is less than a preset amplitude threshold, and adjust the amplitude of the audio at a frequency point that affects the hearing sense.

19. The adaptive audio output device according to claim 18, characterized in that: The frequency points that affect hearing perception include 200 Hz, 1500 Hz and 3000 Hz.

20. A wireless headset, characterized in that: Comprising the adaptive audio output device as described in any one of claims 12-20.

Images