Electronic ear audio channel switching method and device based on content driving, and electronic equipment

Abstract

The invention discloses an electronic ear audio channel switching method based on content driving. The method comprises the following steps: calculating the power of an input signal frame; calculating fast smoothing power and slow smoothing power of the current signal frame based on the power of the input signal frame and different smoothing coefficients; and switching audio channels of the electronic ear based on the difference value between the fast smoothing power and the slow smoothing power / the difference value between the power of the input signal frame and the slow smoothing power, and controlling mutual switching between a first audio channel and a second audio channel. According to the electronic ear audio channel switching method based on content driving, real-time switching control of the two audio channels of the electronic ear is carried out based on the power of the input signal frame, and automatic control of channel switching is achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of electronic ear audio channel switching, and in particular to a content-driven electronic ear audio channel switching method and device, and electronic equipment. Background Art

[0002] The Tomatis Method (TM) is a rehabilitation technique used in psychology that aims to stimulate the cochlea in the inner ear through filtered air and bone conduction sound. The electronic filter and amplifier system used in this therapy is called the "electronic ear". The theory behind the relationship between hearing and speaking is covered in Tomatis's Law. Alfred Tomatis observed that problems singing or speaking within a specific frequency spectrum were associated with hearing difficulties within the same frequency spectrum, and proposed that the voice and vocal range could be improved by opening up the ability to hear specific frequency spectrums. This principle is called the Tomatis Effect. Over the years, his ideas have been used in other forms of sound therapy and a universal "electronic ear" tool has been developed.

[0003] The "electronic ear" stimulates the basilar membrane of the cochlea by means of air conduction and bone conduction. Air conduction is based on the typical ear pathway, where sound vibrations are picked up by the eardrum and transmitted to the oval window of the cochlea through the ossicles. Bone conduction is the perception of vibrations transmitted through the bones, stimulating the basilar membrane through pressure changes in the cochlear fluid or vibrations of the cochlear walls. Bone-conducted sound reaches the brain faster due to the higher density of the medium; however, a large part of the acoustic signal is reflected due to the air-bone impedance mismatch. This is why bone conduction is mainly biased towards our own voice. Tomatis concluded from this observation that air conduction is used for "communicating with the outside world" and bone conduction is used for "listening to ourselves".

[0004] Another feature that is important to the Tomatis Method (TM) is the use of human ear dominance, which is which ear is dominant during the hearing process. Left ear dominance is problematic because the path from the left ear to the left hemisphere is longer. The delay between the left and right ear is about 0.4-0.9 milliseconds. People with a left-ear dominant hearing have many hearing problems that can lead to various psychological disorders, such as dyslexia. One of the main goals of Tomatis rehabilitation is to increase the role of the right ear for people with a left-ear dominant hearing. For this reason, the left and right channels have separate delays and adjustable volume levels.

[0005] Figure 1The flowchart of the sound processing of the "electronic ear" is shown, which is an audio system whose main functions are to amplify, gate and filter the sounds entering the three output channels (left air conduction, right air conduction and bone conduction). Gating (C1filter, C2 filter) is the process of changing the type of filter depending on the signal level. Below a certain amplitude level, the C1 filter is switched on, above a certain level, the filter switches to the C2 filter. This sudden change generates an impulse that theoretically stimulates the brain. The C1 filter and the C2 filter are filters with a crossover frequency of 1000 Hz. The boost / cut level is adjusted by the specialist who practices Tomatis Therapy and can be set from -5 to 5 dB. The electronic ear also contains a second filter - a high-pass filter with an adjustable cutoff frequency. Its supposed function is to simulate the medium of the mother's womb. In some cases, it is necessary to increase or decrease the effect of bone conduction relative to air conduction.

[0006] The prior art discloses a brain stimulator (Brain-Activator), which is a Tomatis system based on analog circuits. Please refer to https: / / www.mozart-brain-lab.com / brain-activator?lang=en. The adjustment point of the threshold control (Gate) needs to be set according to the signal characteristics, and the switch (Switch) parameter in the threshold control (Gate) is set manually. When the parameter is 1, the signal passes through the C1 filter (C1 filter); when the parameter is 10, the signal passes through the C2 filter (C1 filter); when the parameter is an intermediate value, the signal passes through the C1 filter and the C2 filter randomly. If the target is that the probability of passing the C1 filter and the C2 filter is 50%, the choice of this parameter for different input signals is not fixed at this time, that is, signal A may need to be set to 4; but signal B may need to be set to 6. As signal A evolves over time, the short-term parameters are also not fixed. It may need to be set to 4 in the early stage; but it may need to be set to 6 in the later stage. Summary of the invention

[0007] The purpose of the present invention is to overcome the shortcomings and defects of the prior art and to provide a content-driven electronic ear audio channel switching method and device, and electronic equipment that replaces manual intervention.

[0008] In a first aspect, the present invention provides a content-driven electronic ear audio channel switching method, comprising the steps of:

[0009] Calculate the power of the input signal frame;

[0010] Based on the power of the input signal frame, calculating the fast smoothed power and the slow smoothed power of the current signal frame;

[0011] Based on the difference between the fast smooth power and the slow smooth power / the difference between the power of the input signal frame and the slow smooth power, the electronic ear audio channel is switched to control the switching between the first audio channel and the second audio channel.

[0012] The power of the input signal frame is calculated using the following formula:

[0013] F power =10·log 10 (mean(F·F));

[0014] In the formula, F power represents the power of the input signal frame, F represents the input signal frame, F·F indicates the energy, and mean() indicates the average value.

[0015] Among them, the fast smoothing power and slow smoothing power of the current signal frame are calculated by the following formula:

[0016]

[0017] In the formula, F power_sf 、F power_ss Respectively represent the fast smoothing power and slow smoothing power of the current input signal frame, Respectively represent F power_sf 、F power_ss The corresponding smoothed power of the previous signal frame; alpha sf , alpha ss They represent the corresponding smoothing factors respectively.

[0018] Wherein, based on the difference between the fast smoothed power and the slow smoothed power / the difference between the power of the input signal frame and the slow smoothed power, the electronic ear audio channel is switched to control the switching between the first audio channel and the second audio channel, including:

[0019] When the current channel is the first audio channel, if the difference between the fast smoothed power and the slow smoothed power of the current signal frame is greater than the first threshold, or the difference between the power of the input signal and the slow smoothed power of the current signal is greater than the second threshold, switch to the second audio channel;

[0020] When the current channel is the second audio channel, if the difference between the fast smoothed power and the slow smoothed power of the current signal frame is less than the third threshold, or the difference between the power of the input signal and the slow smoothed power of the current signal is less than the fourth threshold, switch to the first audio channel.

[0021] Among them, the first threshold, the second threshold, the third threshold, and the fourth threshold are fixed values ​​or non-fixed values, wherein the first threshold and the second threshold are positive values ​​greater than 0, and the third threshold and the fourth threshold are negative values ​​less than 0.

[0022] Among them, when the first threshold, the second threshold, the third threshold, and the fourth threshold are non-fixed values, a threshold for the number of jumps in a period of time is preset, and the number of real-time jumps is dynamically adjusted. If the number of real-time jumps in a period of time is lower than the number threshold, the first threshold, the second threshold, the third threshold, and the fourth threshold are lowered until the number of real-time jumps matches the number threshold.

[0023] Wherein, the input signal is any time domain signal or frequency signal.

[0024] The input signal is a superposition signal of a microphone collection signal, an audio playback signal and a microphone collection signal, or a brain wave collection signal.

[0025] According to a second aspect of the present invention, there is provided a content-driven electronic ear audio channel switching device, comprising a memory and a processor, wherein the memory is used to store a method program supporting execution of the processor, and the processor is configured to execute the program stored in the memory to implement the content-driven electronic ear audio channel switching method.

[0026] According to a third aspect of the present invention, an electronic device is provided, comprising the content-driven electronic ear audio channel switching device.

[0027] The content-driven electronic ear audio channel switching method of the present invention performs real-time switching control of the two audio channels of the electronic ear based on the power size of the input signal frame, realizes automatic control of channel switching, and makes the signal input of the switched channel more in line with the use needs. Automatic switching is achieved by using power jumps, so that the switching can be more regular and more comfortable in listening in places where the energy changes dramatically. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic diagram of signal processing of electronic ears under existing technology.

[0029] Figure 2 The present invention is a flowchart of a content-driven electronic ear audio channel switching method according to an embodiment of the present invention.

[0030] Figure 3 is a schematic diagram of content-driven electronic ear audio channel switching according to an embodiment of the present invention;

[0031] Figure 4 4 is a schematic diagram of an electronic device for switching audio channels of an electronic ear based on content-driven operation according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0033] The content-driven electronic ear audio channel switching method of the embodiment of the present invention automatically calculates the switch value in real time according to the input signal, so that the switch parameter is dynamically generated, and then according to the preset gate switching rule, the switch can calculate the switching of the C1 channel and the C2 channel in real time according to the input signal, replacing manual intervention

[0034] See also Figure 2 As shown, in the embodiment of the present application, the content-driven electronic ear audio channel switching method includes the steps of:

[0035] S1. Calculate the power of the input signal frame;

[0036] S2. Based on the power of the input signal frame and different smoothing coefficients, calculate the fast smoothing power and slow smoothing power of the current signal frame;

[0037] S3. Based on the difference between the fast smooth power and the slow smooth power / the difference between the power of the input signal frame and the slow smooth power, the electronic ear audio channel is switched to control the switching between the first audio channel and the second audio channel.

[0038] In the embodiment of the present application, when an audio signal is input, the device will automatically calculate the switch value, so that the switch value can be automatically and dynamically generated between different playback contents and between different segments of the same playback content. Then, according to the preset gate switching rules, the switch can calculate the switching of the C1 channel and the C2 channel in real time according to the input signal, instead of manually adjusting the switch, thereby realizing content-driven automatic control of the adjustment.

[0039] In a specific embodiment, the power of the input signal frame may be calculated using the following formula:

[0040] F power =10·log 10 (mean(F·F));

[0041] In the formula, F power Indicates the power of the input signal frame, F indicates the input signal frame, such as a signal frame with 1024 points @ 48kHz sampling rate, F·F indicates energy, and mean() indicates average value.

[0042] After calculating the power of an input signal, the smoothed power of the signal can be calculated. Different smoothing coefficients can be used to obtain fast-changing and slow-changing powers. In a specific embodiment, the fast smoothed power and slow smoothed power of the current signal frame can be calculated by the following formula:

[0043]

[0044] In the formula, F power_sf 、F power_ss Respectively represent the fast smoothing power and slow smoothing power of the current input signal frame, Respectively represent F power_sf 、F power_ss The corresponding smoothed power of the previous signal frame; alpha sf , alpha ss Represent the corresponding smoothing factors, typically alpha sf and alpha ss The values ​​are 0.9 and 0.999.

[0045] In some embodiments, based on the difference between the fast smoothed power and the slow smoothed power / the difference between the power of the input signal frame and the slow smoothed power, the electronic ear audio channel is switched to control the switching between the first audio channel and the second audio channel, including:

[0046] When the current channel is the first audio channel, if the difference between the fast smoothed power and the slow smoothed power of the current signal frame is greater than the first threshold, or the difference between the power of the input signal and the slow smoothed power of the current signal is greater than the second threshold, switch to the second audio channel;

[0047] When the current channel is the second audio channel, if the difference between the fast smoothed power and the slow smoothed power of the current signal frame is less than the third threshold, or the difference between the power of the input signal and the slow smoothed power of the current signal is less than the fourth threshold, switch to the first audio channel.

[0048] refer to Figure 1As shown, the first audio channel and the second audio channel are respectively provided with a C1 filter (Fliter) and a C2 filter (Fliter). After the external audio signal enters through the input module (IN), it is first processed by the threshold control (Gate), and the signal entering the first audio channel is selected to be processed by the C1 filter (Fliter), or the signal entering the second audio channel is selected to be processed by the C2 filter (Fliter); the signals processed by the C1 filter (Fliter) and the C2 filter (Fliter) are respectively output after passing through an HP filter (HP Fliter), and then passing through corresponding amplifiers (Amplifier), respectively realizing air conduction and bone conduction output, wherein, in the bone conduction channel, before the amplifier (Amplifier), the Z -X Delay processing and output after X seconds.

[0049] In some embodiments, the first threshold, the second threshold, the third threshold, and the fourth threshold are fixed values ​​or non-fixed values, wherein the first threshold and the second threshold are positive values ​​greater than 0, and the third threshold and the fourth threshold are negative values ​​less than 0, the absolute value of the first threshold is the same as or different from the absolute value of the third threshold, and the absolute value of the second threshold is the same as or different from the absolute value of the fourth threshold, such as 2dB, 5dB, -2dB, -5dB, and can also be set to other thresholds of different sizes, or four thresholds of different sizes.

[0050] In some embodiments, when the first threshold, the second threshold, the third threshold, and the fourth threshold are non-fixed values, a threshold for the number of jumps over a period of time is preset, and the number of real-time jumps is dynamically adjusted. If the number of real-time jumps over a period of time is lower than the threshold, the first threshold, the second threshold, the third threshold, and the fourth threshold are lowered until the number of real-time jumps matches the threshold.

[0051] Specifically, if the current audio channel is the first audio channel, such as the C1 channel (C1 filter channel), and F power_sf -F power_ss >F thrd_sa or F power -F power_ss >F thrd_fa , switch to the second audio channel, such as the C2 channel (C2 filter channel);

[0052] If the current audio channel is the second audio channel, such as the C2 channel (C2 filter channel), and F power_sf -F power_ss <F thrd_sr or F power -F power_ss <F thrd_fr , switch to the first audio channel, such as the C1 channel (C1 filter channel).

[0053] Among them, the F thrd_sa ,F t g rd_fa ,F t g rd_sr ,F thrd_fr It can be set to a fixed value, such as 2dB, 5dB, -2dB, -5dB. thrd_sa ,F thrd_fa ,F thrd_sr ,F thrd_fr You can also set a threshold for the number of jumps within a period of time and dynamically adjust the threshold. For example, if you want to set 10 jumps per minute, if the actual number of jumps is lower than the threshold, gradually reduce F. thrd_sa ,F thrd_fa ,F thrd_sr ,F thrd_fr In order to avoid jumps due to small disturbances, a minimum F thrd_sa ,F thrd_fa ,F thrd_sr ,F thrd_fr , such as 1dB, 2dB, -1dB, -2dB.

[0054] In the embodiment of the present application, the input signal is any time domain signal or frequency signal.

[0055] In an embodiment of the present application, the input signal is a microphone collection signal, a superposition signal of an audio playback signal and a microphone collection signal, or a brain wave collection signal.

[0056] See also Figure 3 As shown, in a second aspect of an embodiment of the present application, a content-driven electronic ear audio channel switching device is provided, comprising a memory and a processor, wherein the memory is used to store a method program supporting execution of the processor, and the processor is configured to execute the program stored in the memory to implement the content-driven electronic ear audio channel switching method.

[0057] The content-driven electronic ear audio channel switching device also includes a communication interface for communication between the memory and the processor, and the memory is used to store a computer program that can be run on the processor. The memory may include a high-speed RAM memory, and may also include a non-volatile memory, such as at least one disk memory. If the memory, the processor and the communication interface are implemented independently, the communication interface, the memory and the processor can be connected to each other through a bus and complete the communication between each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0058] Optionally, in a specific implementation, if the memory, processor and communication interface are integrated on a chip, the memory, processor and communication interface can communicate with each other through an internal interface.

[0059] The processor may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0060] See also Figure 4 As shown, in a third aspect of the embodiment of the present application, an electronic device is provided, including the content-driven electronic ear audio channel switching device, the electronic device includes an electronic ear, and the electronic ear structure is as shown in Figure 1As shown, it includes amplifying, filtering and gating the sound entering three output channels (left air conduction, right air conduction and bone conduction). Gating (C1 filter, C2 filter) is the process of changing the filter type according to the signal level. Below a specific amplitude level, the C1 filter is turned on, and above a specific level, the C1 filter is switched to the C2 filter. The C1 filter and the C2 filter are filters with a crossover frequency of 1000Hz. After the C1 filter and the C2 filter is a filtering channel, including a high-pass filter (HP filter) with an adjustable cutoff frequency, the high-pass filter (HP filter) is an amplification channel, and there are three amplifiers (Amplifier) ​​respectively, corresponding to the left air conduction, the right air conduction and the bone conduction. The electronic device contains the content-driven electronic ear audio channel switching device, which is used to realize automatic threshold control (Gate), automatically calculate the size of the switching parameter threshold of the threshold control (Gate), and compare it with the corresponding set threshold. Through the comparison result, the automatic switching of the two channels or paths is realized, that is, switching back and forth between the two channels or paths.

[0061] According to a fourth aspect of an embodiment of the present invention, a computer-readable storage medium is provided, on which a computer program or instruction is stored. When the computer program or instruction is executed by a processor, it is used to implement the content-driven electronic ear audio channel switching method.

[0062] The fifth aspect of the embodiments of the present application also provides a computer program product, including a computer program or instructions, which, when executed, implements the content-driven electronic ear audio channel switching method as described above.

[0063] The basic principles and main features of the present invention and the advantages of the present invention are shown and described above. It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and the present invention can be implemented in other specific forms without departing from the spirit or basic features of the present invention.

[0064] Therefore, the embodiments should be considered in all respects as illustrative and non-restrictive, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is therefore intended that all changes falling within the meaning and range of equivalent elements of the claims are included in the present invention.

[0065] In addition, it should be understood that although the present specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

Claims

1. A content-driven electronic ear audio channel switching method, characterized in that: Includes steps: Calculate the power of the input signal frame; Based on the power of the input signal frame and different smoothing coefficients, calculating the fast smoothing power and the slow smoothing power of the current signal frame; Based on the difference between the fast smooth power and the slow smooth power / the difference between the power of the input signal frame and the slow smooth power, the electronic ear audio channel is switched to control the switching between the first audio channel and the second audio channel.

2. The content-driven electronic ear audio channel switching method according to claim 1, characterized in that: The power of the input signal frame is calculated using the following formula: F power =10·log 10 (mean(F·F)); In the formula, F power represents the power of the input signal frame, F represents the input signal frame, F·F indicates the energy, and mean() indicates the average value.

3. The content-driven electronic ear audio channel switching method according to claim 2 is characterized in that: The fast smoothing power and slow smoothing power of the current signal frame are calculated by the following formula: In the formula, F power_sf 、F power_ss Respectively represent the fast smoothing power and slow smoothing power of the current input signal frame, Respectively represent F power_sf 、F power_ss The corresponding smoothed power of the previous signal frame; alpha sf , alpha ss They represent the corresponding smoothing factors respectively.

4. The content-driven electronic ear audio channel switching method according to claim 3 is characterized in that: Based on the difference between the fast smoothed power and the slow smoothed power / the difference between the power of the input signal frame and the slow smoothed power, the electronic ear audio channel is switched to control the switching between the first audio channel and the second audio channel, including: When the current channel is the first audio channel, if the difference between the fast smoothed power and the slow smoothed power of the current signal frame is greater than the first threshold, or the difference between the power of the input signal and the slow smoothed power of the current signal is greater than the second threshold, switch to the second audio channel; When the current channel is the second audio channel, if the difference between the fast smoothed power and the slow smoothed power of the current signal frame is less than the third threshold, or the difference between the power of the input signal and the slow smoothed power of the current signal is less than the fourth threshold, switch to the first audio channel.

5. The content-driven electronic ear audio channel switching method according to claim 4 is characterized in that: The first threshold, the second threshold, the third threshold, and the fourth threshold are fixed values ​​or non-fixed values, wherein the first threshold and the second threshold are positive values ​​greater than 0, and the third threshold and the fourth threshold are negative values ​​less than 0.

6. The content-driven electronic ear audio channel switching method according to claim 5, characterized in that: When the first threshold, the second threshold, the third threshold, and the fourth threshold are non-fixed values, a threshold for the number of jumps within a period of time is preset, and the number of real-time jumps is dynamically adjusted. If the number of real-time jumps within a period of time is lower than the number threshold, the first threshold, the second threshold, the third threshold, and the fourth threshold are lowered until the number of real-time jumps matches the number threshold.

7. The content-driven electronic ear audio channel switching method according to claim 1, characterized in that: The input signal is any time domain signal or frequency signal.

8. The content-driven electronic ear audio channel switching method according to claim 1, characterized in that: The input signal is a microphone collection signal, a superposition signal of an audio playback signal and a microphone collection signal, or a brain wave collection signal.

9. A content-driven headphone audio channel switching device, characterized in that: It comprises a memory and a processor, wherein the memory is used to store a method program that supports execution of the processor, and the processor is configured to execute the program stored in the memory to implement the content-driven electronic ear audio channel switching method according to any one of claims 1 to 8.

10. An electronic device, characterized in that The device comprises the content-driven headphone audio channel switching device as claimed in claim 9.

Images