Headphone audio signal processing methods, devices, headphones and storage media

By incorporating an angular motion detection device into the headphones, local audio processing between the master and slave headphones is achieved, solving the problem of real-time transmission of angle information by the headphones, improving data processing performance and versatility, and avoiding audio latency.

CN116801151BActive Publication Date: 2026-11-171MORE ACOUSTIC TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210268799.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-18
Publication Date
2026-11-17
Estimated Expiration
2042-03-18

AI Technical Summary

Technical Problem

In existing spatial audio technologies, headphones need to transmit angle information to mobile phones in real time, which results in high requirements for signal transmission stability, affects data processing performance, and increases device losses.

Method used

An angular motion detection device is set in the main earphone. By acquiring angular motion data, the audio is processed locally in the earphone. The angle change values ​​are shared between the main earphone and the slave earphone, realizing local processing of spatial audio algorithms and avoiding real-time data interaction.

Benefits of technology

It reduces reliance on mobile phones, minimizes the impact of real-time data interaction, improves data processing performance and breadth, and avoids audio latency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116801151B_ABST
    Figure CN116801151B_ABST
Patent Text Reader

Abstract

This application relates to the field of headphone technology, providing a method, apparatus, headphone, and storage medium for audio signal processing in headphones. The method includes: a main headphone acquiring angular motion data collected by an angular motion detection device; when the headphone angle change value is determined to be within a set range based on the angular motion data, processing the acquired audio to be played using a spatial audio algorithm according to the headphone angle change value to obtain a first channel audio, and sending a synchronization command carrying the headphone angle change value to a slave headphone; and outputting the first channel audio to the main headphone playback component for output. In this solution, the spatial sound effect processing of both the main and slave headphones is performed locally on the headphones, avoiding sound effect delay and reducing the impact of data communication.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of headphone technology, and particularly relates to an audio signal processing method, device, headphone, and storage medium for headphones. Background Technology

[0002] Spatial audio technology refers to transmitting spatial information data of the audio data source simultaneously during the transmission of audio data. When the audio data is played at the receiving end, the spatial information data corresponding to the audio data is used to create a three-dimensional spatial effect for the user, so as to give the user an immersive auditory experience.

[0003] The main method for implementing spatial audio now is to include gyroscopes in both the left and right earphones. When spatial sound effects are enabled, the earphones collect acceleration and angular velocity data in real time and calculate the change in earphone angle by integration. The earphones then transmit the angle to the mobile phone via Bluetooth. The mobile phone uses the HRTF (Head Related Transfer Function) algorithm to convert the stereo sound effect into audio with spatial sound effects and finally transmits the audio to the earphones.

[0004] This process requires the earphone to transmit angle information to the mobile phone in real time, which places high demands on the stability of signal transmission. It is prone to data loss when encountering strong interference environments. Furthermore, the real-time transmission of angle information significantly increases the power consumption and MIPS (Million Instructions Per Second) of both the earphone and the mobile phone, affecting data processing performance and causing significant device losses. Summary of the Invention

[0005] This application provides an audio signal processing method, apparatus, earphone, and storage medium for earphones, in order to solve the problem that existing spatial audio technologies require earphones to transmit angle information to mobile phones in real time, which places high demands on the stability of signal transmission, affects data processing performance, and causes significant device losses.

[0006] A first aspect of this application provides an audio signal processing method for an earphone, the earphone including a main earphone and a slave earphone, the main earphone being provided with an angular motion detection device, the method comprising:

[0007] The main earphone acquires the angular motion data collected by the angular motion detection device;

[0008] When the headphone angle change value is determined to be within a set range based on the angular motion data, the acquired audio to be played is processed using a spatial audio algorithm according to the headphone angle change value to obtain the first channel audio, and a synchronization command carrying the headphone angle change value is sent to the slave headphone.

[0009] The synchronization command is used to instruct the earphone to process the acquired audio to be played based on the earphone angle change value using a spatial audio algorithm to obtain the second channel audio.

[0010] The first channel audio is output to the main headphone playback component.

[0011] A second aspect of this application provides an audio signal processing device for an earphone, the earphone including a main earphone and a slave earphone, the main earphone being provided with an angular motion detection device, and the audio signal processing device comprising:

[0012] The data acquisition module is used to acquire the angular motion data collected by the angular motion detection device;

[0013] The data processing module is used to, when the change value of the headphone angle is determined to be within a set range based on the angular motion data, process the acquired audio to be played using a spatial audio algorithm to obtain the first channel audio, and send a synchronization command carrying the change value of the headphone angle to the slave headphone; wherein, the synchronization command is used to instruct the slave headphone to process the acquired audio to be played using a spatial audio algorithm based on the change value of the headphone angle to obtain the second channel audio;

[0014] The audio output module is used to output the first channel audio to the main headphone playback component.

[0015] A third aspect of this application provides an earphone, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method described in the first aspect.

[0016] A fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the method described in the first aspect.

[0017] The fifth aspect of this application provides a computer program product that, when run on headphones, causes the headphones to perform the steps of the method described in the first aspect.

[0018] As can be seen from the above, in this embodiment, the main earphone acquires angular motion data collected by the angular motion detection device. When the angular motion data determines that the earphone angle change value is within a set range, the main earphone processes the acquired audio to be played locally using a spatial audio algorithm based on the earphone angle change value to obtain the first channel audio. The first channel audio is then output to the main earphone playback component. The earphone angle change value is also sent to the slave earphone, which processes the audio to be played locally using a spatial audio algorithm based on the earphone angle change value to obtain the second channel audio. The second channel audio is then output to the slave earphone playback component. The sound effect algorithm and the data of the audio to be played are placed at the earphone end. The main earphone performs the acquisition of angle change data and the sharing of angle data with the slave earphone. The spatial sound effect processing of both the main and slave earphones is done locally on the earphones, without relying on the mobile phone. At the same time, it avoids real-time data interaction with the mobile phone, avoids sound effect latency, reduces the impact of data communication, and improves the versatility of the application. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a flowchart of an audio signal processing method for headphones provided in an embodiment of this application. Figure 1 ;

[0021] Figure 2 This is a flowchart of an audio signal processing method for headphones provided in an embodiment of this application. Figure 2 ;

[0022] Figure 3 This is a structural diagram of an audio signal processing device for headphones provided in an embodiment of this application;

[0023] Figure 4 This is a structural diagram of an earphone provided in an embodiment of this application. Detailed Implementation

[0024] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0025] It should be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0026] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0027] It should also be further understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0028] As used in this specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrases "if determined" or "if [described condition or event] is detected" may be interpreted, depending on the context, as "once determined," "in response to determination," "once [described condition or event] is detected," or "in response to detection of [described condition or event]."

[0029] It should be understood that the sequence number of each step in this embodiment does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of this application embodiment.

[0030] To illustrate the technical solution described in this application, specific embodiments are provided below.

[0031] See Figure 1 , Figure 1 This is a flowchart of an audio signal processing method for headphones provided in an embodiment of this application. Figure 1 .

[0032] Specifically, in the audio signal processing method for headphones described in this embodiment, the headphones mentioned include a main headphone and a slave headphone, wherein the main headphone is provided with an angular motion detection device.

[0033] In practical applications, the audio signal processing method of this headset can be applied to either the left or right earpiece. That is, the main earpiece can be either the left or right earpiece.

[0034] It should be noted that, in this embodiment of the application, the distinction between the master earphone and the slave earphone is mainly that the slave earphone is the earphone that needs to be sent a synchronization command carrying the earphone angle change value by the master earphone.

[0035] like Figure 1 As shown, an audio signal processing method for headphones includes the following steps:

[0036] Step 101: The main earphone acquires the angular motion data collected by the angular motion detection device.

[0037] The angular motion detection device is specifically a gyroscope sensor.

[0038] When the headphones are worn, if the user's head moves, the angular motion detection device in the headphones will detect the angular motion data caused by the user's head movement.

[0039] Specifically, the angular motion data includes acceleration and angular velocity.

[0040] In one specific implementation, before acquiring the angular motion data collected by the angular motion detection device, the method further includes:

[0041] When both the main and secondary earphones are detected to be in the wearing state, the main earphone activates the spatial audio function and enables the diagonal motion detection device.

[0042] The detection of whether the main and secondary earphones are being worn can be achieved by installing devices such as distance sensors, light sensors, temperature sensors, humidity sensors, and pressure sensors on the main and secondary earphones. These sensors can collect data on the external environment of the earphones and then determine whether the earphones are being worn.

[0043] When the system detects that the headphones are being worn in both ears and playing audio, the spatial audio function is enabled; when worn in only one ear, it is disabled.

[0044] That is, when it is determined that both the main earphone and the slave earphone are in the earphone wearing state, the spatial audio function is activated. At this time, the angular motion detection device in the main earphone is enabled to realize the real-time acquisition of earphone angle data.

[0045] Step 102: When the headphone angle change value is determined to be within a set range based on the angular motion data, the acquired audio to be played is processed using a spatial audio algorithm according to the headphone angle change value to obtain the first channel audio, and a synchronization command carrying the headphone angle change value is sent to the slave headphone.

[0046] The synchronization command is used to instruct the earphone to process the acquired audio to be played using a spatial audio algorithm based on the change value of the earphone angle to obtain the second channel audio.

[0047] The headphone angle change value can be determined by two adjacent angular motion data collected by the angular motion detection device, or it can be the cumulative angle change value determined by several angular motion data collected by the angular motion detection device.

[0048] When the headphone angle change value is determined to be within the set range, it is considered that the audio output data of the audio to be played needs to be adjusted based on the headphone angle information to achieve the playback effect of spatial audio technology.

[0049] Specifically, the main earphone needs to use a spatial audio algorithm to process the acquired audio to be played based on the change value of the earphone angle to obtain the first channel audio.

[0050] The spatial audio algorithm is, for example, the HRTF algorithm. Specifically, the audio to be processed and the headphone angle change value are used as inputs to the HRTF algorithm. The HRTF algorithm is used to convert stereo sound effects into audio with spatial sound effects, realizing local audio processing operations at the headphone end, and finally outputting the audio to the main headphone playback component for output.

[0051] Simultaneously, the main earphone needs to share the earphone angle change value with the slave earphone, so that the slave earphone can process the audio to be played locally based on the earphone angle change value using a spatial audio algorithm to obtain the second channel audio, and output the second channel audio to the slave earphone playback component for output.

[0052] The above processing method ensures that the headphone angle change value can be obtained without installing an angular motion detection device in the headphones. It also ensures that the two headphones can synchronously process the audio to be played based on the headphone angle change value to obtain the corresponding channel audio, thus achieving the effect of binaural spatial audio processing in the headphones.

[0053] In this process, while ensuring that at least one earphone contains an angular motion detection device, the method of transmitting angular data from one earphone to the other earphone is adopted to improve data acquisition efficiency and save costs.

[0054] Furthermore, in an optional implementation, the angular motion detection device is not installed in the earphone, but only in the main earphone, in order to save costs and reduce energy consumption.

[0055] Specifically, when the main earphone is the left earphone and the secondary earphone is the right earphone, the first channel audio is the left channel audio and the second channel audio is the right channel audio; when the main earphone is the right earphone and the secondary earphone is the left earphone, the first channel audio is the right channel audio and the second channel audio is the left channel audio.

[0056] After receiving the stereo audio transmitted from the mobile phone, the master and slave headphones process the stereo audio data locally using a spatial audio algorithm, and output a mono channel with spatial sound effects to the speaker output.

[0057] This process places the sound effect algorithm and the data of the audio to be played on the earphone. The main earphone performs the acquisition of angle transformation data and shares the angle data with the slave earphone. The spatial sound effect processing of both the main and slave earphones is done locally on the earphones, without relying on the mobile phone. At the same time, it avoids real-time data interaction with the mobile phone, avoids sound effect latency, reduces the impact of data communication, and improves the versatility of the application.

[0058] In one embodiment, before determining that the headphone angle change value is within a set range based on the angular motion data, and processing the acquired audio to be played using a spatial audio algorithm based on the headphone angle change value to obtain the first channel audio, the method further includes:

[0059] Establish a wireless communication connection with the mobile terminal;

[0060] The audio to be played is acquired by the mobile terminal through the wireless communication connection.

[0061] That is, the audio to be played in the headphones is transmitted from the mobile terminal.

[0062] The wireless communication connection can be, for example, a Bluetooth connection or a Wi-Fi direct connection. The mobile terminal can be, for example, a mobile phone, a tablet computer, or a portable music player.

[0063] In other embodiments, the audio to be played in the headphones may also come from a non-removable terminal or from the headphones themselves. The audio to be played may be audio pre-stored in the headphones or audio acquired by the headphones in real time.

[0064] Further, optionally, the aforementioned sending of a synchronization command carrying the headphone angle change value to the slave headphone includes:

[0065] A synchronization command carrying the headphone angle change value is sent to the slave headphone via a wireless communication connection.

[0066] Similarly, the wireless communication connection can be, for example, a Bluetooth connection or a Wi-Fi Direct connection.

[0067] When the earphones are TWS (True Wireless Stereo) earphones, the connection between the master earphone and the slave earphone is via Bluetooth.

[0068] Step 103: Output the first channel audio to the main headphone playback component.

[0069] Specifically, the playback component is a speaker.

[0070] Finally, after performing spatial sound effect processing on the audio to be played locally on the headphones, the audio can be directly output through the playback component in the headphones.

[0071] In this embodiment, the main earphone acquires angular motion data collected by the angular motion detection device. When the angular motion data determines that the earphone angle change value is within a set range, the main earphone processes the acquired audio to be played locally using a spatial audio algorithm based on the earphone angle change value to obtain the first channel audio. The first channel audio is then output to the main earphone playback component. The earphone angle change value is also sent to the slave earphone, which processes the audio to be played locally using a spatial audio algorithm based on the earphone angle change value to obtain the second channel audio. The second channel audio is then output to the slave earphone playback component. The sound effect algorithm and the audio data to be played are placed at the earphone end. The main earphone performs the acquisition of angle change data and the sharing of angle data with the slave earphone. The spatial sound effect processing of both the main and slave earphones is done locally on the earphones, without relying on the mobile phone. This avoids real-time data interaction with the mobile phone, avoids sound effect latency, reduces the impact of data communication, and improves the applicability.

[0072] This application also provides different implementations of the audio signal processing method for headphones.

[0073] See Figure 2 , Figure 2 This is a flowchart of an audio signal processing method for headphones provided in an embodiment of this application. Figure 2 .

[0074] Similarly, in the audio signal processing method for headphones described in this embodiment, the headphones mentioned include a main headphone and a slave headphone, wherein the main headphone is provided with an angular motion detection device.

[0075] In practical applications, the audio signal processing method of this headset is specifically applied to the main earpiece. The main earpiece can be either the left or right earpiece.

[0076] like Figure 2 As shown, an audio signal processing method for headphones includes the following steps:

[0077] Step 201: The main earphone sequentially acquires angular motion data collected by the angular motion detection device at a set frequency;

[0078] Angular motion data is collected at a set frequency, for example, at a frequency of 50 Hz.

[0079] The main earphone sequentially acquires the angular motion data collected by the angular motion detection device.

[0080] Step 202: Based on the angular motion data, determine whether the cumulative change value of the headphone angle is greater than the angle threshold;

[0081] In this process, since spatial audio is applied to headphones, the changes in the sound field caused by minute angle changes are imperceptible. Therefore, this embodiment reduces the resolution of angle transmission. Specifically, angular motion data collected by the angular motion detection device is acquired according to a set frequency. Subsequent algorithm processing is only performed when the accumulated value of angle change exceeds a certain value. This reduces both data transmission and the amount of data sent to the spatial audio algorithm for audio processing.

[0082] The cumulative change value of the headphone angle can be obtained by calculating the difference between the successively acquired angular motion data and then summing them up.

[0083] Further, in one specific implementation, determining whether the cumulative change value of the headphone angle is greater than an angle threshold based on the angular motion data includes:

[0084] For each angular motion data acquired, an attitude calculation is performed based on the angular motion data to obtain the current headphone angle value;

[0085] The current headphone angle value is compared with the previous headphone angle value to obtain the angle difference;

[0086] Based on the angle difference, the cumulative change value of the headphone angle is obtained by summing them up;

[0087] Determine whether the cumulative change value of the headphone angle is greater than the angle threshold.

[0088] Specifically, the attitude calculation is performed based on angular motion data to obtain the current headphone angle value. In the implementation process, this can be done as follows:

[0089] The angular motion data includes angular velocity and acceleration. Based on these two data, combined with the relationship between angular velocity and angle, and the relationship between acceleration and angle, attitude calculation is performed to obtain the headphone angle value corresponding to each angular motion data.

[0090] In this process, the specific approach is to calculate the headphone angle from each acquired angular motion data and compare it with the previous angle value to obtain the angle difference. Only when the accumulated angle exceeds a certain value is the spatial audio algorithm called to process the acquired audio to be played. This reduces both data transmission and the amount of data sent to the spatial audio algorithm for processing.

[0091] Step 203: When the cumulative change value of the headphone angle is greater than the angle threshold, determine that the change value of the headphone angle is within the set range;

[0092] Step 204: Based on the change value of the headphone angle, the obtained audio to be played is processed using a spatial audio algorithm to obtain the first channel audio, and a synchronization command carrying the change value of the headphone angle is sent to the slave headphone.

[0093] The synchronization command is used to instruct the earphone to process the acquired audio to be played based on the earphone angle change value using a spatial audio algorithm to obtain the second channel audio.

[0094] The implementation process of this step is the same as that of step 102 in the aforementioned embodiments, and will not be repeated here.

[0095] Step 205: Output the first channel audio to the main headphone playback component.

[0096] The implementation process of this step is the same as that of step 103 in the aforementioned embodiments, and will not be repeated here.

[0097] In this embodiment, the main earphone acquires angular motion data collected by the angular motion detection device. When the angular motion data determines that the earphone angle change value is within a set range, the main earphone processes the acquired audio to be played locally using a spatial audio algorithm based on the earphone angle change value to obtain the first channel audio. The first channel audio is then output to the main earphone playback component. The earphone angle change value is also sent to the slave earphone, which processes the audio to be played locally using a spatial audio algorithm based on the earphone angle change value to obtain the second channel audio. The second channel audio is then output to the slave earphone playback component. The sound effect algorithm and the audio data to be played are placed at the earphone end. The main earphone performs the acquisition of angle change data and the sharing of angle data with the slave earphone. The spatial sound effect processing of both the main and slave earphones is performed locally on the earphones, without relying on the mobile phone. This avoids real-time data interaction with the mobile phone, reduces the amount of data transmitted to the spatial audio algorithm for audio processing, avoids sound effect latency, and improves the versatility of the application.

[0098] See Figure 3 , Figure 3 This is a structural diagram of an audio signal processing device for headphones provided in an embodiment of this application. For ease of explanation, only the parts related to the embodiment of this application are shown.

[0099] The earphones include a main earphone and a slave earphone, with the main earphone equipped with an angular motion detection device.

[0100] The audio signal processing device 300 of the headphones includes:

[0101] Data acquisition module 301 is used to acquire angular motion data collected by the angular motion detection device;

[0102] The data processing module 302 is used to, when the change value of the headphone angle is determined to be within a set range based on the angular motion data, process the acquired audio to be played using a spatial audio algorithm to obtain the first channel audio based on the change value of the headphone angle, and send a synchronization command carrying the change value of the headphone angle to the slave headphone; wherein, the synchronization command is used to instruct the slave headphone to process the acquired audio to be played using a spatial audio algorithm based on the change value of the headphone angle to obtain the second channel audio;

[0103] The audio output module 303 is used to output the first channel audio to the main headphone playback component.

[0104] The data acquisition module 301 is specifically used for:

[0105] The angular motion data collected by the angular motion detection device at a set frequency are acquired sequentially.

[0106] The step of determining that the headphone angle change value is within a set range based on the angular motion data includes:

[0107] Based on the angular motion data, determine whether the cumulative change value of the headphone angle is greater than the angle threshold.

[0108] When the cumulative change value of the headphone angle is greater than the angle threshold, it is determined that the change value of the headphone angle is within the set range.

[0109] The data acquisition module 301 is more specifically used for:

[0110] For each angular motion data acquired, an attitude calculation is performed based on the angular motion data to obtain the current headphone angle value;

[0111] The current headphone angle value is compared with the previous headphone angle value to obtain the angle difference;

[0112] Based on the angle difference, the cumulative change value of the headphone angle is obtained by summing them up;

[0113] Determine whether the cumulative change value of the headphone angle is greater than the angle threshold.

[0114] The device also includes:

[0115] The status adjustment module is used to enable the spatial audio function of the main earphone and enable the angular motion detection device when it is detected that both the main earphone and the slave earphone are in the earphone wearing state.

[0116] The device also includes:

[0117] Data transmission module, used for:

[0118] Establish a wireless communication connection with the mobile terminal;

[0119] The audio to be played is acquired by the mobile terminal through the wireless communication connection.

[0120] Specifically, the data processing module is used for:

[0121] A synchronization command carrying the headphone angle change value is sent to the slave headphone via a wireless communication connection.

[0122] The audio signal processing device for headphones provided in this application embodiment can implement the various processes of the above-described audio signal processing method for headphones embodiment and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0123] Figure 4 This is a structural diagram of an earphone provided in an embodiment of this application. As shown in the figure, the earphone 4 of this embodiment includes: at least one processor 40 ( Figure 4 (Only one is shown in the diagram), memory 41, and computer program 42 stored in said memory 41 and executable on said at least one processor 40, which, when executed, implements the steps in any of the above method embodiments.

[0124] Those skilled in the art will understand that Figure 4 This is merely an example of headphone 4 and does not constitute a limitation on headphone 4. It may include more or fewer components than shown, or combine certain components, or different components. For example, the headphone may also include input / output devices, network access devices, buses, etc.

[0125] The processor 40 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0126] The memory 41 can be an internal storage unit of the earphone 4, such as a hard drive or memory of the earphone 4. The memory 41 can also be an external storage device of the earphone 4, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the earphone 4. Furthermore, the memory 41 can include both internal storage units and external storage devices of the earphone 4. The memory 41 is used to store the computer program and other programs and data required by the earphone. The memory 41 can also be used to temporarily store data that has been output or will be output.

[0127] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0128] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0129] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0130] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0131] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0132] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0133] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electrical carrier signals and telecommunication signals.

[0134] The methods described in this application can be implemented in whole or in part by a computer program product. When the computer program product is run on the headphones, the headphones execute the steps described in the various method embodiments.

[0135] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. An audio signal processing method for headphones, characterized in that, The earphone includes a main earphone and a slave earphone. The main earphone is equipped with an angular motion detection device, while the slave earphone is not equipped with an angular motion detection device. The method is executed by the main earphone, and the method includes: When it is detected that both the main earphone and the slave earphone are in the earphone wearing state, the main earphone activates the spatial audio function and enables the angular motion detection device; The main earphone sequentially acquires angular motion data collected by the angular motion detection device at a set frequency; For each angular motion data acquired, an attitude calculation is performed based on the angular motion data to obtain the current headphone angle value; The current headphone angle value is compared with the previous headphone angle value to obtain the angle difference; Based on the angle difference, the cumulative change value of the headphone angle is obtained by summing them up; Determine whether the cumulative change value of the headphone angle is greater than the angle threshold; When the cumulative change value of the headphone angle is greater than the angle threshold, the main headphone processes the audio to be played obtained from the mobile terminal using a spatial audio algorithm based on the cumulative change value of the headphone angle to obtain the first channel audio, and sends a synchronization command carrying the cumulative change value of the headphone angle to the slave headphone. The synchronization instruction is used to instruct the earphone to process the audio to be played obtained from the mobile terminal using a spatial audio algorithm locally on the earphone based on the cumulative change value of the earphone angle to obtain the second channel audio. The first channel audio is output to the main headphone playback component.

2. The method according to claim 1, characterized in that, Before the first channel audio is obtained by processing the audio to be played from the mobile terminal using a spatial audio algorithm locally on the main earphone based on the accumulated change value of the earphone angle, the method further includes: Establish a wireless communication connection with the mobile terminal; The audio to be played is acquired by the mobile terminal through the wireless communication connection.

3. The method according to claim 1, characterized in that, Sending a synchronization command carrying the cumulative change value of the headphone angle to the slave headphone includes: A synchronization command carrying the cumulative change value of the headphone angle is sent to the slave headphone via a wireless communication connection.

4. An audio signal processing device for headphones, characterized in that, The earphones include a main earphone and a slave earphone. The main earphone is equipped with an angular motion detection device, while the slave earphone is not equipped with an angular motion detection device. The audio signal processing device corresponds to the main earphone and includes: The status adjustment module is used to control the main earphone to enable the spatial audio function and enable the angular motion detection device when it is detected that both the main earphone and the slave earphone are in the earphone wearing state. The data acquisition module is used to acquire angular motion data collected by the angular motion detection device; specifically, the data acquisition module is used to sequentially acquire angular motion data collected by the angular motion detection device at a set frequency. The data processing module is configured to: upon acquiring each angular motion data point, perform attitude calculation based on the angular motion data to obtain the current headphone angle value; compare the current headphone angle value with the previous headphone angle value to obtain an angle difference; accumulate the angle difference to obtain a cumulative change value of the headphone angle; determine whether the cumulative change value of the headphone angle is greater than an angle threshold; when the cumulative change value of the headphone angle is greater than the angle threshold, the main headphone processes the audio to be played acquired from the mobile terminal using a spatial audio algorithm locally based on the cumulative change value of the headphone angle to obtain the first channel audio, and sends a synchronization command carrying the cumulative change value of the headphone angle to the slave headphone; wherein, the synchronization command is used to instruct the slave headphone to process the audio to be played acquired from the mobile terminal using a spatial audio algorithm locally based on the cumulative change value of the headphone angle to obtain the second channel audio; The audio output module is used to output the first channel audio to the main headphone playback component.

5. A pair of headphones, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 3.

6. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 3.

Citation Information

Patent Citations

  • An apparatus, method and computer program for providing sound reproduction

    CN108028999A

  • Stereo processing method and system of earphone assembly and earphone assembly

    CN111142665A