Audio processing method, earphone cabin, system, medium and program product

Abstract

The invention discloses an audio processing method, an earphone cabin, a system, a medium and a program product. The earphone cabin is provided with an audio acquisition module array; the earphone cabin is at least used for accommodating a target Bluetooth earphone; comprising the following steps: when a target Bluetooth earphone is in a call mode, an earphone bin collects audio of a first user in real time through an audio collection module array to obtain an audio data set; wherein the target Bluetooth earphone is connected to a first device; processing the audio data set to obtain call audio; wherein the call audio comprises spatial orientation information of the first user; and transmitting the call audio to a second device to trigger the second device to play the call audio, so that a second user associated with the second device can obtain the spatial orientation information.

Description

Technical Field

[0001] This application relates to the field of call audio processing technology, and in particular to an audio processing method, earphone compartment, system, medium and program product. Background Art

[0002] In practical applications, Bluetooth headsets are widely popular due to their portability and good audio experience. However, in call scenarios, Bluetooth headsets can only provide basic voice transmission functions and cannot meet the diverse needs of call scenarios. Summary of the Invention

[0003] Based on the above technical problems, embodiments of this application provide an audio processing method, headphone case, system, medium, and program product.

[0004] This application first provides an audio processing method applied to an earphone case, wherein the earphone case is provided with an audio acquisition module array; the earphone case is at least used to accommodate a target Bluetooth earphone; including:

[0005] When the target Bluetooth headset is in call mode, the audio of the first user is collected in real time through the audio acquisition module array to obtain an audio data set; wherein, the target Bluetooth headset is connected to the first device;

[0006] The audio data set is processed to obtain call audio, wherein the call audio includes the spatial location information of the first user;

[0007] The call audio is transmitted to the second device to trigger the second device to play the call audio, so that the second user associated with the second device can obtain the spatial location information.

[0008] This application embodiment also provides an earphone case, which includes a processor, a memory, and an audio acquisition module array; wherein, the memory stores a computer program; when the computer program is executed by the processor, it can implement the audio processing method applied to the earphone case as described above.

[0009] This application embodiment also provides an audio processing system, which includes an earphone case, a target Bluetooth earphone, a first device, and a second device as described above; wherein, the earphone case is used to house the target Bluetooth earphone; the target Bluetooth earphone is connected to the first device; and the first device and the second device are in a call state.

[0010] This application also provides a computer-readable storage medium, the storage medium including a computer program; when the computer program is executed by the processor of the headphone compartment, it can implement the audio processing method as described above.

[0011] This application also provides a computer program product, which includes a computer program; when the computer program is executed by the processor of the headphone compartment, it can implement the audio processing method as described above.

[0012] In the audio processing method provided in this application embodiment, the target Bluetooth headset is connected to the first device. When the target Bluetooth headset is in call mode, an audio data set is collected through the audio acquisition module array set in the earphone case. This not only expands the audio acquisition function of the earphone case, but also realizes precise control over the operation of the earphone case to collect the audio of the first user, and also improves the real-time performance of the audio data set. Furthermore, the audio data set is processed to obtain call audio including the spatial orientation information of the first user, thus expanding the richness of the data in the call audio and expanding the functional range of the earphone case. At the same time, the call audio is transmitted to the second device to trigger the second device to play the call audio, so that the second user associated with the second device can obtain spatial orientation information. In this way, the second device provides spatial orientation information with stereoscopic and spatial dimensions for playing the call audio, thereby providing the second user with a stereoscopic immersive call experience, and thus meeting the user's need for an immersive stereoscopic call experience. Attached Figure Description

[0013] Figure 1 A schematic flowchart illustrating the audio processing method provided in an embodiment of this application;

[0014] Figure 2 This is a schematic diagram of the structure of an audio acquisition module mounted on the outer wall of the earphone compartment, as provided in an embodiment of this application.

[0015] Figure 3 A schematic diagram illustrating the structure of a mobile phone receiving spatial audio transmitted by a headphone storage box via a Bluetooth headset, as provided in an embodiment of this application.

[0016] Figure 4 A schematic diagram illustrating the process of a mobile phone receiving and sending call audio according to an embodiment of this application;

[0017] Figure 5 A schematic diagram illustrating the principle of a second device simulating call audio transmitted from different directions via a Bluetooth headset, as provided in an embodiment of this application.

[0018] Figure 6 A schematic diagram illustrating the process of playing call audio through the receiving earpiece provided in an embodiment of this application;

[0019] Figure 7 This is a schematic diagram of the headphone case provided in an embodiment of this application;

[0020] Figure 8This is a schematic diagram of the structure of the audio processing system provided in the embodiments of this application. Detailed Implementation

[0021] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application.

[0022] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0023] Bluetooth headsets are widely popular due to their portability and good audio experience. However, in call scenarios, Bluetooth headsets can only provide basic voice transmission. One party in a call cannot perceive the location of the other party. Therefore, Bluetooth headsets cannot provide a true sense of stereo for both parties during voice calls.

[0024] Based on the above technical problems, embodiments of this application provide an audio processing method, headphone case, system, medium, and program product.

[0025] Figure 1 This is a schematic flowchart illustrating the audio processing method provided in an embodiment of this application. Figure 1 As shown, the method may include the following steps:

[0026] Step 101: When the target Bluetooth headset is in call mode, the audio of the first user is collected in real time through the audio acquisition module array to obtain an audio data set.

[0027] The audio processing method provided in this application embodiment is applied to an earphone compartment; the earphone compartment is provided with an audio acquisition module array; the earphone compartment is at least used to accommodate a target Bluetooth earphone.

[0028] The target Bluetooth headset is connected to the first device.

[0029] Accordingly, if the target Bluetooth headset is not in call mode, the audio of the first user can be collected without using the audio acquisition module.

[0030] In one embodiment, the earphone compartment may include an audio acquisition module, a communication module, a housing, a power transmission module, and an energy storage module; wherein, the audio acquisition module array may be disposed on the outer wall of the housing; the housing is used to house and store the target Bluetooth earphone; the power transmission module is disposed on the inner wall of the housing and electrically connected to the energy storage module, and is used to transmit the electrical energy stored in the energy storage module to the target Bluetooth earphone.

[0031] In one embodiment, the earphone case may include a charging case for the target Bluetooth earphone; exemplarily, the audio acquisition module array may include multiple audio acquisition modules, and the multiple audio acquisition modules may be respectively disposed on different surfaces of the outer wall of the earphone case; exemplarily, the audio acquisition module may have audio data acquisition function, for example, the audio acquisition module may include a miniature microphone.

[0032] Figure 2 This is a schematic diagram of the structure of an audio acquisition module installed on the outer wall of the earphone compartment according to an embodiment of this application. Figure 2 The outer wall of the earphone compartment 2 shown can be provided with multiple audio acquisition modules. For example, the first surface of the outer wall 201 of the earphone compartment 2 can be provided with a first audio acquisition module 202, the second surface can be provided with a second audio acquisition module 203, and the third surface can be provided with a third audio acquisition module 204. Exemplarily, other audio acquisition modules can also be provided on other surfaces corresponding to the first, second, and third surfaces respectively. It should be noted that this application does not limit the number of audio acquisition modules provided on any surface of the outer wall 201.

[0033] In one embodiment, the communication module may have Bluetooth communication functionality, through which the working status of the target Bluetooth headset can be obtained; for example, the working status may include whether the target Bluetooth headset is being worn by a first user or whether it is in call mode; for example, if the target Bluetooth headset is in call mode, it can be indicated that the audio currently being played by the target Bluetooth headset is call audio data.

[0034] In one implementation, the audio data set may include at least two audio data streams, and the at least two audio data streams may include the audio of a first user; wherein the first user may include a user wearing the target Bluetooth headset.

[0035] In one implementation, the target Bluetooth headset may include true wireless stereo (TWS) headsets.

[0036] In one implementation, the first device may establish a Bluetooth connection with the target Bluetooth headset, and the first device may include a smart terminal device, such as a smartphone or a laptop computer.

[0037] It should be noted that when the distance between the first user and the earphone case is less than or equal to the distance threshold, the amplitude of the audio data in the audio data set can be greater than or equal to the amplitude threshold; while when the distance between the first user and the earphone case is greater than the distance threshold, the amplitude of the audio data in the audio data set can be less than the amplitude threshold. Therefore, the technical solution provided in this application embodiment can be implemented when the distance between the first user and the earphone case is less than or equal to the distance threshold.

[0038] Step 102: Process the audio data set to obtain the call audio.

[0039] The call audio includes the spatial location information of the first user.

[0040] In one implementation, spatial orientation information can characterize the distance and orientation of the first user relative to the headphone energy storage device.

[0041] In one implementation, spatial orientation information can be obtained in the following way:

[0042] The acquisition time corresponding to the audio data in the audio dataset is analyzed to determine the spatial orientation information; the acquisition time can characterize the time difference between the arrival of the first user's audio at the audio acquisition module array.

[0043] In one implementation, the call audio can be determined in the following way:

[0044] The amplitudes of the audio data in the audio dataset are superimposed to obtain superimposed audio data. Then, spatial orientation information is added to the superimposed audio data to obtain the call audio.

[0045] Step 103: Transmit the call audio to the second device to trigger the second device to play the call audio, so that the second user associated with the second device can obtain spatial location information.

[0046] In one implementation, the first device and the second device may be in a call state.

[0047] In one implementation, when the target Bluetooth headset is in call mode, if the first user enables the orientation determination switch, the headset compartment can be triggered to control the audio acquisition module array to acquire the first user's audio in real time, obtain the audio dataset, merge and determine the spatial orientation information, and then process the audio dataset to obtain the call audio, and then transmit the call audio to the second device; if the first user does not enable the orientation determination switch, the headset compartment may not perform the above operations.

[0048] In one implementation, transmitting call audio to a second device can be achieved in the following way:

[0049] The earphone case transmits call audio to a first device. After receiving the call audio, the first device can perform modulation and transmission processing on the call audio, thereby transmitting the call audio to a second device.

[0050] In one implementation, the second device may be the same as or different from the first device.

[0051] In one implementation, the first user and the second user may include at least one person who is in a call.

[0052] In one embodiment, the second device and the first device may be in a voice call state or a video call state; for example, the voice call state may include a call state in which voice data is transmitted through the circuit bearer domain, and may also include a call state in which voice data is transmitted through the traffic data domain.

[0053] In one implementation, after receiving the call audio, the second device can obtain spatial orientation information from the call audio and control its decoding and playback operations based on the spatial orientation information, thereby providing a sense of stereo and space in the call audio playback state, so that the second user can obtain the spatial orientation information of the first user relative to the earphone compartment while listening to the call audio.

[0054] As can be seen from the above, in the audio processing method provided in this application embodiment, the target Bluetooth headset is connected to the first device. When the target Bluetooth headset is in call mode, the audio data set is collected through the audio acquisition module array set in the earphone case. In this way, not only is the audio acquisition function of the earphone case expanded, but also the precise control of the earphone case to collect the audio of the first user is realized, and the real-time performance of the audio data set is improved. Furthermore, the audio data set is processed to obtain call audio including the spatial orientation information of the first user. In this way, the richness of the data in the call audio is expanded, and the functional range of the earphone case is expanded. At the same time, the call audio is transmitted to the second device to trigger the second device to play the call audio, so that the second user associated with the second device can obtain spatial orientation information. In this way, the second device provides spatial orientation information with three-dimensional and spatial dimensions for playing the call audio, thereby providing the second user with a three-dimensional immersive call experience, and thus meeting the user's need for an immersive three-dimensional call experience.

[0055] Based on the foregoing embodiments, the audio processing method provided in this application, which transmits call audio to a second device, can be implemented in the following ways:

[0056] Send the call audio to the target Bluetooth headset to trigger the target Bluetooth headset to send the call audio to the first device.

[0057] The first device is used to transmit call audio to the second device.

[0058] In one implementation, a Bluetooth connection can be established between the target Bluetooth headset and the communication module of the earphone case. In this way, the earphone case can send call audio to the target Bluetooth headset through the communication module via the Bluetooth connection.

[0059] As can be seen from the above, in the audio processing method provided in this application embodiment, the earphone case sends the call audio to the target Bluetooth earphone, thereby triggering the target Bluetooth earphone to send the call audio to the first device. Thus, while maintaining the framework of voice transmission between the target Bluetooth earphone and the first device, the transmission process of call audio between the earphone case and the second device can be simplified.

[0060] Based on the foregoing embodiments, the audio processing method provided in this application, which processes the audio data set to obtain call audio, can be implemented in the following ways:

[0061] Based on spatial orientation information, the audio data in the audio dataset is processed to obtain the call audio.

[0062] In one implementation, the call audio can be obtained in the following way:

[0063] The processor in the earphone case adds the spatial orientation information to the audio data set, resulting in audio data with added spatial information. This audio data is then encoded to produce call audio.

[0064] As can be seen from the above, in the voice transmission method provided in this application embodiment, the audio data in the audio data set is processed based on spatial orientation information to obtain the call audio. Thus, through the above processing, the call audio can carry spatial orientation information, enabling it to not only carry the first user's audio but also possess spatial and stereoscopic characteristics.

[0065] Based on the foregoing embodiments, the audio processing method provided in this application, which processes audio data in an audio dataset based on spatial orientation information to obtain call audio, can be implemented in the following ways:

[0066] Based on spatial orientation information, spatial encoding is performed on the audio data in the audio dataset to obtain the call audio.

[0067] Based on the time delay difference, phase difference, and intensity difference contained in the spatial orientation information, different audio data in the audio dataset are processed to obtain the call audio.

[0068] As can be seen from the above, in the audio processing method provided in this application embodiment, the audio data in the audio data set is spatially encoded based on spatial orientation information to obtain the call audio. In this way, the call audio can carry spatial orientation information. On this basis, when the second device plays the call audio, it can simulate the orientation, distance and environmental reflection state between the first user and the earphone compartment in three-dimensional space, thereby improving the spatial immersion generated when the call audio is played at one end of the second device.

[0069] Based on the foregoing embodiments, the audio processing method provided in this application can also perform the following operations:

[0070] Determine the time delay data of at least two audio data streams in the audio dataset; determine the phase data of at least two audio data streams; and determine the spatial orientation information based on the time delay data and the phase data.

[0071] In one implementation, at least two audio data streams may carry audio characteristics of a first user; for example, the delay data may include the difference in transmission time corresponding to the at least two audio data streams respectively, that is, the delay data may include the delay difference between the at least two audio data streams; for example, the delay difference may be determined by the Time Difference of Arrival (TDOA).

[0072] In one implementation, the phase data may include the phase difference between at least two audio data streams; for example, the phase difference may include the phase difference of arrival (PDOA).

[0073] In one implementation, spatial orientation information can be determined in the following way:

[0074] Based on the time delay data, the order in which the audio acquisition module array acquires at least two audio data streams is determined. Using the aforementioned time sequence, phase data, and the distance between different audio acquisition modules, the incident angle of the first user's voice relative to the audio acquisition module array is determined, and the spatial orientation information of the first user is determined based on the incident angle.

[0075] As can be seen from the above, the audio processing method provided in this application determines the time delay data of at least two audio data in the audio data set. Thus, the time delay data can reflect the transmission time difference between at least two audio data between the first user and the headphone compartment. Furthermore, it determines the phase data of at least two audio data. Thus, the phase data can reflect the stereoscopic and spatial sense between at least two audio data. Based on this, the spatial orientation information can be determined based on the time delay data and the phase data, thereby improving the accuracy of the spatial orientation information.

[0076] Based on the foregoing embodiments, in the audio processing method provided in this application, the audio acquisition module array is disposed on different surfaces of the outer wall of the headphone compartment.

[0077] In one embodiment, at least two audio acquisition modules may be provided on any surface of the outer wall of the earphone compartment; and the number of audio acquisition modules provided on different surfaces of the outer wall of the earphone compartment may be different.

[0078] In one embodiment, the audio acquisition modules in the audio acquisition module array can be disposed on at least a portion of the surface of the outer wall of the headphone compartment.

[0079] Figure 3 This is a schematic diagram illustrating the structure of a mobile phone receiving spatial audio transmitted by a headphone case via Bluetooth headphones, as provided in an embodiment of this application. Figure 3 As shown, a first Bluetooth connection is established between the mobile phone 301 and the TWS earphone 302, and a second Bluetooth connection can also be established between the TWS earphone 302 and the earphone storage box 303; wherein, the mobile phone 301 can be the first device in the aforementioned embodiment, the TWS earphone 302 can be the target Bluetooth earphone in the aforementioned embodiment, and the earphone storage box 303 can be the earphone case in the aforementioned embodiment.

[0080] For example, when the TWS earbuds are in call mode, the microphone array on the outer wall of the earbud storage box can perform sound signal acquisition operations to obtain an audio data set. Then, spatial positioning calculations are performed on the audio data set to determine spatial orientation information. The call audio is then obtained through spatial audio encoding and sent to the left or right earbud in the TWS earbuds 302 via the wireless communication module in the earbud storage box 303. The TWS earbuds then send the call audio to the mobile phone. The microphone array can be the audio acquisition module array in the aforementioned embodiment, and the wireless communication module can be the communication module in the aforementioned embodiment.

[0081] For example, the power management charging and discharging module can manage the charging and discharging state of the energy storage module in the headphone case 303.

[0082] The above structure enables the call audio, which carries spatial orientation information and is contained within the earphone case, to be stably transmitted to the mobile phone via the TWS earphones.

[0083] As can be seen from the above, in the audio processing method provided in this application embodiment, the audio acquisition module array is arranged on different surfaces of the outer wall of the earphone compartment. In this way, the spatial stereo information carried in the audio of the first user acquired by the audio acquisition module array can be improved.

[0084] Figure 4This is a schematic diagram illustrating the process of a mobile phone receiving and sending call audio according to an embodiment of this application. Figure 4 As shown, the process may include the following steps:

[0085] Step 401: Switch the headset to call mode.

[0086] For example, if a first device such as a mobile phone connected to the headset via Bluetooth switches to a call state, the headset can switch to call mode; wherein, the headset can be the target Bluetooth headset in the aforementioned embodiments.

[0087] Step 402: Turn on the microphone power of the headphone case.

[0088] For example, the earphone case can be the earphone compartment in the foregoing embodiments; the microphone can be the audio acquisition module in the foregoing embodiments.

[0089] Step 403: The microphone collects audio signals.

[0090] For example, a microphone array can collect audio signals to obtain an audio data set.

[0091] Step 404: Positioning calculation.

[0092] For example, the spatial orientation information of the first user can be determined by calculating the phase difference and time delay difference between audio data in the audio dataset.

[0093] Step 405: Spatial audio encoding.

[0094] For example, call audio can be obtained by performing spatial audio encoding.

[0095] Step 406: Wirelessly transmit to the headphones.

[0096] For example, the earphone case can transmit call audio to the earphones via a Bluetooth connection between the case and the Bluetooth earphones.

[0097] Step 407: The headphones transmit spatial audio to the phone.

[0098] For example, spatial audio may include call audio, and the mobile phone may be the first device in the foregoing embodiments.

[0099] Step 408: The mobile phone sends the message to the receiving end.

[0100] For example, a mobile phone can send call audio to the receiving device with which it is talking, namely the second device in the aforementioned embodiments.

[0101] In one implementation, after receiving the call audio, the receiving end, i.e., the second device, can decode the call audio to obtain spatial orientation information and the audio to be played; and play the audio to be played based on the spatial orientation information through the audio output module.

[0102] In one implementation, the audio output module may include a speaker, earpiece, or headphones of a second device.

[0103] In one implementation, decoding the call audio can be achieved in the following way:

[0104] The call audio is decoded by the decoding unit in the second device to obtain spatial location information and the audio to be played.

[0105] In one implementation, playing the audio to be played can be achieved in the following way:

[0106] Based on spatial orientation information, the intensity, phase, and delay of different audio frames in the audio to be played are determined, and the audio output state of the audio output module is controlled based on the above parameters to output a speech signal with spatial sense.

[0107] In one embodiment, the audio output module of the second device includes an associated Bluetooth headset connected to the second device.

[0108] Accordingly, playing the audio to be played through the audio output module of the second device can be achieved in the following ways:

[0109] If both Bluetooth earbuds are being worn, the audio to be played is decomposed into a first audio and a second audio based on spatial orientation information; the first audio is sent to the first earbud and the second audio is sent to the second earbud to trigger the first earbud to play the first audio and the second earbud to play the second audio.

[0110] The two earphones associated with the Bluetooth headset include a first earphone and a second earphone.

[0111] Accordingly, if one of the associated Bluetooth earphones is being worn, the operation of dividing the audio to be played into a first audio and a second audio is not required.

[0112] In one implementation, dividing the audio to be played into a first audio and a second audio can be achieved in the following way:

[0113] Based on the relative positional relationship between the first user and the earphone compartment as represented by the spatial orientation information, the audio to be played is divided into a first audio and a second audio. For example, if the spatial orientation information indicates that the first user is located on the left side of the earphone compartment, the audio to be played is divided into the left channel audio corresponding to the first audio and the right channel audio corresponding to the second audio. In this case, the sound intensity of the first audio can be greater than that of the second audio. Thus, when the first audio is played through the first earphone and the second audio is played through the second earphone, the audio transmission delay and phase difference corresponding to the spatial orientation information can be simulated, so that the call user associated with the second device can feel the spatial experience effect of the call audio coming from the left side. The first earphone can be worn in the left ear of the call user, and the second earphone can be worn in the right ear of the call user.

[0114] Figure 5 This is a schematic diagram illustrating the principle of the second device provided in this application simulating call audio transmitted from different directions via a Bluetooth headset. Figure 5 As shown, both the first earphone 501 and the second earphone 502 are worn by the user 503 during the call. At the same time, based on the parameters such as the intensity, phase and delay of the left and right channels carried in the spatial orientation information, the audio to be played is divided into the first audio and the second audio, and played through the first earphone 501 and the second earphone 502 respectively, in order to simulate the spatial stereo effect of sound coming from different directions.

[0115] Figure 6 This is a schematic diagram illustrating the process of playing call audio through the receiving earpiece in an embodiment of this application. Figure 6 As shown, the process may include the following steps:

[0116] Step 601: The receiving end receives spatial audio.

[0117] For example, the receiving end may include a second device, and the spatial audio may include call audio.

[0118] Step 602: Wirelessly transmit to the headphones.

[0119] For example, the receiving end can decode the call audio to obtain the audio to be played, divide the audio to be played into a first audio and a second audio, and then transmit them to the associated Bluetooth headset respectively.

[0120] Step 603: Play voice messages with different loudness / phase / delay through the left and right speakers of the headphones.

[0121] For example, the left and right speakers of the headphones can correspond to the first and second headphones, respectively.

[0122] Through the above process, the left and right speakers of the receiving earpiece can play stereo call audio with spatial characteristics, thereby providing the caller with a stereo call experience.

[0123] In the audio processing method provided in this application embodiment, if both earpieces of the associated Bluetooth headset are being worn, the audio to be played is divided into a first audio and a second audio based on spatial orientation information. This achieves precise control over the division of the audio to be played and also enables targeted division of the audio to be played. Furthermore, the first audio is sent to the first earpiece and the second audio is sent to the second earpiece to trigger the first earpiece to play the first audio and the second earpiece to play the second audio. The two earpieces of the associated Bluetooth headset include the first earpiece and the second earpiece. Thus, through the above operations, stereo playback of the audio to be played is achieved, thereby improving the stereo effect of the call audio playback on the second device side.

[0124] Based on the foregoing embodiments, this application also provides an earphone case. Figure 7 This is a schematic diagram of the earphone case provided in an embodiment of this application, as shown below. Figure 7 As shown, the headphone compartment 7 may include a processor 701, a memory 702, and an audio acquisition module array 703; wherein, the memory 702 stores a computer program, and when the computer program is executed by the processor 701, it can implement the audio processing method applied to the headphone compartment as described above.

[0125] Specifically, the outer shell of the earphone compartment can be made of high-strength, flame-retardant engineering plastics with certain electromagnetic shielding properties, such as an alloy of polycarbonate and acrylonitrile-butadiene-styrene copolymer, to protect its internal modules and reduce electromagnetic interference; for example, the microphone in the audio acquisition module array can be a miniature electret condenser microphone to fully utilize its high sensitivity, low noise and wide frequency response characteristics; and the microphone shell can be made of metal to provide good shielding and reduce interference from external noise.

[0126] Specifically, the manufacturing process of the earphone case can include shell molding, microphone array installation, internal circuit assembly, and overall assembly.

[0127] In the shell molding process, high-precision injection molding can be used to manufacture the shell of the earphone compartment, such as the charging case. By carefully designing the mold, the dimensional accuracy and appearance quality of the shell can be improved. During the injection molding process, precise microphone mounting holes and circuit channels are reserved according to the layout requirements of the microphone array. At the same time, suitable installation positions are reserved for modules such as communication modules, processors, energy storage modules, and power transmission modules.

[0128] In terms of the microphone array installation process, multiple microphones can be fixed in preset positions inside the charging case using surface mount technology (SMT) or plug-in methods, and the connection lines between each microphone are shielded to reduce signal interference.

[0129] For the internal circuit assembly process, the processor, energy storage module, and power transmission module are soldered onto a multilayer printed circuit board (PCB) using SMT technology to form the core circuit module of the charging box. This module is then installed inside the charging box and electrically connected to the microphone array and communication module, among other related circuits. The wireless communication antenna included in the communication module can be a flexible printed antenna (FPC), which is attached to a designated location inside the charging box using a special process to minimize its impact on performance.

[0130] In terms of the overall assembly process, after completing the installation of all internal modules and wiring connections, the upper and lower outer shells of the charging case are assembled and secured using clips, screws, and other methods to improve the sealing and stability of the shells. Simultaneously, a visual inspection of the charging case is performed to ensure the microphone pickup hole is not blocked.

[0131] For example, after the overall assembly process is completed, the charging case can undergo comprehensive functional and performance testing, specifically including the following:

[0132] Test the sound collection performance of each microphone to ensure that its sensitivity, frequency response and other indicators meet the design requirements; test the spatial sound pickup effect of the microphone array, and adjust the algorithm parameters by simulating sound sources from different directions to enable accurate pickup of sound from the target direction.

[0133] To test the accuracy of the sound localization algorithm, sound sources were placed in different locations to verify whether the algorithm could accurately calculate the location of the sound sources.

[0134] Check the signal transmission and reception strength and stability of the communication module, and optimize the wireless signal quality by adjusting the antenna position and parameters.

[0135] Check the power management circuitry to ensure the charging case can charge the earphones properly and manage its own battery effectively.

[0136] This application also provides an audio processing system. Figure 8 This is a schematic diagram of the structure of the audio processing system provided in the embodiments of this application, such as... Figure 8 As shown, the audio processing system 8 includes an earphone compartment 7, a target Bluetooth earphone 801, a first device 802, and a second device 803.

[0137] The earphone compartment is used to hold the target Bluetooth earphone, which is connected to the first device, and the first device and the second device are in a call state.

[0138] Specifically, the TWS earphone shell of the target Bluetooth earphone can be made of lightweight, skin-friendly plastic, such as polyethylene terephthalate (PET) plastic coated with medical-grade silicone, to improve wearing comfort and stability; and the communication module, decoding unit and speaker components inside the earphone use high-performance, low-power chips and components to extend the earphone's battery life while meeting functional requirements; the speaker in the earphone can use a high-fidelity miniature dynamic speaker to improve the accuracy of its spatial characteristics in reproducing call audio.

[0139] Specifically, the manufacturing process of the target Bluetooth headset can include shell manufacturing, component assembly, and functional debugging.

[0140] For the shell manufacturing process, a multi-step injection molding process can be used to manufacture the earphone shell. First, the internal plastic skeleton is injection molded, and then medical-grade silicone is wrapped on the surface to form a comfortable wearing surface. In addition, during the injection molding process, space needs to be reserved for the installation of components such as communication modules, decoding units and speakers.

[0141] In the component assembly stage, electronic components such as wireless communication modules and decoding units can be soldered onto the PCB of the headphones using SMT technology, and then the PCB is installed inside the headphone shell. The speakers can be fixed in the appropriate position using glue or clips, and the audio lines can be connected. Then, the ear hooks or earplugs of the headphones can be installed to improve their wearing stability and comfort.

[0142] As for the functional debugging stage, it is mainly used to perform comprehensive functional debugging on the manufactured TWS earphones, including wireless communication function testing, decoding function testing, and speaker sound quality testing, so that the earphones can accurately receive the spatial audio signal transmitted by the charging case and clearly and accurately reproduce the spatial voice through the left and right channel speakers; at the same time, it can also test the stability and comfort of the earphones under different wearing conditions, so that users can still maintain a relatively comfortable wearing experience even after a long time.

[0143] Spatial audio technology has been applied in related technologies, including Virtual Reality (VR) and surround sound systems. However, these applications are often used for multimedia content playback rather than real-time calls. For Bluetooth headsets, due to their small size and compact structure, achieving spatial call audio functionality within their limited space presents numerous challenges and can easily lead to problems such as unreasonable microphone placement, signal processing difficulties, and power consumption control issues. In this application, the audio data acquisition and processing within the earphone charging case enables the transmission of spatial orientation information into the call audio, thereby achieving stereoscopic audio processing even during calls.

[0144] This application also provides a computer-readable storage medium including a computer program; when executed by a processor of an earphone compartment, the computer program is capable of implementing the audio processing method as described above.

[0145] This application also provides a computer program product, which includes a computer program; when executed by the processor of the headphone compartment, the computer program is capable of implementing the audio processing method as described above.

[0146] The description of the various embodiments above tends to emphasize the differences between the various embodiments. The similarities or similarities between them can be referred to, and for the sake of brevity, they will not be repeated here.

[0147] The methods disclosed in the various method embodiments provided in this application can be arbitrarily combined to obtain new method embodiments without conflict.

[0148] The features disclosed in the various product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0149] The features disclosed in the various method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0150] It should be noted that the aforementioned computer-readable storage media can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM), etc.; or it can be various electronic devices that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0151] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0152] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0153] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware nodes. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0154] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0155] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0156] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0157] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. An audio processing method applied to an earphone charging case, wherein the earphone charging case is provided with an audio acquisition module array; The earphone compartment is at least used to accommodate the target Bluetooth earphone; characterized in that... The method includes: When the target Bluetooth headset is in call mode, the audio of the first user is collected in real time through the audio acquisition module array to obtain an audio data set; wherein, the target Bluetooth headset is connected to the first device; The audio data set is processed to obtain the call audio; wherein the call audio includes the spatial location information of the first user; The call audio is transmitted to the second device to trigger the second device to play the call audio, so that the second user associated with the second device can obtain the spatial location information.

2. The method according to claim 1, characterized in that, The step of transmitting the call audio to the second device includes: The call audio is sent to the target Bluetooth headset to trigger the target Bluetooth headset to send the call audio to the first device; wherein, the first device is used to transmit the call audio to the second device.

3. The method according to claim 1, characterized in that, The process of processing the audio data set to obtain the call audio includes: Based on the spatial orientation information, the audio data in the audio data set is processed to obtain the call audio.

4. The method according to claim 3, characterized in that, The step of processing the audio data in the audio data set based on the spatial orientation information to obtain the call audio includes: Based on the spatial orientation information, the audio data in the audio data set is spatially encoded to obtain the call audio.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: Determine the time delay data of at least two audio data streams in the audio data set; Determine the phase data of the at least two audio data streams; Based on the time delay data and the phase data, the spatial orientation information is determined.

6. The method according to claim 1, characterized in that, The audio acquisition module array is disposed on different surfaces of the outer wall of the earphone compartment.

7. An earphone case, characterized in that, The earphone compartment includes a processor, a memory, and an audio acquisition module array; wherein, the memory stores a computer program; when the computer program is executed by the processor, it can implement the audio processing method as described in any one of claims 1 to 6.

8. An audio processing system, characterized in that, The audio processing system includes, as described in claim 7, an earphone case, a target Bluetooth earphone, a first device, and a second device; wherein, the earphone case is used to house the target Bluetooth earphone; the target Bluetooth earphone is connected to the first device; and the first device and the second device are in a call state.

9. A computer-readable storage medium, characterized in that, The storage medium stores a computer program; when the computer program is executed by the processor of the headphone compartment, it can implement the audio processing method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, The program product includes a computer program; when the computer program is executed by the processor of the headphone compartment, it is capable of implementing the audio processing method as described in any one of claims 1 to 6.

Images