A wearable device

Abstract

The application discloses a wearable device, and relates to the technical field of audio playing, and comprises a first audio playing device and a second audio playing device; the first audio playing device is worn on the head, and the second audio playing device is worn on the neck; the first audio playing device comprises a first gravity acceleration sensor and at least two loudspeakers; the second audio playing device comprises a second gravity acceleration sensor and at least two loudspeakers; the first audio playing device obtains the head posture through the first gravity acceleration sensor and plays audio obtained through spatial audio rendering through the loudspeakers; the second audio playing device obtains the shoulder posture through the second gravity acceleration sensor and plays audio obtained through spatial audio rendering through the loudspeakers. The wearable device can realize better spatial audio effect, and can utilize the real pinna reflection of a using object to avoid the problem of insufficient personalization caused by unified HRTF parameters.

Description

Technical Field

[0001] This application relates to the field of audio playback technology, and in particular to a wearable device. Background Technology

[0002] Currently, headphones with stereo audio capabilities mainly fall into two categories: in-ear headphones and over-ear headphones. In-ear headphones, limited by size, typically have only one driver unit, making it difficult to accurately simulate the spatial feel of audio. Furthermore, in-ear headphones rely on HRTF (Head-Related Transfer Function) to simulate head-shoulder reflections, auricular reflections, and ILD (Interaural Level Difference) and ITD (Interaural Time Difference). However, auricular shape varies from person to person, and universal HRTF parameters cannot accurately simulate the auricular reflections of each individual. Personalized HRTF parameters also face constraints such as cost. While over-ear headphones have multiple drivers, these drivers are used for crossover output. Over-ear headphones achieve spatial audio effects based on HRTF, but they also suffer from the inability to accurately simulate the auricular reflections of each individual, and personalized HRTF parameters face constraints such as cost. Therefore, addressing these technical shortcomings has become a pressing technical problem for those skilled in the art. Summary of the Invention

[0003] The purpose of this application is to provide a wearable device that can achieve better spatial audio effects and can utilize the user's own real auricular reflections to avoid the lack of personalization caused by uniform HRTF parameters.

[0004] To address the aforementioned technical problems, this application provides a wearable device, comprising:

[0005] A first audio playback device and a second audio playback device; the first audio playback device is worn on the head, and the second audio playback device is worn around the neck; the first audio playback device includes a first gravity acceleration sensor and at least two speakers; the second audio playback device includes a second gravity acceleration sensor and at least two speakers;

[0006] The first audio playback device is used to obtain head posture through the first gravity acceleration sensor, and the head posture is used for spatial audio rendering; and to play the audio obtained by spatial audio rendering through a speaker;

[0007] The second audio playback device is used to obtain the shoulder posture through the second gravity acceleration sensor; the shoulder posture is used for spatial audio rendering; and the audio obtained by spatial audio rendering is played through a speaker.

[0008] In some embodiments, the first audio playback device is used to send the head posture to the target device, and the second audio playback device is used to send the shoulder posture to the target device, so that the target device performs spatial audio rendering on the original audio based on the head posture, the shoulder posture, and the absolute coordinates of the virtual sound source.

[0009] In some embodiments, the first audio playback device is configured to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the shoulder posture sent by the second audio playback device, and perform spatial audio rendering on the original audio based on the head posture, shoulder posture, and the absolute coordinates of the virtual sound source.

[0010] In some embodiments, the second audio playback device is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the head posture sent by the first audio playback device, and to perform spatial audio rendering on the original audio based on the head posture, shoulder posture, and the absolute coordinates of the virtual sound source.

[0011] In some embodiments, the method of rendering the original audio includes:

[0012] Extract the main audio and ambient audio from the original audio;

[0013] Based on the head posture, shoulder posture, and absolute coordinates of the virtual sound source, the relative coordinates of the virtual sound source are obtained;

[0014] The main audio is rendered based on the relative coordinates of the virtual sound source to obtain the first main audio.

[0015] Based on the relative coordinates of the virtual audio source and the position coordinates of the online speaker, a vector-based amplitude translation algorithm is used to render the first main audio to obtain the second main audio.

[0016] In some embodiments, the first audio playback device is further configured to record audio played by the speakers of the first audio playback device and the second audio playback device one by one through the microphone of the first audio playback device, so as to determine the compensation filter parameters of the speakers one by one based on the recorded audio and the original audio of the speakers, and to perform sound field compensation based on the compensation filter parameters.

[0017] In some embodiments, the first audio playback device is further configured to receive an audio signal via a microphone of the first audio playback device; the audio signal includes audio played by a target speaker and ambient noise; so as to extract the ambient noise in the audio signal and adjust the playback gain of the target speaker according to the energy level of the ambient noise.

[0018] In some embodiments, the second audio playback device further includes a bass channel speaker for playing low-frequency audio through the bass channel speaker.

[0019] In some embodiments, the first audio playback device is a pair of glasses with audio playback functionality.

[0020] In some embodiments, the second audio playback device is a neckband-style audio playback device.

[0021] The wearable device provided in this application includes: a first audio playback device and a second audio playback device; the first audio playback device is worn on the head, and the second audio playback device is worn on the neck; the first audio playback device includes a first gravity acceleration sensor and at least two speakers; the second audio playback device includes a second gravity acceleration sensor and at least two speakers; the first audio playback device is used to obtain a head posture through the first gravity acceleration sensor, the head posture being used for spatial audio rendering; and to play audio rendered by spatial audio through the speakers; the second audio playback device is used to obtain a shoulder posture through the second gravity acceleration sensor, the shoulder posture being used for spatial audio rendering; and to play audio rendered by spatial audio through the speakers.

[0022] As can be seen, the wearable device provided in this application includes a first audio playback device and a second audio playback device. The first audio playback device is worn on the head, and the second audio playback device is worn around the neck. Both the first and second audio playback devices include at least two speakers. The multiple speakers of the first and second audio playback devices can play audio rendered by spatial audio, providing a better sense of spatial immersion and achieving a better spatial audio effect. Furthermore, by playing audio through the speakers of the first and second audio playback devices, the user's own real auricular reflection can be utilized, avoiding the lack of personalization caused by the uniform HRTF parameters when using HRTF to simulate auricular reflection. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the prior art and embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a schematic diagram of a wearable device provided in an embodiment of this application;

[0025] Figure 2 This is a schematic diagram of wearing a wearable device provided in an embodiment of this application;

[0026] Figure 3 This is a schematic diagram illustrating the wearing of another wearable device provided in an embodiment of this application;

[0027] Figure 4 This is a schematic diagram of the hardware composition of a wearable device provided in an embodiment of this application;

[0028] Figure 5 This is a schematic diagram of a spatial audio rendering process provided in an embodiment of this application;

[0029] Figure 6 This is a schematic flowchart illustrating a method for determining the parameters of a compensation filter corresponding to a loudspeaker, as provided in an embodiment of this application.

[0030] Figure 7 This is a schematic diagram of a process for adjusting speaker gain provided in an embodiment of this application. Detailed Implementation

[0031] The core of this application is to provide a wearable device that can achieve better spatial audio effects and can utilize the user's own real auricular reflections to avoid the lack of personalization caused by uniform HRTF parameters.

[0032] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0033] Please refer to Figure 1 , Figure 1 This is a schematic diagram of a wearable device provided in an embodiment of this application, with reference to... Figure 1 As shown, the wearable device includes:

[0034] A first audio playback device 10 and a second audio playback device 20; the first audio playback device 10 is worn on the head, and the second audio playback device 20 is worn around the neck; the first audio playback device 10 includes a first gravity acceleration sensor and at least two speakers; the second audio playback device 20 includes a second gravity acceleration sensor and at least two speakers;

[0035] The first audio playback device 10 is used to obtain head posture through the first gravity acceleration sensor, and the head posture is used for spatial audio rendering; and to play the audio obtained by spatial audio rendering through a speaker;

[0036] The second audio playback device 20 is used to obtain the shoulder posture through the second gravity acceleration sensor; the shoulder posture is used for spatial audio rendering; and the audio obtained by spatial audio rendering is played through a speaker.

[0037] In this embodiment, the wearable device includes a first audio playback device 10 and a second audio playback device 20. The first audio playback device 10 is worn on the head and includes at least two speakers. In some embodiments, the first audio playback device 10 is a pair of glasses with audio playback functionality. For example, see reference... Figure 2 or Figure 3 As shown, a speaker can be installed on each of the two temples of the glasses near the ears, and these two speakers can be used as stereo speakers.

[0038] The second audio playback device 20 is worn around the neck and includes at least two speakers. In some embodiments, the second audio playback device 20 is a neckband-style audio playback device. For example, two speakers may be symmetrically arranged on the neckband-style audio playback device. The speakers on the second audio playback device 20 can function as surround sound speakers.

[0039] Additionally, in some embodiments, the second audio playback device 20 further includes a bass channel speaker for playing low-frequency audio through the bass channel speaker. For example, see reference... Figure 2 or Figure 3 As shown, the second audio playback device 20 can be equipped with a subwoofer channel speaker.

[0040] The first audio playback device 10 also includes a first gravity accelerometer. The head pose of the user object can be obtained through the first gravity accelerometer. The head pose is the coordinate of the head. The head pose is used for spatial audio rendering. The second audio playback device 20 also includes a second gravity accelerometer. The shoulder pose of the user object can be obtained through the second gravity accelerometer. The shoulder pose is the coordinate of the shoulder. The shoulder pose is used for spatial audio rendering. The first audio playback device 10 and the second audio playback device 20 play the audio rendered by spatial audio through their respective speakers.

[0041] In addition, the first audio playback device 10 also includes a first processor, a battery, etc. The second audio playback device 20 also includes a second processor, a battery, etc.

[0042] There are three usage modes for the first audio playback device 10 and the second audio playback device 20. The first is simultaneous use of both devices. The second is using only the first audio playback device 10. The third is using only the second audio playback device 20. When using both devices simultaneously, a wireless connection can be established between them, and their speakers will form a surround sound system to play surround sound. When using only the first audio playback device 10, stereo sound can be played. When using only the second audio playback device 20, stereo sound can be played.

[0043] Spatial audio rendering can be performed by the target device (e.g., a device that provides an audio stream, such as a mobile phone or set-top box) or by the wearable device itself.

[0044] In some embodiments, the first audio playback device 10 is used to send the head posture to the target device, and the second audio playback device 20 is used to send the shoulder posture to the target device, so that the target device performs spatial audio rendering on the original audio based on the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

[0045] In this embodiment, spatial audio rendering is performed by the target device. (See reference...) Figure 4As shown, the first audio playback device 10 and the second audio playback device 20 can be configured with Bluetooth, Wi-Fi, or a StarFlash chip. The first audio playback device 10, the second audio playback device 20, and the target device network via Bluetooth, Wi-Fi, or StarFlash. The first audio playback device 10 sends the obtained head posture of the user to the target device, and the second audio playback device 20 sends the obtained shoulder posture of the user to the target device. The target device performs spatial audio rendering on the original audio based on the head posture, shoulder posture, and the absolute coordinates of the virtual sound source, and sends the rendered audio to the first audio playback device 10 and the second audio playback device 20 for playback.

[0046] It should be noted that when both the first audio playback device 10 and the second audio playback device 20 are online, the target device networks with both devices, enabling it to obtain the head and shoulder postures of the user. The target device can then perform spatial audio rendering on the original audio based on the head and shoulder postures and the absolute coordinates of the virtual sound source. When only one of the first or second audio playback devices is online, the target device networks with that online audio playback device, enabling it to obtain the posture information (head or shoulder posture of the user) from that device. The target device can then perform spatial audio rendering on the original audio based on this posture information and the absolute coordinates of the virtual sound source.

[0047] For example, if only the first audio playback device 10 is online, the target device is networked with the first audio playback device 10 and receives the head posture obtained from the first audio playback device 10. The target device then performs spatial audio rendering on the original audio based on the head posture and the absolute coordinates of the virtual sound source. Since the second audio playback device 20 is offline, the target device cannot receive the shoulder posture. Therefore, when performing spatial audio rendering, the target device can choose not to use the shoulder posture as the basis for spatial audio rendering, or it can assign a default value to the shoulder posture and use this default value as the basis for spatial audio rendering. The target device then performs spatial audio rendering on the original audio based on the default values ​​of the head posture and shoulder posture, as well as the absolute coordinates of the virtual sound source.

[0048] In some embodiments, the first audio playback device 10 is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the shoulder posture sent by the second audio playback device 20, and to perform spatial audio rendering on the original audio based on the head posture, shoulder posture, and the absolute coordinates of the virtual sound source.

[0049] In this embodiment, spatial audio rendering is performed by a first audio playback device 10. The first audio playback device 10 receives the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the shoulder posture sent by a second audio playback device 20. Based on the head posture, shoulder posture, and the absolute coordinates of the virtual sound source, the first audio playback device 10 performs spatial audio rendering on the original audio. The first audio playback device 10 then sends the rendered audio to the second audio playback device 20 so that the second audio playback device 20 can play the spatially rendered audio.

[0050] If the second audio playback device 20 is offline, the first audio playback device 10 cannot obtain the shoulder posture of the user object. When performing spatial audio rendering, the first audio playback device 10 may choose not to use the shoulder posture as the basis for spatial audio rendering, or it may assign a default value to the shoulder posture and use the default value as the basis for spatial audio rendering. The first audio playback device 10 performs spatial audio rendering on the original audio based on the default values ​​of the head posture, the shoulder posture, and the absolute coordinates of the virtual sound source.

[0051] In some embodiments, the second audio playback device 20 is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the head posture sent by the first audio playback device 10, and to perform spatial audio rendering on the original audio based on the head posture, shoulder posture, and the absolute coordinates of the virtual sound source.

[0052] In this embodiment, spatial audio rendering is performed by the second audio playback device 20. The second audio playback device 20 receives the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the head posture sent by the first audio playback device 10. Based on the head posture, shoulder posture, and absolute coordinates of the virtual sound source, the second audio playback device 20 performs spatial audio rendering on the original audio. The second audio playback device 20 then sends the rendered audio to the first audio playback device 10 for playback.

[0053] If the first audio playback device 10 is offline, the second audio playback device 20 cannot obtain the head posture of the user. When performing spatial audio rendering, the second audio playback device 20 may choose not to use the head posture as the basis for spatial audio rendering, or it may assign a default value to the head posture and use the default value as the basis for spatial audio rendering. The second audio playback device 20 performs spatial audio rendering on the original audio based on the default value of the head posture, the shoulder posture, and the absolute coordinates of the virtual sound source.

[0054] When both the first audio playback device 10 and the second audio playback device 20 have spatial audio rendering capabilities, and both are online, spatial audio rendering can be performed by either the first audio playback device 10 or the second audio playback device 20.

[0055] For example, the first processor of the first audio playback device 10 is pre-set as the main processor. When both the first audio playback device 10 and the second audio playback device 20 are online, they can network together and know each other's online status. The second audio playback device 20 sends the shoulder pose of the object to the first audio playback device 10, which then performs spatial audio rendering. The first audio playback device 10 sends the rendered audio to the second audio playback device 20, and both devices play the rendered audio.

[0056] In some embodiments, the method of rendering the original audio includes:

[0057] Extract the main audio and ambient audio from the original audio;

[0058] Based on the head posture, shoulder posture, and absolute coordinates of the virtual sound source, the relative coordinates of the virtual sound source are obtained;

[0059] The main audio is rendered based on the relative coordinates of the virtual sound source to obtain the first main audio.

[0060] Based on the relative coordinates of the virtual audio source and the position coordinates of the online speaker, a vector-based amplitude translation algorithm is used to render the first main audio to obtain the second main audio.

[0061] This embodiment employs a multi-level rendering structure, referencing... Figure 5 As shown, spatial audio rendering mainly includes the following steps:

[0062] S101. The PAE (Primary Ambient Extraction) algorithm is used to process the original audio and extract the main audio and ambient audio.

[0063] S102. Obtain the relative coordinates of the virtual sound source based on its absolute coordinates, head posture, and shoulder posture.

[0064] S103. Render the main audio based on the relative coordinates of the virtual sound source. There are two methods for rendering the main audio based on the relative coordinates of the virtual sound source: one is to look up the HRTF parameters in a table based on the relative coordinates of the virtual sound source and then render the main audio based on the HRTF parameters; the other is to establish a mathematical model based on the relative coordinates of the virtual sound source, calculate the ILD and ITD of both ears using this mathematical model, and then render the main audio based on the ILD and ITD.

[0065] S104. VBAP (Vector Base Amplitude Panning) is used to render the main audio after S103, and then the main audio signal with sound source direction information is projected onto the speakers on the first audio playback device 10 and the second audio playback device 20.

[0066] S105, The ambient audio extracted in S101 is projected as a sound bed signal onto the speakers of the first audio playback device 10 and the second audio playback device 20.

[0067] Based on the subwoofer channel speaker in the second audio playback device 20, low-frequency components are further extracted from the main audio and ambient audio extracted in S101 as subwoofer audio, and the subwoofer audio is projected onto the subwoofer channel speaker of the second audio playback device 20 for playback.

[0068] In some embodiments, the first audio playback device 10 is further configured to record, one by one, the audio played by the speaker of the first audio playback device 10 and the speaker of the second audio playback device 20 through the microphone of the first audio playback device 10, so as to determine the compensation filter parameters of the speaker one by one according to the recorded audio and the original audio of the speaker, and to perform sound field compensation based on the compensation filter parameters.

[0069] refer to Figure 4 As shown, the first audio playback device 10 is equipped with two microphones, either of which can be used as a feedback microphone. During the sound field calibration initialization phase, the speakers of the first audio playback device 10 and the second audio playback device 20 sequentially play pre-recorded calibration audio with relatively rich full-frequency components. The feedback microphone records the calibration audio played by the speaker, and then obtains the speaker's compensation filter parameters based on the spectral data of the sound signal recorded by the feedback microphone and the original calibration audio. The compensation filter parameters are used for sound field compensation during the usage phase.

[0070] Specifically, the first audio playback device 10 can determine the compensation filter parameters of the speakers of both the first audio playback device 10 and the second audio playback device 20 one by one based on the recorded audio and the original audio from the speakers. The first audio playback device 10 then sends the determined compensation filter parameters of the speakers of the second audio playback device 20 to the second audio playback device 20 so that the second audio playback device 20 can perform sound field compensation accordingly.

[0071] refer to Figure 6 As shown, the process for determining the compensation filter parameters corresponding to the loudspeaker may include:

[0072] S201, Speaker index idx=0.

[0073] S202, The speaker corresponding to the speaker index idx plays the calibration audio.

[0074] S203. The feedback microphone on the first audio playback device 10 records the audio signal and determines the compensation filter parameters of the speaker corresponding to the speaker index idx based on the recorded audio and the original calibration audio.

[0075] S204, Speaker index idx = idx + 1.

[0076] S205. Determine if the speaker index idx is greater than or equal to the total number of online speakers. If the speaker index idx is greater than or equal to the total number of online speakers, stop; otherwise, return to S202.

[0077] Each speaker has a corresponding speaker index, starting from 0. The speaker with index 0 plays the calibration audio. The feedback microphone records the calibration audio, and the compensation filter parameters for the speaker with index 0 are obtained based on the spectral data of the sound signal recorded by the feedback microphone and the original calibration audio. These compensation filter parameters are used for subsequent sound field compensation. Incrementing the speaker index by 1 causes the speaker with index 1 to play the calibration audio. The feedback microphone records the calibration audio, and the compensation filter parameters for the speaker with index 1 are obtained based on the spectral data of the sound signal recorded by the feedback microphone and the original calibration audio. These compensation filter parameters are used for subsequent sound field compensation, and so on, until the speaker index value is greater than or equal to the total number of online speakers.

[0078] In some embodiments, the first audio playback device 10 is further configured to receive an audio signal via a microphone of the first audio playback device 10; the audio signal includes audio played by a target speaker and ambient noise; so as to extract the ambient noise in the audio signal and adjust the playback gain of the target speaker according to the energy level of the ambient noise.

[0079] Specifically, the first audio playback device 10 can extract ambient noise from the recorded audio signal, and adjust the playback gain of its speakers according to the energy level of the ambient noise. Additionally, the first audio playback device 10 sends the energy level of the ambient noise to the second audio playback device 20, so that the second audio playback device 20 can adjust the playback gain of its speakers.

[0080] refer to Figure 7 As shown, the process of adjusting speaker gain may include:

[0081] S301, The feedback microphone on the first audio playback device 10 receives audio signals; the audio signals include audio played by the speaker and ambient noise.

[0082] S302. Based on the AEC (Acoustic Echo Cancellation) algorithm, the ambient noise is obtained.

[0083] S303. Dynamically adjust the speaker gain according to the energy level of the ambient noise.

[0084] During the usage phase, the microphone on the first audio playback device 10 can be used to record audio signals. These audio signals include audio played by the target speaker and ambient noise. Based on the AEC algorithm, ambient noise is extracted from the recorded audio signals, and the playback gain of the target speaker is dynamically adjusted according to the energy level of the ambient noise. The audio signal recorded by the first audio playback device 10 is a near-end signal, and the audio played by the target speaker is a far-end signal. The speaker's playback gain is positively correlated with the energy level of the ambient noise.

[0085] In summary, the wearable device provided in this application includes a first audio playback device and a second audio playback device. The first audio playback device is worn on the head, and the second audio playback device is worn around the neck. Both the first and second audio playback devices include at least two speakers. The multiple speakers of the first and second audio playback devices can play audio rendered by spatial audio, providing a better sense of spatial immersion and achieving a better spatial audio effect. Furthermore, playing audio through the speakers of the first and second audio playback devices can utilize the user's own real auricular reflection, avoiding the lack of personalization caused by the uniform HRTF parameters when simulating auricular reflection using HRTF.

[0086] The various embodiments in the specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0087] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0088] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0089] The wearable device provided in this application has been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the method and core ideas of this application. It should be noted that those skilled in the art can make several improvements and modifications to this application without departing from the principles of this application, and these improvements and modifications also fall within the protection scope of this application.

Claims

1. A wearable device, characterized in that, include: The first audio playback device and the second audio playback device; The first audio playback device is worn on the head, and the second audio playback device is worn around the neck; the first audio playback device includes a first gravity acceleration sensor and at least two speakers; the second audio playback device includes a second gravity acceleration sensor and at least two speakers. The first audio playback device is used to obtain a head posture through the first gravity acceleration sensor, and the head posture is used for spatial audio rendering; and to play audio obtained by spatial audio rendering of the original audio based on the head posture, shoulder posture and the absolute coordinates of the virtual sound source through a speaker. The second audio playback device is used to obtain the shoulder posture through the second gravity acceleration sensor; the shoulder posture is used for spatial audio rendering; and the audio obtained by spatial audio rendering of the original audio based on the head posture, shoulder posture and the absolute coordinates of the virtual sound source is played through a speaker. The methods for rendering the original audio include: Extract the main audio and ambient audio from the original audio; Based on the head posture, shoulder posture, and absolute coordinates of the virtual sound source, the relative coordinates of the virtual sound source are obtained; The main audio is rendered based on the relative coordinates of the virtual sound source to obtain the first main audio. Based on the relative coordinates of the virtual sound source and the position coordinates of the online speaker, a vector-based amplitude translation algorithm is used to render the first main audio to obtain the second main audio. The first audio playback device is further configured to record audio played by the speakers of the first audio playback device and the second audio playback device one by one through the microphone of the first audio playback device, so as to determine the compensation filter parameters of the speakers one by one based on the recorded audio and the original audio of the speakers, and to perform sound field compensation based on the compensation filter parameters.

2. The wearable device according to claim 1, characterized in that, The first audio playback device is used to send the head posture to the target device, and the second audio playback device is used to send the shoulder posture to the target device, so that the target device can perform spatial audio rendering on the original audio based on the head posture, the shoulder posture and the absolute coordinates of the virtual sound source.

3. The wearable device according to claim 2, characterized in that, The first audio playback device is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the shoulder posture sent by the second audio playback device, and to perform spatial audio rendering on the original audio based on the head posture, shoulder posture, and absolute coordinates of the virtual sound source.

4. The wearable device according to claim 2, characterized in that, The second audio playback device is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the head posture sent by the first audio playback device, and to perform spatial audio rendering on the original audio based on the head posture, shoulder posture, and the absolute coordinates of the virtual sound source.

5. The wearable device according to claim 1, characterized in that, The first audio playback device is further configured to receive audio signals via its microphone; the audio signals include audio played by a target speaker and ambient noise; in order to extract the ambient noise from the audio signals and adjust the playback gain of the target speaker according to the energy level of the ambient noise.

6. The wearable device according to claim 1, characterized in that, The second audio playback device also includes a bass channel speaker for playing low-frequency audio through the bass channel speaker.

7. The wearable device according to claim 1, characterized in that, The first audio playback device is a pair of glasses with audio playback function.

8. The wearable device according to claim 7, characterized in that, The second audio playback device is a neckband-style audio playback device.

Images