Wearable device

Abstract

The invention discloses a wearable device, and relates to the technical field of audio playing, and the wearable device comprises a first audio playing device and a second audio playing device. The first audio playing device is worn on the head, and the second audio playing device is worn on the neck; the first audio playing device comprises a first gravity acceleration sensor and at least two loudspeakers; the second audio playing device comprises a second gravity acceleration sensor and at least two loudspeakers; the first audio playing device obtains a head posture through a first gravity acceleration sensor, and plays audio obtained by spatial audio rendering through a loudspeaker; the second audio playing device obtains a shoulder posture through a second gravity acceleration sensor; and playing the audio obtained by rendering the spatial audio through a loudspeaker. According to the wearable device, a better spatial audio effect can be realized, and the problem of insufficient individuation caused by uniform HRTF parameters can be avoided by utilizing the real auricle reflection of the use object.

Description

Technical Field

[0001] The present application relates to the field of audio playback technology, and in particular to a wearable device. Background Art

[0002] At present, there are mainly two types of headphones with stereo audio functions, one is in-ear headphones and the other is headphones. Among them, due to size limitations, in-ear headphones usually have only one generating unit, which cannot simulate the spatial sense of audio well. In addition, in-ear headphones rely on HRTF (Head-Related Transfer Function) to simulate head-shoulder reflection, auricle reflection, ILD (Interaural Level Difference, sound level difference between the two ears) and ITD (Interaural Time Difference, time difference between the two ears). However, the shape of the auricle varies from person to person, and the universal HRTF parameters cannot simulate the auricle reflection of each person well, and personalized HRTF parameters face multiple constraints such as cost. Although headphones have multiple generating units, these generating units are used for frequency division output. Headphones achieve spatial audio effects based on HRTF, but they also have the problem of not being able to simulate the auricle reflection of each person well, and personalized HRTF parameters face multiple constraints such as cost. Therefore, how to solve the above technical defects has become a technical problem that needs to be solved urgently by technicians in this field. Summary of the invention

[0003] The purpose of this application is to provide a wearable device that can achieve better spatial audio effects and can utilize the real auricle reflection of the user itself to avoid the problem of insufficient personalization caused by unified HRTF parameters.

[0004] In order to solve the above technical problems, the present application provides a wearable device, including:

[0005] A first audio playback device and a second audio playback device; the first audio playback device is worn on the head, and the second audio playback device is worn on the neck; the first audio playback device includes a first gravity acceleration sensor and at least two speakers; the second audio playback device includes a second gravity acceleration sensor and at least two speakers;

[0006] The first audio playback device is used to obtain a head posture through the first gravity acceleration sensor, and the head posture is used for spatial audio rendering; and to play the audio obtained by the spatial audio rendering through the speaker;

[0007] The second audio playback device is used to obtain the shoulder posture through the second gravity acceleration sensor; the shoulder posture is used for spatial audio rendering; and the audio obtained by the spatial audio rendering is played through a speaker.

[0008] In some embodiments, the first audio playback device is used to send the head posture to the target device, and the second audio playback device is used to send the shoulder posture to the target device, so that the target device performs spatial audio rendering on the original audio according to the head posture, the shoulder posture and the absolute coordinates of the virtual sound source.

[0009] In some embodiments, the first audio playback device is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source and the shoulder posture sent by the second audio playback device, and perform spatial audio rendering on the original audio according to the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

[0010] In some embodiments, the second audio playback device is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source and the head posture sent by the first audio playback device, and perform spatial audio rendering on the original audio according to the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

[0011] In some embodiments, the method of performing audio rendering on the original audio includes:

[0012] Extracting main audio and ambient audio from the original audio;

[0013] Obtaining relative coordinates of the virtual sound source according to the head posture, shoulder posture and absolute coordinates of the virtual sound source;

[0014] Rendering the main audio according to the relative coordinates of the virtual audio source to obtain a first main audio;

[0015] According to the relative coordinates of the virtual sound source and the position coordinates of the online loudspeaker, the first main audio is rendered using a vector-based amplitude translation algorithm to obtain a second main audio.

[0016] In some embodiments, the first audio playback device is also used to record the audio played by the speaker of the first audio playback device and the speaker of the second audio playback device one by one through the microphone of the first audio playback device, so as to determine the compensation filter parameters of the speaker one by one according to the recorded audio and the original audio of the speaker, and perform sound field compensation based on the compensation filter parameters.

[0017] In some embodiments, the first audio playback device is also used to record an audio signal through a microphone of the first audio playback device; the audio signal includes the audio played by the target speaker and the ambient noise; so as to extract the ambient noise in the audio signal and adjust the playback gain of the target speaker according to the energy level of the ambient noise.

[0018] In some embodiments, the second audio playback device further includes a bass channel speaker, so as to play low-frequency audio through the bass channel speaker.

[0019] In some embodiments, the first audio playback device is a pair of glasses with audio playback function.

[0020] In some embodiments, the second audio playback device is a neck-hanging audio playback device.

[0021] The wearable device provided in the present application includes: a first audio playback device and a second audio playback device; the first audio playback device is worn on the head, and the second audio playback device is worn on the neck; the first audio playback device includes a first gravity acceleration sensor and at least two speakers; the second audio playback device includes a second gravity acceleration sensor and at least two speakers; the first audio playback device is used to obtain the head posture through the first gravity acceleration sensor, and the head posture is used for spatial audio rendering; the audio obtained by spatial audio rendering is played through the speaker; the second audio playback device is used to obtain the shoulder posture through the second gravity acceleration sensor; the shoulder posture is used for spatial audio rendering; the audio obtained by spatial audio rendering is played through the speaker.

[0022] It can be seen that the wearable device provided by the present application includes a first audio playback device and a second audio playback device, the first audio playback device is worn on the head, the second audio playback device is worn on the neck, the first audio playback device and the second audio playback device each include at least two speakers, and the audio obtained by playing spatial audio rendering with multiple speakers of the first audio playback device and the second audio playback device can provide a better sense of spatial wrapping and achieve a better spatial audio effect. In addition, by playing audio with the speakers of the first audio playback device and the second audio playback device, the real auricle reflection of the user can be utilized, which can avoid the problem of insufficient personalization caused by the unified HRTF parameters when using HRTF to simulate auricle reflection. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the prior art and the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0024] Figure 1 A schematic diagram of a wearable device provided in an embodiment of the present application;

[0025] Figure 2 A schematic diagram of wearing a wearable device provided in an embodiment of the present application;

[0026] Figure 3 A schematic diagram of wearing another wearable device provided in an embodiment of the present application;

[0027] Figure 4 A schematic diagram of the hardware composition of a wearable device provided in an embodiment of the present application;

[0028] Figure 5 A schematic diagram of a spatial audio rendering process provided by an embodiment of the present application;

[0029] Figure 6 A schematic diagram of a flow chart of determining compensation filter parameters corresponding to a speaker provided in an embodiment of the present application;

[0030] Figure 7 A schematic diagram of a flow chart of adjusting speaker gain provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The core of this application is to provide a wearable device that can achieve better spatial audio effects and can utilize the real auricle reflection of the user itself to avoid the problem of insufficient personalization caused by unified HRTF parameters.

[0032] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0033] Please refer to Figure 1 , Figure 1 A schematic diagram of a wearable device provided in an embodiment of the present application, referring to Figure 1 As shown, the wearable device includes:

[0034] A first audio playback device 10 and a second audio playback device 20; the first audio playback device 10 is worn on the head, and the second audio playback device 20 is worn on the neck; the first audio playback device 10 includes a first gravity acceleration sensor and at least two speakers; the second audio playback device 20 includes a second gravity acceleration sensor and at least two speakers;

[0035] The first audio playback device 10 is used to obtain a head posture through the first gravity acceleration sensor, and the head posture is used for spatial audio rendering; and to play the audio obtained by the spatial audio rendering through a speaker;

[0036] The second audio playback device 20 is used to obtain the shoulder posture through the second gravity acceleration sensor; the shoulder posture is used for spatial audio rendering; and the audio obtained by the spatial audio rendering is played through a speaker.

[0037] In this embodiment, the wearable device includes a first audio playback device 10 and a second audio playback device 20. The first audio playback device 10 is worn on the head, and the first audio playback device 10 includes at least two speakers. In some embodiments, the first audio playback device 10 is a pair of glasses with an audio playback function. For example, referring to Figure 2 or Figure 3 As shown, a speaker can be respectively arranged at the position of the two temples of the glasses close to the ears, and these two speakers can be used as stereo speakers.

[0038] The second audio player 20 is worn on the neck, and the second audio player 20 includes at least two speakers. In some embodiments, the second audio player 20 is a neck-hanging audio player. For example, two speakers can be set on the neck-hanging audio player, and the two speakers are symmetrically arranged. The speakers set in the second audio player 20 can be used as surround sound speakers.

[0039] In addition, in some embodiments, the second audio playback device 20 further includes a bass channel speaker to play low-frequency audio through the bass channel speaker. Figure 2 or Figure 3 As shown, the second audio playback device 20 may be provided with a bass channel speaker.

[0040] The first audio playback device 10 also includes a first gravity acceleration sensor. The head posture of the user can be obtained through the first gravity acceleration sensor. The head posture is the coordinates of the head. The head posture is used for spatial audio rendering. The second audio playback device 20 also includes a second gravity acceleration sensor. The shoulder posture of the user can be obtained through the second gravity acceleration sensor. The shoulder posture is the coordinates of the shoulder. The shoulder posture is used for spatial audio rendering. The first audio playback device 10 and the second audio playback device 20 play the audio obtained by spatial audio rendering through their respective speakers.

[0041] In addition, the first audio playback device 10 further includes a first processor, a battery, etc. The second audio playback device 20 further includes a second processor, a battery, etc.

[0042] There are three usage modes of the first audio playback device 10 and the second audio playback device 20. The first mode is to use the first audio playback device 10 and the second audio playback device 20 at the same time. The second mode is to use only the first audio playback device 10. The third mode is to use only the second audio playback device 20. When the first audio playback device 10 and the second audio playback device 20 are used at the same time, the first audio playback device 10 and the second audio playback device 20 can be wirelessly connected, and the speakers of the two can form a surround sound speaker to play surround sound. When only the first audio playback device 10 is used, the first audio playback device 10 can be used to play stereo. When only the second audio playback device 20 is used, the second audio playback device 20 can be used to play stereo.

[0043] Spatial audio rendering can be done by the target device (for example, a mobile phone, set-top box, or other device that provides the audio stream) or by the wearable device itself.

[0044] In some embodiments, the first audio playback device 10 is used to send the head posture to the target device, and the second audio playback device 20 is used to send the shoulder posture to the target device, so that the target device performs spatial audio rendering on the original audio according to the head posture, shoulder posture and absolute coordinates of the virtual sound source.

[0045] In this embodiment, spatial audio rendering is performed by the target device. Figure 4As shown, the first audio playback device 10 and the second audio playback device 20 can be provided with Bluetooth, WIFI or Star Flash chip. The first audio playback device 10 and the second audio playback device 20 and the target device are networked via Bluetooth or WIFI or Star Flash. The first audio playback device 10 sends the obtained head posture of the user to the target device, and the second audio playback device 20 sends the obtained shoulder posture of the user to the target device. The target device performs spatial audio rendering on the original audio according to the head posture, shoulder posture and absolute coordinates of the virtual sound source, and sends the rendered audio to the first audio playback device 10 and the second audio playback device 20 for playback.

[0046] It should be noted that when both the first audio playback device 10 and the second audio playback device 20 are online, the target device forms a network with the first audio playback device 10 and the second audio playback device 20, and can obtain the head posture and shoulder posture of the user, and then the target device can perform spatial audio rendering on the original audio according to the head posture, shoulder posture and the absolute coordinates of the virtual sound source. When only one of the first audio playback device 10 and the second audio playback device 20 is online, the target device forms a network with the online audio playback device, and can obtain the posture information (the head posture or shoulder posture of the user) obtained by the online audio playback device, and then the target device can perform spatial audio rendering on the original audio according to the posture information and the absolute coordinates of the virtual sound source.

[0047] For example, only the first audio playback device 10 is online, the target device is networked with the first audio playback device 10, and the head posture obtained by the first audio playback device 10 is received, and then the target device performs spatial audio rendering on the original audio according to the head posture and the absolute coordinates of the virtual sound source. Since the second audio playback device 20 is not online, the target device cannot receive the shoulder posture. When performing spatial audio rendering, the target device may not use the shoulder posture as the basis for spatial audio rendering, or may assign a default value for the shoulder posture, use the default value as the basis for spatial audio rendering, and perform spatial audio rendering on the original audio according to the default values ​​of the head posture and the shoulder posture and the absolute coordinates of the virtual sound source.

[0048] In some embodiments, the first audio playback device 10 is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source and the shoulder posture sent by the second audio playback device 20, and perform spatial audio rendering on the original audio according to the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

[0049] In this embodiment, the spatial audio rendering is performed by the first audio playback device 10. The first audio playback device 10 receives the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the shoulder posture sent by the second audio playback device 20, and performs spatial audio rendering on the original audio according to the head posture, shoulder posture, and the absolute coordinates of the virtual sound source. The first audio playback device 10 sends the rendered audio to the second audio playback device 20, so that the second audio playback device 20 plays the audio obtained by the spatial audio rendering.

[0050] If the second audio playback device 20 is not online, the first audio playback device 10 cannot obtain the shoulder posture of the user. When performing spatial audio rendering, the first audio playback device 10 may not use the shoulder posture as the basis for spatial audio rendering, or may assign a default value for the shoulder posture and use the default value as the basis for spatial audio rendering. The first audio playback device 10 performs spatial audio rendering on the original audio according to the default values ​​of the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

[0051] In some embodiments, the second audio playback device 20 is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source and the head posture sent by the first audio playback device 10, and perform spatial audio rendering on the original audio according to the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

[0052] In this embodiment, the spatial audio rendering is performed by the second audio playback device 20. The second audio playback device 20 receives the original audio sent by the target device, the absolute coordinates of the virtual sound source, and the head posture sent by the first audio playback device 10, and performs spatial audio rendering on the original audio according to the head posture, shoulder posture, and the absolute coordinates of the virtual sound source. The second audio playback device 20 sends the rendered audio to the first audio playback device 10 so that the first audio playback device 10 plays it.

[0053] If the first audio playback device 10 is not online, the second audio playback device 20 cannot obtain the head posture of the user. When performing spatial audio rendering, the second audio playback device 20 may not use the head posture as the basis for spatial audio rendering, or may assign a default value to the head posture and use the default value as the basis for spatial audio rendering. The second audio playback device 20 performs spatial audio rendering on the original audio according to the default value of the head posture, the shoulder posture and the absolute coordinates of the virtual sound source.

[0054] When both the first audio playback device 10 and the second audio playback device 20 have spatial audio rendering functions and are online, any one of the first audio playback device 10 and the second audio playback device 20 can perform spatial audio rendering.

[0055] For example, the first processor of the first audio playback device 10 is pre-set as the main processor. When the first audio playback device 10 and the second audio playback device 20 are both online, the first audio playback device 10 and the second audio playback device 20 can form a network, and each other can know that the other party is online. The second audio playback device 20 sends the shoulder posture of the user to the first audio playback device 10, and the first audio playback device 10 performs spatial audio rendering. The first audio playback device 10 sends the rendered audio to the second audio playback device 20, and the first audio playback device 10 and the second audio playback device 20 play the audio rendered by the spatial audio.

[0056] In some embodiments, the method of performing audio rendering on the original audio includes:

[0057] Extracting main audio and ambient audio from the original audio;

[0058] Obtaining relative coordinates of the virtual sound source according to the head posture, shoulder posture and absolute coordinates of the virtual sound source;

[0059] Rendering the main audio according to the relative coordinates of the virtual audio source to obtain a first main audio;

[0060] According to the relative coordinates of the virtual sound source and the position coordinates of the online loudspeaker, the first main audio is rendered using a vector-based amplitude translation algorithm to obtain a second main audio.

[0061] This embodiment adopts a multi-level rendering structure. Figure 5 As shown, spatial audio rendering mainly includes the following steps:

[0062] S101, using PAE (Primary Ambient Extraction) algorithm to process the original audio and extract the main audio and ambient audio.

[0063] S102: Obtain the relative coordinates of the virtual sound source according to the absolute coordinates, head posture, and shoulder posture of the virtual sound source.

[0064] S103, rendering the main audio according to the relative coordinates of the virtual sound source. There are two ways to render the main audio according to the relative coordinates of the virtual sound source. One is to look up the table to obtain HRTF parameters according to the relative coordinates of the virtual sound source, and render the main audio based on the HRTF parameters. The other is to establish a mathematical model according to the relative coordinates of the virtual sound source, calculate the ILD and ITD of both ears according to the mathematical model, and render the main audio according to the ILD and ITD.

[0065] S104 , rendering the main audio rendered in S103 again by using VBAP (Vector Base Amplitude Panning), and then projecting the main audio signal with the sound source direction information to the speakers on the first audio playback device 10 and the second audio playback device 20 .

[0066] S105 , projecting the ambient audio extracted in S101 as a sound bed signal to the speakers on the first audio playback device 10 and the second audio playback device 20 .

[0067] On the basis of setting a bass channel speaker in the second audio playback device 20, a low-frequency component is further extracted from the main audio and the ambient audio extracted in S101 as bass audio, and the bass audio is projected to the bass channel speaker of the second audio playback device 20 for playback.

[0068] In some embodiments, the first audio playback device 10 is also used to record the audio played by the speaker of the first audio playback device 10 and the speaker of the second audio playback device 20 one by one through the microphone of the first audio playback device 10, so as to determine the compensation filter parameters of the speaker one by one according to the recorded audio and the original audio of the speaker, and perform sound field compensation based on the compensation filter parameters.

[0069] refer to Figure 4 As shown, the first audio playback device 10 is provided with two microphones, and any microphone can be used as a feedback microphone. In the initialization stage of the sound field calibration, the speakers of the first audio playback device 10 and the second audio playback device 20 sequentially play pre-recorded calibration audio with relatively rich full-band components. The feedback microphone records the calibration audio played by the speaker, and then obtains the compensation filter parameters of the speaker based on the sound signal recorded by the feedback microphone and the spectrum data of the original calibration audio. The compensation filter parameters are used for sound field compensation in the use stage.

[0070] The first audio playback device 10 can determine the compensation filter parameters of the speakers of the first audio playback device 10 and the second audio playback device 20 one by one according to the recorded audio and the original audio of the speakers. The first audio playback device 10 sends the determined compensation filter parameters of the speakers of the second audio playback device 20 to the second audio playback device 20, so that the second audio playback device 20 performs sound field compensation accordingly.

[0071] refer to Figure 6 As shown, the process of determining the compensation filter parameters corresponding to the speaker may include:

[0072] S201. Speaker index idx=0.

[0073] S202: The speaker corresponding to the speaker index idx plays the calibration audio.

[0074] S203: The feedback microphone on the first audio playback device 10 records an audio signal, and determines compensation filter parameters of the speaker corresponding to the speaker index idx according to the recorded audio and the original calibration audio.

[0075] S204. Speaker index idx=idx+1.

[0076] S205: Determine whether the speaker index idx is greater than or equal to the total number of online speakers. If the speaker index idx is greater than or equal to the total number of online speakers, stop, otherwise return to S202.

[0077] Each speaker has a corresponding speaker index, starting from speaker index 0. The speaker corresponding to speaker index 0 plays the calibration audio. The feedback microphone records the calibration audio, and then the compensation filter parameters of the speaker corresponding to speaker index 0 are obtained based on the sound signal recorded by the feedback microphone and the spectrum data of the original calibration audio. The compensation filter parameters are used for subsequent sound field compensation. The speaker index is increased by 1, and the speaker corresponding to speaker index 1 plays the calibration audio. The feedback microphone records the calibration audio, and then the compensation filter parameters of the speaker corresponding to speaker index 1 are obtained based on the sound signal recorded by the feedback microphone and the spectrum data of the original calibration audio. The compensation filter parameters are used for subsequent sound field compensation, and so on, until the value of the speaker index is greater than or equal to the total number of online speakers.

[0078] In some embodiments, the first audio playback device 10 is also used to record an audio signal through the microphone of the first audio playback device 10; the audio signal includes the audio played by the target speaker and the ambient noise; so as to extract the ambient noise in the audio signal and adjust the playback gain of the target speaker according to the energy level of the ambient noise.

[0079] The first audio playback device 10 may extract the environmental noise from the recorded audio signal, and the first audio playback device 10 adjusts the playback gain of the speaker on the first audio playback device 10 according to the energy level of the environmental noise. In addition, the first audio playback device 10 sends the energy level of the environmental noise to the second audio playback device 20, so that the second audio playback device 20 adjusts the playback gain of the speaker on the second audio playback device 20.

[0080] refer to Figure 7 As shown, the process of adjusting the speaker gain may include:

[0081] S301. A feedback microphone on a first audio playback device 10 records an audio signal; the audio signal includes the audio played by a speaker and ambient noise.

[0082] S302: Obtain environmental noise based on an AEC (Acoustic Echo Cancellation) algorithm.

[0083] S303: Dynamically adjust the speaker gain according to the energy level of the ambient noise.

[0084] During the use phase, the microphone on the first audio playback device 10 can be used to record audio signals. The audio signal includes the audio played by the target speaker and the ambient noise. The ambient noise is extracted from the recorded audio signal based on the AEC algorithm, and the playback gain of the target speaker is dynamically adjusted according to the energy level of the ambient noise. The audio signal recorded by the first audio playback device 10 is a near-end signal, and the audio played by the target speaker is a far-end signal. The playback gain of the speaker is positively correlated with the energy level of the ambient noise.

[0085] In summary, the wearable device provided by the present application includes a first audio playback device and a second audio playback device, the first audio playback device is worn on the head, the second audio playback device is worn on the neck, the first audio playback device and the second audio playback device each include at least two speakers, and the audio obtained by playing spatial audio rendering with multiple speakers of the first audio playback device and the second audio playback device can provide a better sense of spatial wrapping and achieve a better spatial audio effect. In addition, by playing audio with the speakers of the first audio playback device and the second audio playback device, the real auricle reflection of the user can be utilized, and the problem of insufficient personalization caused by the unified HRTF parameters when using HRTF to simulate auricle reflection can be avoided.

[0086] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0087] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0088] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0089] The above is a detailed introduction to the wearable device provided by the present application. This article uses specific examples to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the present application.

Claims

1. A wearable device, characterized in that: include: A first audio playback device and a second audio playback device; The first audio playback device is worn on the head, and the second audio playback device is worn on the neck; the first audio playback device includes a first gravity acceleration sensor and at least two speakers; the second audio playback device includes a second gravity acceleration sensor and at least two speakers; The first audio playback device is used to obtain a head posture through the first gravity acceleration sensor, and the head posture is used for spatial audio rendering; and to play the audio obtained by the spatial audio rendering through the speaker; The second audio playback device is used to obtain the shoulder posture through the second gravity acceleration sensor; The shoulder posture is used for spatial audio rendering; and the audio obtained by the spatial audio rendering is played through a speaker.

2. The wearable device according to claim 1, characterized in that: The first audio playback device is used to send the head posture to the target device, and the second audio playback device is used to send the shoulder posture to the target device, so that the target device performs spatial audio rendering on the original audio according to the head posture, the shoulder posture and the absolute coordinates of the virtual sound source.

3. The wearable device according to claim 1, characterized in that: The first audio playback device is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source and the shoulder posture sent by the second audio playback device, and perform spatial audio rendering on the original audio according to the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

4. The wearable device according to claim 1, characterized in that: The second audio playback device is used to receive the original audio sent by the target device, the absolute coordinates of the virtual sound source and the head posture sent by the first audio playback device, and perform spatial audio rendering on the original audio according to the head posture, shoulder posture and the absolute coordinates of the virtual sound source.

5. The wearable device according to any one of claims 2 to 4, characterized in that: The method of performing audio rendering on the original audio includes: Extracting main audio and ambient audio from the original audio; Obtaining relative coordinates of the virtual sound source according to the head posture, shoulder posture and absolute coordinates of the virtual sound source; Rendering the main audio according to the relative coordinates of the virtual audio source to obtain a first main audio; According to the relative coordinates of the virtual sound source and the position coordinates of the online loudspeaker, the first main audio is rendered using a vector-based amplitude translation algorithm to obtain a second main audio.

6. The wearable device according to claim 1, characterized in that: The first audio playback device is also used to record the audio played by the speaker of the first audio playback device and the speaker of the second audio playback device one by one through the microphone of the first audio playback device, so as to determine the compensation filter parameters of the speakers one by one according to the recorded audio and the original audio of the speakers, and perform sound field compensation based on the compensation filter parameters.

7. The wearable device according to claim 1, characterized in that: The first audio playback device is also used to record an audio signal through the microphone of the first audio playback device; the audio signal includes the audio played by the target speaker and the ambient noise; so as to extract the ambient noise in the audio signal and adjust the playback gain of the target speaker according to the energy level of the ambient noise.

8. The wearable device according to claim 1, characterized in that: The second audio playing device further includes a bass channel speaker, so as to play low-frequency audio through the bass channel speaker.

9. The wearable device according to claim 1, characterized in that: The first audio playing device is glasses with audio playing function.

10. The wearable device according to claim 9, characterized in that: The second audio playback device is a neck-hanging audio playback device.

Images