Head-mounted device and sound processing method and device thereof

Abstract

The present invention discloses a head-mounted device, including multiple microphones, a processor and an audio processing module, wherein: the processor is used to identify the working mode of the head-mounted device, and control the corresponding microphone to turn on according to the working mode; the audio processing module is used to process the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode. The head-mounted device in the present invention can identify the working mode of the head-mounted device through the processor, and control the corresponding microphone to turn on according to the working mode, so as to pick up the sound signal through the microphone, and the audio processing module processes the sound signal according to the audio processing method corresponding to the working mode; that is, the sound signal can be processed differently according to different working modes, so as to meet the various needs of users and help improve the user experience.

Description

Technical Field

[0001] The present invention relates to the technical field of head-mounted devices, and in particular to a head-mounted device and a sound processing method and device thereof. Background Art

[0002] With the development of technology, smart head-mounted devices are becoming more and more popular. Current smart head-mounted devices have multiple functions, such as watching videos and listening to music through head-mounted devices, but the current working modes of smart head-mounted devices are still relatively few and cannot meet users' needs for sound processing.

[0003] In view of this, how to provide a head mounted device and a sound processing method and device thereof that solve the above-mentioned technical problems has become a problem that needs to be solved by those skilled in the art. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a head mounted device and a sound processing method and device thereof, which can better meet the various needs of users during use and help improve the user experience.

[0005] To solve the above technical problems, an embodiment of the present invention provides a head mounted device, including multiple microphones, a processor and an audio processing module, wherein:

[0006] The processor is used to identify the working mode of the head mounted device and control the corresponding microphone to turn on according to the working mode;

[0007] The audio processing module is used to process the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode.

[0008] Optionally, the multiple microphones include a first microphone, a second microphone and a third microphone, the first microphone is arranged at a first position of the head mounted device, the second microphone is arranged at a second position of the head mounted device, the third microphone is arranged at a third position of the head mounted device, the first microphone, the second microphone and the third microphone are no longer on the same straight line, and the first microphone and the microphone which is closer to the second microphone and the third microphone constitute a call microphone group;

[0009] The processor is used to control the call microphone group to turn on when the working mode of the head mounted device is the call mode;

[0010] The audio processing module is used to process the sound signal picked up by the call microphone group according to the audio processing method corresponding to the call mode.

[0011] Optionally, the plurality of microphones further include a fourth microphone disposed at a fourth position of the head mounted device and a fifth microphone disposed at a fifth position of the head mounted device, and the fourth microphone and the fifth microphone are not in a straight line with the second microphone and the third microphone, and constitute a left channel pickup microphone group and a right channel pickup microphone group;

[0012] The processor is further configured to control the right channel sound pickup microphone group and the left channel sound pickup microphone group to be turned on when the working mode of the head mounted device is a left and right stereo mode;

[0013] The audio processing module is further used to process the sound signal picked up by the right channel pickup microphone group and the sound signal picked up by the right channel pickup microphone group according to the audio processing method corresponding to the left and right stereo mode.

[0014] Optionally, the second microphone and the third microphone are symmetrically distributed relative to the glasses of the head-mounted device, and the fourth microphone and the fifth microphone are symmetrically distributed relative to the glasses of the head-mounted device.

[0015] Optionally, the second microphone is located on the right side frame of the head-mounted device, the third microphone is located on the left side frame of the head-mounted glasses, the fourth microphone is set on the right temple of the head-mounted glasses, and the fifth microphone is located on the left temple of the head-mounted glasses; wherein, the second microphone and the fifth microphone constitute the right channel sound pickup microphone group, and the third microphone and the fourth microphone constitute the left channel sound pickup microphone group.

[0016] Optionally, the processor is further configured to, when the working mode of the head mounted device is a directional sound pickup mode, determine a target preset area from a pre-established correspondence between a visual direction and a preset area according to a current visual direction of the user, and control the microphone array corresponding to the target preset area to be turned on;

[0017] The audio processing module is further used to process the sound signal picked up by the microphone array according to the audio processing method corresponding to the target preset area.

[0018] Optionally, the first microphone is located in the nose wing area of ​​the lower eyeglass frame.

[0019] Optionally, the calculation relationship used in the audio processing method is determined based on a beamforming algorithm.

[0020] An embodiment of the present invention further provides a sound processing method for a head-mounted device, which is applied to a head-mounted device provided with multiple microphones, comprising:

[0021] Identify the working mode of the head mounted device and control the corresponding microphone to turn on according to the working mode;

[0022] The sound signal picked up by the microphone is processed accordingly according to the audio processing method corresponding to the working mode; wherein the corresponding relationship between the working mode and the microphone, and the corresponding relationship between the working mode and the audio processing method are established in advance.

[0023] An embodiment of the present invention further provides a sound processing device for a head-mounted device, which is applied to a head-mounted device provided with multiple microphones, comprising:

[0024] A control module, used to identify the working mode of the head mounted device and control the corresponding microphone to turn on according to the working mode;

[0025] A processing module is used to process the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode; wherein the corresponding relationship between the working mode and the microphone, and the corresponding relationship between the working mode and the audio processing method are pre-established.

[0026] The embodiment of the present invention provides a head-mounted device, including multiple microphones, a processor, and an audio processing module, wherein: the processor is used to identify the working mode of the head-mounted device, and control the corresponding microphone to turn on according to the working mode; the audio processing module is used to process the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode. It can be seen that the head-mounted device in the embodiment of the present invention can identify the working mode of the head-mounted device through the processor, and control the corresponding microphone to turn on according to the working mode, so as to pick up the sound signal through the microphone, and the audio processing module processes the sound signal according to the audio processing method corresponding to the working mode; that is, it can process the sound signal differently according to different working modes, so as to meet the various needs of users and help improve the user experience.

[0027] The embodiments of the present invention also provide a sound processing method and device for a head mounted device, which have the same beneficial effects as described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the prior art and the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0029] Figure 1 A schematic diagram of the structure of a head mounted device provided by an embodiment of the present invention;

[0030] Figure 2 A front view of a head mounted device provided by an embodiment of the present invention;

[0031] Figure 3 A bottom view of a head mounted device provided by an embodiment of the present invention;

[0032] Figure 4 A schematic diagram of beam pointing of a head mounted device in a call mode provided by an embodiment of the present invention;

[0033] Figure 5 A schematic diagram of a filter provided by an embodiment of the present invention;

[0034] Figure 6 A top view of a head mounted device provided by an embodiment of the present invention;

[0035] Figure 7 A side view of a head mounted device provided by an embodiment of the present invention;

[0036] Figure 8 A schematic diagram of beam directivity of a head mounted device in a left-right stereo mode provided by an embodiment of the present invention;

[0037] Fig. 9 A schematic diagram of dividing the visual area of ​​a head mounted device in a directional sound pickup mode provided by an embodiment of the present invention;

[0038] Fig.10 A schematic flow chart of a sound processing method for a head mounted device provided by an embodiment of the present invention;

[0039] Fig.11 A schematic diagram of the structure of a sound processing device for a head mounted device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0040] The embodiments of the present invention provide a head mounted device and a sound processing method and device thereof, which can better meet various needs of users during use and are conducive to improving the user experience.

[0041] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] Please refer to Figure 1 , Figure 1The schematic diagram of the structure of a head mounted device provided by an embodiment of the present invention. The head mounted device comprises a plurality of microphones 1, a processor 2 and an audio processing module 3, wherein:

[0043] Processor 2, used for identifying the working mode of the head mounted device and controlling the corresponding microphone 1 to turn on according to the working mode;

[0044] The audio processing module 3 is used to process the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode.

[0045] It should be noted that in the embodiments of the present invention, the correspondence between the working mode and the microphone can be predetermined, that is, the corresponding microphone works in a certain working mode, and the correspondence between the working mode and the audio processing method can be predetermined, that is, in a certain working mode, the corresponding audio processing method is used to perform corresponding processing on the sound signal picked up by the turned-on microphone.

[0046] Specifically, in the embodiment of the present invention, the working mode of the head-mounted device can be identified by the processor 2 during the use of the head-mounted device, and according to the working mode and the pre-established correspondence between the working mode and the microphone, the microphone corresponding to the working mode is controlled to be turned on, and the microphone picked up the sound signal after being turned on, and the picked up sound signal is sent to the audio processing module 3. After receiving the sound signal, the audio processing module 3 matches the corresponding audio processing method from the pre-established correspondence between the working mode and the audio processing method according to the working mode of the head-mounted device, and uses the audio processing method to perform corresponding processing on the received sound signal. The present invention can perform different processing on the sound signal picked up by the corresponding microphone according to the different working modes of the head-mounted device, thereby meeting various needs of users and helping to improve the user experience.

[0047] For further information, please refer to Figure 2 The multiple microphones in the embodiment of the present invention may include a first microphone 11, a second microphone 12 and a third microphone 13. The first microphone 11 is arranged at a first position of the head mounted device, the second microphone 12 is arranged at a second position of the head mounted device, and the third microphone 13 is arranged at a third position of the head mounted device. The first microphone 11 and the microphone which is closer to the second microphone 12 and the third microphone 13 constitute a call microphone group.

[0048] Processor 2, used for controlling the call microphone group to turn on when the working mode of the head mounted device is the call mode;

[0049] The audio processing module 3 is used to process the sound signal picked up by the call microphone group according to the audio processing method corresponding to the call mode.

[0050] Specifically, the first microphone 11 in the embodiment of the present invention may be located in the nose wing area of ​​the lower frame of the glasses, and the second microphone 12 and the third microphone 13 may be located at positions symmetrically distributed relative to the glasses of the head-mounted device. Figure 2 and Figure 3 As shown. In actual applications, the first microphone 1 can be set on the left side of the nose wing area, closer to the second microphone 12, specifically in a straight line with the second microphone 12, or can be set on the right side of the nose wing area, closer to the third microphone 13 for children, specifically in a straight line with the third microphone 13. The specific setting position can be determined according to actual needs, and the embodiment of the present invention does not make special restrictions. Specifically, a microphone that is closer to the first microphone 11 is determined from the second microphone 12 and the third microphone 13, and the first microphone 11 and the microphone form a call microphone group.

[0051] It can be understood that during the use of the head-mounted device, when the working mode of the head-mounted device is the call mode, the microphone in the call microphone group is controlled to turn on. After being turned on, the microphone picks up the sound signal and sends the sound signal to the audio processing module 3. The audio processing module 3 processes the sound signal picked up by the call microphone group according to the audio processing method corresponding to the call mode.

[0052] Specifically, Figure 4 As shown, the first microphone 11 and the second microphone 12 constitute a call microphone group. The audio processing method for the call mode can be determined in advance according to the beamforming algorithm. Specifically, the sound signal MIC1 picked up by the first microphone 11 and the sound signal MIC2 picked up by the second microphone 12 can be made into beams pointing to the surroundings. The MIC1 sound signal s1 = s(t)e jωt , MIC2 sound signal s2=s(t)e jωt e j2πdsinθ / λ , where t represents time, s(t) is the external sound signal, ω is the angular velocity, d is the distance between the first microphone 11 and the second microphone 12, and θ represents the angle of deviation from the normal of the line connecting MIC1 and MIC2, which is positive when it is biased toward MIC1 and negative when it is biased toward MIC2. The embodiment of the present invention does not specifically limit which beamforming algorithm is used in actual applications. In the embodiment of the present invention, the delayed addition of the beamforming algorithm is used as an example to illustrate. If the beam points to the vertical plane connecting the two microphones, θ is equal to 0, and the sound signal picked up by the two microphones is x=s1+s2, where x mainly includes the surrounding environmental noise and has less user voice signal components. Therefore, x can be used as a reference signal, and the sound signal s1 of the first microphone 11 is used as a voice plus noise signal. The noise component in s1 is filtered out in the form of a filter. The embodiment of the present invention does not limit the type of filter. For example, the following can be used: Figure 5 The filter y=h(s1)=s1-x shown in the figure may also use other forms of filters, such as Wiener filter, etc. The filter to be used may be determined according to the actual situation, so as to obtain the processed signal y, and send the signal y out to realize the call function.

[0053] Furthermore, the plurality of microphones in the embodiment of the present invention may further include a fourth microphone 14 and a fifth microphone 15 located on both sides of the central axis of the glasses, and the fourth microphone 14 and the fifth microphone 15 are not in a straight line with the second microphone 12 and the third microphone 13, and constitute a left channel pickup microphone group and a right channel pickup microphone group;

[0054] Processor 2 is further used to control the right channel pickup microphone group and the left channel pickup microphone group to turn on when the working mode of the head mounted device is the left and right stereo mode;

[0055] The audio processing module 3 is further used to process the sound signal picked up by the right channel pickup microphone group and the sound signal picked up by the right channel pickup microphone group according to the audio processing method corresponding to the left and right stereo mode.

[0056] Specifically, the embodiment of the present invention further includes a fourth microphone 14 and a fifth microphone 15. In order to realize the left-right stereo function, the fourth microphone 14, the fifth microphone 15, the second microphone 12, and the third microphone 13 are not in a straight line. Specifically, the fourth microphone 14 and the fifth microphone 15 in the embodiment of the present invention are symmetrically distributed relative to the glasses of the head-mounted device, and as shown in FIG. Figure 6 and Figure 7 As shown, in the embodiment of the present invention, the second microphone 12 is located on the right eyeglass frame of the head-mounted device, the third microphone 13 is located on the left eyeglass frame of the head-mounted glasses, the fourth microphone 14 is arranged on the right temple of the head-mounted glasses, and the fifth microphone 15 is located on the left temple of the head-mounted glasses; wherein, Figure 8 As shown, the second microphone 12 and the fifth microphone 15 constitute a right channel sound pickup microphone group, and the third microphone 13 and the fourth microphone 14 constitute a left channel sound pickup microphone group.

[0057] It should be noted that the second microphone 12 and the fifth microphone 15 in the embodiment of the present invention constitute a right channel pickup microphone group for picking up the right channel, and the third microphone 13 and the fourth microphone 14 constitute a left channel pickup microphone group for picking up the left channel. The embodiment of the present invention takes the left channel as an example for detailed description, wherein the third microphone 13 and the fourth microphone 14 form an array, the third microphone is the main MIC, the fourth microphone is the auxiliary MIC, the array points to the end of the third microphone 13, and the sound signal of the third microphone 13 is s3=s(t)e jωt, the sound signal of the fourth microphone 14 is s4=s(t)e jωt e j2πdsinθ / λ , pointing to the third microphone 13 means θ = -90°, then the corresponding audio processing method can be that the processed left channel signal is xl = s3 + s4e jω(t-2πd / λ) Similarly, the right channel sound signal is xr=s2+s5e jω(t-2πd / λ) .

[0058] Specifically, in actual applications, when the processor 2 recognizes that the headset is in the left-right stereo mode, the processor 2 controls the right-channel pickup microphone group and the left-channel pickup microphone group to be turned on according to the pre-designed right-channel pickup microphone group and the left-channel pickup microphone group corresponding to the left-right stereo mode. After being turned on, the right-channel pickup microphone group and the left-channel pickup microphone group respectively pick up sound signals and send the picked-up sound signals to the audio processing module 3. The audio processing module 3 determines the audio processing method for the right-channel pickup microphone group according to the audio processing method corresponding to the left-right stereo mode (that is, xr=s2+s5e jω(t-2πd / λ) ) and obtain the processed right channel sound signal according to the sound signal picked up by the right channel pickup microphone group, and determine the audio processing method for the left channel pickup microphone group (ie xl = s3 + s4e jω(t-2πd / λ) ) and obtain a processed left channel sound signal based on the sound signal picked up by the left channel pickup microphone group. The sound signal can be played to the user through a speaker, or the sound signal can be stored, which can be determined specifically according to actual conditions.

[0059] Furthermore, the processor 2 is further configured to determine a target preset area from a pre-established correspondence between a visual direction and a preset area according to a current visual direction of the user when the working mode of the head mounted device is a directional sound pickup mode, and control the microphone array corresponding to the target preset area to be turned on;

[0060] The audio processing module 3 is further used to process the sound signal picked up by the microphone array according to the audio processing method corresponding to the target preset area.

[0061] It should be noted that the head-mounted device in the embodiment of the present invention may also have a directional sound pickup mode. When the head-mounted device works in this directional sound pickup mode, the sound in a specific direction can be picked up by the corresponding microphone so that the user can better hear the sound in the direction of his interest.

[0062] Specifically, the visual area of ​​the head-mounted device (that is, the user's forward space) can be divided into multiple areas in advance to obtain multiple preset areas, each area corresponds to a different visual direction, each preset area corresponds to a group of microphone arrays, and each preset area corresponds to an audio processing method. In actual applications, the eye tracking technology can be combined to track the user's eyes and locate the user's visual direction, and then the target preset area where the visual direction is located is determined according to the correspondence between the visual direction and the preset area, and further according to the correspondence between the preset area and the microphone array, the corresponding microphone array is determined, and the microphone array is controlled to turn on. The sound signal picked up by the microphone array is sent to the audio processing module 3, and the audio processing module 3 further determines the audio processing method corresponding to the target preset area according to the correspondence between the preset area and the audio processing method, and uses the audio processing method to process the received sound signal, thereby obtaining a processed sound signal, which can be played to the user through a speaker, or stored. The specific determination can be made according to actual conditions.

[0063] For details, please refer to Fig. 9 The visual area can be pre-divided into 7 areas, each area corresponds to a group of microphone arrays, wherein the microphone array corresponding to the preset area ① is the second microphone 12 and the third microphone 13, the microphone array corresponding to the preset area ② is the second microphone 12 and the fifth microphone 15, the microphone array corresponding to the preset area ③ is the third microphone 13 and the fifth microphone 15, the microphone array corresponding to the preset area ④ is the second microphone 12, the third microphone 13, the fourth microphone 14 and the fifth microphone 15, the microphone array corresponding to the preset area ⑤ is the second microphone 12 and the fourth microphone 14, the microphone array corresponding to the preset area ⑥ is the third microphone 13 and the fourth microphone 14, and the microphone array corresponding to the preset area ⑦ is the third microphone 13 and the second microphone 12. Among them, the sound signal picked up by the second microphone 12 is s2, the sound signal picked up by the third microphone 13 is s3, the sound signal picked up by the fourth microphone 14 is s4, and the sound signal picked up by the fifth microphone 15 is s5, and the distance between the connecting line between the second microphone 12 and the third microphone 13 and the connecting line between the fourth microphone 14 and the fifth microphone 15 is d1. The signal processing method corresponding to the preset area ① can be according to To achieve this, the signal processing method corresponding to the preset area ② can be as follows To achieve this, the signal processing method corresponding to the preset area ③ can be as follows The signal processing method corresponding to the preset area ④ can be realized according to x=(s2+s3) / (s4+s5)2*e jω(t-2πd1 / λ) The signal processing method corresponding to the preset area ⑤ can be implemented as follows: The signal processing method corresponding to the preset area ⑥ can be To achieve this, the signal processing method corresponding to the preset area ⑦ can be To achieve, where d 23 and d 32 represents the distance between the second microphone 12 and the third microphone 13, d 25 represents the distance between the second microphone 12 and the fifth microphone 15, d 35 represents the distance between the third microphone 13 and the fifth microphone 15, d 24 represents the distance between the second microphone 12 and the fourth microphone 14, d 34 represents the distance between the third microphone 13 and the fourth microphone 14.

[0064] It can be seen that the head-mounted device in the embodiment of the present invention can identify the working mode of the head-mounted device through the processor, and control the corresponding microphone to turn on according to the working mode, so as to pick up the sound signal through the microphone, and the audio processing module processes the sound signal accordingly according to the audio processing method corresponding to the working mode; that is, the sound signal can be processed differently according to different working modes, thereby meeting the various needs of users and helping to improve the user experience.

[0065] The embodiment of the present invention also provides a sound processing method for a head-mounted device, which is applied to a head-mounted device with multiple microphones. Fig.10 , the method comprising:

[0066] S110: Identify the working mode of the head mounted device, and control the corresponding microphone to turn on according to the working mode;

[0067] S120: Processing the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode; wherein the corresponding relationship between the working mode and the microphone, and the corresponding relationship between the working mode and the audio processing method are pre-established.

[0068] It should be noted that an embodiment of the present invention also provides a sound processing method for a head-mounted device, which has the same beneficial effects as the head-mounted device in the above embodiment. For a specific introduction to the head-mounted device involved in the embodiment of the present invention, please refer to the above embodiment.

[0069] The embodiment of the present invention further provides a sound processing device for a head-mounted device, which is applied to a head-mounted device with multiple microphones. Fig.11 The device comprises:

[0070] The control module 21 is used to identify the working mode of the head mounted device and control the corresponding microphone to turn on according to the working mode;

[0071] The processing module 22 is used to process the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode; wherein the corresponding relationship between the working mode and the microphone, and the corresponding relationship between the working mode and the audio processing method are pre-established.

[0072] It should be noted that an embodiment of the present invention also provides a sound processing device for a head mounted device, which has the same beneficial effects as described above.

[0073] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0074] It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0075] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A head mounted device, characterized in that: It includes multiple microphones, processors and audio processing modules, including: The processor is used to identify the working mode of the head mounted device and control the corresponding microphone to turn on according to the working mode; The audio processing module is used to process the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode; wherein: The plurality of microphones include a first microphone, a second microphone and a third microphone, the first microphone is arranged at a first position of the head mounted device, the second microphone is arranged at a second position of the head mounted device, the third microphone is arranged at a third position of the head mounted device, the first microphone, the second microphone and the third microphone are not on the same straight line, and the first microphone and the microphone which is closer to the second microphone and the third microphone constitute a call microphone group; the plurality of microphones also include a fourth microphone arranged at a fourth position of the head mounted device and a fifth microphone arranged at a fifth position of the head mounted device, and the fourth microphone and the fifth microphone are not on a straight line with the second microphone and the third microphone, and constitute a left channel pickup microphone group and a right channel pickup microphone group; The processor is used to control the call microphone group to turn on when the working mode of the head-mounted device is the call mode; and is also used to control the right channel pickup microphone group and the left channel pickup microphone group to turn on when the working mode of the head-mounted device is the left and right stereo mode; The audio processing module is used to process the sound signal picked up by the call microphone group according to the audio processing method corresponding to the call mode; and is also used to process the sound signal picked up by the right channel pickup microphone group and the sound signal picked up by the right channel pickup microphone group according to the audio processing method corresponding to the left and right stereo mode.

2. The head mounted device according to claim 1, characterized in that: The second microphone and the third microphone are symmetrically distributed relative to the glasses of the head-mounted device, and the fourth microphone and the fifth microphone are symmetrically distributed relative to the glasses of the head-mounted device.

3. The head mounted device according to claim 2, characterized in that: The second microphone is located on the right side frame of the head-mounted device, the third microphone is located on the left side frame of the head-mounted glasses, the fourth microphone is set on the right temple of the head-mounted glasses, and the fifth microphone is located on the left temple of the head-mounted glasses; wherein, the second microphone and the fifth microphone constitute the right channel pickup microphone group, and the third microphone and the fourth microphone constitute the left channel pickup microphone group.

4. The head mounted device according to claim 3, characterized in that: The processor is further configured to, when the working mode of the head mounted device is a directional sound pickup mode, determine a target preset area from a pre-established correspondence between a visual direction and a preset area according to a current visual direction of the user, and control the microphone array corresponding to the target preset area to be turned on; The audio processing module is further used to process the sound signal picked up by the microphone array according to the audio processing method corresponding to the target preset area.

5. The head mounted device according to any one of claims 1 to 4, characterized in that: The first microphone is located in the nose wing area of ​​the lower eyeglass frame.

6. The head mounted device according to any one of claims 1 to 4, characterized in that: The calculation relationship used in the audio processing method is determined based on a beamforming algorithm.

7. A sound processing method for a head mounted device, characterized in that: Applicable to headsets with multiple microphones, including: Identify the working mode of the head mounted device and control the corresponding microphone to turn on according to the working mode; Processing the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode; wherein the corresponding relationship between the working mode and the microphone, and the corresponding relationship between the working mode and the audio processing method are pre-established; The plurality of microphones include a first microphone, a second microphone and a third microphone, the first microphone is arranged at a first position of the head mounted device, the second microphone is arranged at a second position of the head mounted device, the third microphone is arranged at a third position of the head mounted device, the first microphone, the second microphone and the third microphone are not on the same straight line, and the first microphone and the microphone which is closer to the second microphone and the third microphone constitute a call microphone group; the plurality of microphones also include a fourth microphone arranged at a fourth position of the head mounted device and a fifth microphone arranged at a fifth position of the head mounted device, and the fourth microphone and the fifth microphone are not on a straight line with the second microphone and the third microphone, and constitute a left channel pickup microphone group and a right channel pickup microphone group; The controlling the corresponding microphone to be turned on according to the working mode includes: when the working mode of the head-mounted device is the call mode, controlling the call microphone group to be turned on; and also controlling the right channel pickup microphone group and the left channel pickup microphone group to be turned on when the working mode of the head-mounted device is the left and right stereo mode; The corresponding processing of the sound signal picked up by the microphone according to the audio processing method corresponding to the working mode includes: processing the sound signal picked up by the call microphone group according to the audio processing method corresponding to the call mode; processing the sound signal picked up by the right channel pickup microphone group and the sound signal picked up by the right channel pickup microphone group according to the audio processing method corresponding to the left and right stereo mode.

8. A sound processing device for a head mounted device, characterized in that: The invention is applied to a head mounted device provided with a plurality of microphones, wherein the plurality of microphones include a first microphone, a second microphone and a third microphone, wherein the first microphone is arranged at a first position of the head mounted device, the second microphone is arranged at a second position of the head mounted device, and the third microphone is arranged at a third position of the head mounted device, the first microphone, the second microphone and the third microphone are not on the same straight line, and the first microphone and the microphone which is closer to the second microphone and the third microphone constitute a call microphone group; the plurality of microphones also include a fourth microphone arranged at a fourth position of the head mounted device and a fifth microphone arranged at a fifth position of the head mounted device, and the fourth microphone and the fifth microphone are not on a straight line with the second microphone and the third microphone, and constitute a left channel pickup microphone group and a right channel pickup microphone group, and the device includes: A control module, used to control the call microphone group to turn on when the working mode of the head-mounted device is the call mode; and also used to control the right channel pickup microphone group and the left channel pickup microphone group to turn on when the working mode of the head-mounted device is the left and right stereo mode; A processing module is used to process the sound signal picked up by the call microphone group according to the audio processing method corresponding to the call mode; to process the sound signal picked up by the right channel pickup microphone group and the sound signal picked up by the right channel pickup microphone group according to the audio processing method corresponding to the left and right stereo mode; wherein the correspondence between the working mode and the microphone, and the correspondence between the working mode and the audio processing method are pre-established.

Images