Noise reduction method and device of TWS earphone, equipment and storage medium
By acquiring multimodal signals and combining air conduction and bone conduction noise processing, the problem of insufficient noise reduction performance of TWS headphones in vibration environments is solved, effectively reducing low-frequency and high-frequency noise, and improving the wearer's experience.
Patent Information
- Application Number
- CN202510681492.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-26
- Publication Date
- 2025-07-18
AI Technical Summary
Traditional TWS headphones cannot effectively eliminate low-frequency bone conduction noise in vibrating environments, resulting in a significant decline in noise reduction performance and affecting the wearer's experience.
By obtaining multimodal signals, including air-conducting noise, bone-conducting vibration signals and attitude data, the current scene is determined, and combined with air-conducting noise and bone-conducting vibration signals for noise reduction in high vibration scenarios, covering the air-conducting and bone-conducting noise bands.
It realizes simultaneous noise reduction of low-frequency and high-frequency noise in vibrating environments, improving the noise reduction performance and wearer experience of TWS headphones.
Smart Images
Figure CN120343465A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of wireless earphones, and particularly to a noise reduction method, device, equipment and storage medium for TWS earphones. Background Art
[0002] When traditional True Wireless Stereo (TWS) earphones perform noise reduction, they usually adopt Active Noise Cancellation (ANC) technology. The ANC technology mainly collects ambient noise transmitted through air by an external microphone, generates a reverse sound wave based on this ambient noise, and then uses phase interference to achieve the noise reduction effect.
[0003] However, when the wearer's head contacts a hard surface (such as a car window, a wall, etc.), since vibrations will be directly transmitted to the inner ear through bones (i.e., the bone conduction effect), and the traditional ANC system can only cancel air-conducted noise and cannot effectively eliminate low-frequency bone-conducted noise. Especially in a vibrating environment such as a vehicle (such as a subway, an airplane), the wearer will still perceive obvious low-frequency vibration noise, resulting in a significant decrease in noise reduction performance and affecting the wearer experience.
[0004] Therefore, how to improve the adaptability of the ANC system in a vibrating environment to improve the noise reduction effect is the problem to be solved currently. Summary of the Invention
[0005] The embodiments of this application provide a noise reduction method, device, equipment and storage medium for TWS earphones. This method can improve the adaptability of the ANC system in a vibrating environment to improve the noise reduction effect and improve the auditory experience of the wearer.
[0006] In a first aspect, this application provides a noise reduction method for TWS earphones, and the method includes:
[0007] When the TWS earphones are in the active noise cancellation mode, obtain multi-modal signals, where the multi-modal signals include: air-conducted noise, bone-conducted vibration signals, and attitude data;
[0008] Based on the attitude data and the bone-conducted vibration signals, determine the current scene;
[0009] When the current scene is a high-vibration scene, perform noise reduction processing on the TWS earphones based on the air-conducted noise and the bone-conducted vibration signals.
[0010] In a possible implementation manner, the determining the current scene based on the attitude data and the bone-conducted vibration signals includes:
[0011] According to the attitude data, determine the corresponding attitude angle;
[0012] Determine whether the attitude angle is within a preset angle range;
[0013] If so, determine whether the vibration intensity of the bone conduction vibration signal is within a preset intensity range;
[0014] When the vibration intensity is within the preset intensity range, determine that the current scenario is a high vibration scenario.
[0015] In a possible implementation manner, the noise reduction processing of the TWS earphone based on the air conduction noise and the bone conduction vibration signal includes:
[0016] Determine a first noise reduction signal based on the air conduction noise;
[0017] Determine a second noise reduction signal based on the bone conduction vibration signal;
[0018] Perform phase calibration and superposition processing on the first noise reduction signal and the second noise reduction signal to obtain a target noise reduction signal;
[0019] Perform noise reduction processing based on the target noise reduction signal.
[0020] In a possible implementation manner, the multimodal signal further includes: an electromyogram signal, and the determining the second noise reduction signal based on the bone conduction vibration signal includes:
[0021] Perform baseline calibration processing on the electromyogram signal to obtain corresponding characteristic parameters;
[0022] Perform low-pass filtering processing on the bone conduction vibration signal, and perform feature extraction on the processed bone conduction vibration signal based on the characteristic parameters to obtain the second noise reduction signal.
[0023] In a possible implementation manner, the method further includes:
[0024] When the attitude angle is not within the preset angle range, or the vibration intensity is not within the preset intensity range, determine that the current scenario is a low vibration scenario.
[0025] In a possible implementation manner, the method further includes:
[0026] When the current scenario is a low vibration scenario, perform noise reduction processing on the TWS earphone based on the air conduction noise.
[0027] In a second aspect, the present application provides a noise reduction device for a TWS earphone, and the device includes:
[0028] An acquisition module, configured to acquire a multimodal signal when the TWS earphone is in an active noise reduction mode, where the multimodal signal includes: air-conducted noise, bone-conducted vibration signals, and attitude data;
[0029] A determination module, configured to determine the current scenario based on the attitude data and the bone-conducted vibration signals;
[0030] A processing module, configured to perform noise reduction processing on the TWS earphone based on the air-conducted noise and the bone-conducted vibration signals when the current scenario is a high-vibration scenario.
[0031] In a possible implementation manner, the device further includes: a judgment module;
[0032] The determination module is configured to determine the corresponding attitude angle according to the attitude data;
[0033] The judgment module is configured to judge whether the attitude angle is within a preset angle range; and in the case where the attitude angle is within the preset angle range, judge whether the vibration intensity of the bone-conducted vibration signal is within a preset intensity range;
[0034] The determination module is further configured to determine that the current scenario is a high-vibration scenario when the vibration intensity is within the preset intensity range.
[0035] In a possible implementation manner, the determination module is configured to determine a first noise reduction signal based on the air-conducted noise; and determine a second noise reduction signal based on the bone-conducted vibration signals;
[0036] The processing module is configured to perform phase calibration and superposition processing on the first noise reduction signal and the second noise reduction signal to obtain a target noise reduction signal, and perform noise reduction processing based on the target noise reduction signal.
[0037] In a possible implementation manner, the multimodal signal further includes: electromyogram signals, and the determination module is configured to perform baseline calibration processing on the electromyogram signals to obtain corresponding characteristic parameters; and perform low-pass filtering processing on the bone-conducted vibration signals, and perform feature extraction on the processed bone-conducted vibration signals based on the characteristic parameters to obtain the second noise reduction signal.
[0038] In a possible implementation manner, the determination module is further configured to determine that the current scenario is a low-vibration scenario when the attitude angle is not within the preset angle range, or the vibration intensity is not within the preset intensity range.
[0039] In a possible implementation, the processing module is further configured to perform noise reduction processing on the TWS earphones based on the air-conducted noise when the current scenario is a low-vibration scenario.
[0040] In a third aspect, the present application provides a pair of TWS earphones, including: a processor, and a memory communicatively connected to the processor;
[0041] The memory stores computer-executable instructions;
[0042] The processor executes the computer-executable instructions stored in the memory to implement the method as described in the first aspect and various possible implementations of the first aspect above.
[0043] In a fourth aspect, the present application provides a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are used to implement the method as described in the first aspect and various possible implementations of the first aspect above when executed by a processor.
[0044] In a fifth aspect, the present application provides a computer program product including a computer program, and the computer program implements the method as described in the first aspect and various possible implementations of the first aspect above when executed by a processor.
[0045] The embodiments of the present application provide a noise reduction method, device, equipment, and storage medium for a pair of TWS earphones. When the TWS earphones are in the active noise reduction mode, the method obtains multi-modal signals, and the multi-modal signals include: air-conducted noise, bone-conducted vibration signals, and attitude data; determines the current scenario based on the attitude data and the bone-conducted vibration signals; and performs noise reduction processing on the TWS earphones based on the air-conducted noise and the bone-conducted vibration signals when the current scenario is a high-vibration scenario. The method can select a corresponding noise reduction method according to the current scenario, especially in a high-vibration scenario, perform noise reduction processing based on multi-modal noise, and since it covers the air-conducted and bone-conducted noise frequency bands, it can achieve noise reduction processing for both low-frequency and high-frequency noises, improving the noise reduction performance of the TWS earphones. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] The drawings here are incorporated into the description and form a part of this description, showing embodiments consistent with the present application and used together with the description to explain the principles of the present application.
[0047] Figure 1 Schematic diagram of the hardware structure of a pair of TWS earphones provided by the embodiments of the present application Figure 1 ;
[0048] Figure 2Flow schematic of a noise reduction method for a TWS headset provided by an embodiment of the present application Figure 1 ;
[0049] Figure 3 Hardware structure schematic of a TWS headset provided by an embodiment of the present application Figure 2 ;
[0050] Figure 4 Flow schematic of a noise reduction method for a TWS headset provided by an embodiment of the present application Figure 2 ;
[0051] Figure 5 Structure schematic diagram of a noise reduction device for a TWS headset provided by an embodiment of the present application;
[0052] Figure 6 Structure schematic diagram of a TWS headset provided by an embodiment of the present application.
[0053] Through the above-mentioned drawings, specific embodiments of the present application have been shown, and there will be more detailed descriptions hereinafter. These drawings and textual descriptions are not intended to limit the scope of the concept of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. Detailed implementation manners
[0054] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the scope of protection of the present application.
[0055] In the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items with basically the same functions and effects, and do not limit their sequence. Those skilled in the art can understand that the terms "first" and "second" do not limit the quantity and execution order, and the terms "first" and "second" do not necessarily mean different.
[0056] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific manner.
[0057] The following explains the terms related to the present application.
[0058] When TWS earphones perform noise cancellation, they usually adopt Active Noise Cancellation (ANC) technology. The ANC technology mainly collects environmental noise transmitted through air by an external microphone, generates an inverse sound wave based on this environmental noise, and then uses phase interference to achieve the noise cancellation effect. However, when the wearer's head touches a hard surface (such as a car window, a wall, etc.), since vibration will be directly transmitted to the inner ear through bones (i.e., the bone conduction effect), and the traditional ANC system can only cancel air-conducted noise and cannot effectively eliminate low-frequency bone-conducted noise. Especially in a vibrating environment such as a vehicle (such as a subway, an airplane), the wearer will still perceive obvious low-frequency vibration noise, resulting in a significant decline in the noise cancellation performance and affecting the wearer's experience.
[0059] Currently, the existing technology mainly optimizes noise collection through a multi-microphone array to improve the noise cancellation effect of the ANC system. However, the existing solutions still only rely on air-conducted noise signals and fail to detect and compensate for the interference of bone-conducted noise and other physiological signals (such as heartbeat, breathing, etc.), resulting in single signal processing and being unable to meet the requirements of complex scenarios.
[0060] Therefore, there is an urgent need for a technical solution that can simultaneously detect air-conducted noise and bone-conducted noise and fuse multi-modal signals for collaborative noise cancellation to improve the adaptability of the ANC system in a vibrating environment and improve the wearer's auditory experience.
[0061] To solve the above problems, the present application provides a noise cancellation method for TWS earphones. When the TWS earphones are in the active noise cancellation mode, the current usage scenario is determined. In the case where the current usage scenario is a high-vibration scenario, noise cancellation processing is jointly performed based on the detected air-conducted noise and bone-conducted vibration signals. This method can select the corresponding noise cancellation method according to the current scenario. Especially in a high-vibration scenario, noise cancellation is performed based on multi-modal noise, covering the frequency bands of air-conducted and bone-conducted noise. Therefore, the noise cancellation performance of the TWS earphones can be improved.
[0062] The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.
[0063] First, the hardware structure of a TWS earphone provided by an embodiment of the present application will be described in detail. Figure 1 Schematic diagram of the hardware structure of a TWS earphone provided by an embodiment of the present application Figure 1 . As Figure 1As shown in the figure, the TWS earphone includes: a vibration sensor 1, an attitude sensing device 2, a microphone 3, a processing module 4, a noise reduction module 5, and an output module 6. The functions of multiple devices will be described in detail below.
[0064] Vibration sensing device 1: It is used to collect bone conduction vibration signals. It can be, for example, a vibration sensor, a voltage sensor, or an integrated sensor with vibration signal detection function. The vibration sensing device 1 can be, for example, arranged on the TWS earphone housing, specifically, for example, in the area where the housing contacts the auricle. It can be understood that the purpose of arranging the vibration sensing device 1 in the area contacting the auricle is to better detect the vibration situation in the current environment to obtain more accurate bone conduction vibration signals.
[0065] Attitude sensing device 2: It is used to detect the attitude and motion-related information of the TWS earphone wearer. It can be, for example, a gyroscope or an accelerometer and other devices with attitude detection functions. The attitude sensing device 2 can be, for example, arranged in the central area of the TWS earphone, or integrated at the central position of the TWS earphone main board, which can improve the accuracy of attitude detection.
[0066] Microphone 3: It is used to collect environmental noise.
[0067] It can be understood that the TWS earphone usually includes at least one microphone, for example, including: a feedforward microphone, a feedback microphone, and an auxiliary microphone, etc. The microphone 3 described in the embodiments of the present application can be, for example, any one of the above microphones. Since the feedforward microphone can well capture the noise in the environment, the microphone 3 is preferably a feedforward microphone.
[0068] Processing module 4: It is used to perform data analysis on the obtained bone conduction vibration signals, air conduction noises, and attitude data to determine the current scene and the noise reduction method to be adopted. At the same time, the processing module 4 can also be used to perform signal conversion on the collected signals, and generate reverse signals based on the noise signals, etc.
[0069] Noise reduction module 5: It is used to convert the reference signal sent by the processing module 4 into a reverse signal. It can be, for example, a noise reduction filter or other devices with noise reduction functions.
[0070] Output module 6: It is used to output the reverse signal to achieve the noise reduction effect.
[0071] Figure 2 It is a schematic flow of a noise reduction method for a TWS earphone provided by an embodiment of the present application Figure 1 . The hardware structure of the TWS earphone provided by the present application can be, for example, Figure 1 the hardware structure of the TWS earphone shown in the embodiment. As Figure 2As shown in the figure, a noise reduction method for TWS earphones provided by an embodiment of the present application includes:
[0072] S201. When the TWS earphones are in the active noise reduction mode, obtain multimodal signals, where the multimodal signals include: air-conducted noise, bone-conducted vibration signals, and attitude data.
[0073] Among them, air-conducted noise refers to environmental sound signals that are transmitted through the air medium and received by the earphone microphone or the human ear. For example, it can be collected by Figure 1 the microphone shown in the embodiment. Specifically: For example, air-conducted noise can be collected by the feedforward microphone on the TWS earphones.
[0074] Bone-conducted vibration signals refer to mechanical vibration signals transmitted through the human bones (such as the skull and jaw bone), rather than sound waves transmitted through the air. For example, it can be collected by Figure 1 the vibration sensing device shown in the embodiment.
[0075] Attitude data can be, for example, data such as the motion state and / or spatial orientation information of the head of the TWS earphone wearer. For example, it can be collected by Figure 1 the attitude sensing device shown in the embodiment.
[0076] It can be understood that in the scenario where a gyroscope and an accelerometer are integrated on the attitude sensing device, the attitude sensing device detecting attitude data includes: detecting the gravity direction through the accelerometer and detecting the angular velocity integration through the gyroscope, so as to obtain the attitude data of the wearer.
[0077] S202. Based on the attitude data and the bone-conducted vibration signals, determine the current scenario.
[0078] Among them, the scenario can include, for example: a high vibration scenario and a low vibration scenario. Since the attitude data can characterize the current action or state of the wearer's head, and the bone-conducted vibration signals can characterize the vibration intensity of the wearer's current environment, after obtaining the attitude data and the bone-conducted vibration signals, the current scenario where the wearer is located can be determined based on the two.
[0079] In a possible implementation manner, for example, it can first be determined whether the wearer is in a leaning state and in a scenario of taking a vehicle through the attitude data; if it is determined that the wearer is in a leaning state and is currently taking a vehicle, it can be determined whether the wearer vibrates with the environmental vibration based on the bone-conducted vibration signals, that is, whether the wearer is in a high vibration scenario.
[0080] S203. When the current scenario is a high vibration scenario, perform noise reduction processing on the TWS earphones based on the air-conducted noise and the bone-conducted vibration signals.
[0081] Among them, if it is determined that the wearer is currently in a high-vibration scenario, it indicates that the noise of the TWS earphones may include air-conducted noise (high-frequency noise) and bone-conducted noise (low-frequency noise). Therefore, it is necessary to perform noise reduction processing on the TWS earphones based on the air-conducted noise and the bone-conducted vibration signal.
[0082] It can be understood that, for example, the air-conducted noise and the bone-conducted vibration signal can be analyzed and processed respectively to obtain corresponding reference signals, and then a reverse signal can be generated based on the two reference signals, so as to achieve noise reduction processing for high-frequency noise and low-frequency noise.
[0083] The noise reduction method of the TWS earphones provided by the embodiments of the present application, when the TWS earphones are in the active noise reduction mode, obtains multi-modal signals, and the multi-modal signals include: air-conducted noise, bone-conducted vibration signal, and attitude data; based on the attitude data and the bone-conducted vibration signal, determines the current scenario; when the current scenario is a high-vibration scenario, performs noise reduction processing on the TWS earphones based on the air-conducted noise and the bone-conducted vibration signal; this method can select the corresponding noise reduction method according to the current scenario, especially in the high-vibration scenario, performs noise reduction processing based on multi-modal noise, and since it covers the air-conducted and bone-conducted noise frequency bands, it can achieve noise reduction processing for both low-frequency noise and high-frequency noise, improving the noise reduction performance of the TWS earphones.
[0084] Figure 3 This is a schematic diagram of the hardware structure of a TWS earphone provided by the embodiments of the present application Figure 2 As Figure 2 shown, the TWS earphones include: a vibration sensor 1, an attitude sensing device 2, a first microphone 31, a first processing module 41, a second processing module 42, a first noise reduction module 51, a second noise reduction module 52, and an output module 6. The functions of multiple devices will be described in detail below.
[0085] The first microphone 31 is similar in structure to the above-mentioned microphone 3, and it can be, for example, a feedforward microphone on the TWS earphones, and is used to collect the ambient sound signal in the air to obtain air-conducted noise.
[0086] The first processing module 41 is used to perform feature analysis and extraction on the obtained vibration signal to convert the vibration signal into an available bone-conducted vibration signal; at the same time, an acoustic model can be deployed on the first processing module 41, and it can convert the bone-conducted vibration signal into a signal corresponding to the actual listening feeling based on the acoustic model.
[0087] The second processing module 42 is configured to perform data analysis on the attitude data obtained by the attitude sensing device 2 to determine whether the current wearer of the TWS earphone is in a relying state and in a scenario of taking a vehicle.
[0088] In a possible implementation, the second processing module 42 can also control the opening and closing state of the second noise reduction mode 52 and the corresponding preset parameters.
[0089] It can be understood that the second processing module 42 can know whether the wearer is currently in a relying state and in a scenario of taking a vehicle. If the wearer is not in a relying state or in a scenario of taking a vehicle, it indicates that there may be no vibration noise or the vibration noise will not affect the normal use of the TWS earphone by the wearer. Therefore, there is no need to perform noise reduction processing based on the bone conduction vibration signal. At this time, the second processing module 42 can control the second noise reduction mode 52 to be in the off state or lower the weight value of the second noise reduction mode 52 to avoid problems such as signal conflict and wasted computing power during noise reduction.
[0090] The first noise reduction module 51 is configured to convert the reference signal of the air conduction noise corresponding to the air medium into a reverse signal.
[0091] The second noise reduction module 52 is configured to convert the reference signal of the bone conduction vibration signal corresponding to the solid medium into a reverse signal.
[0092] Figure 4 It is a schematic flow of a noise reduction method for a TWS earphone provided by an embodiment of the present application Figure 2 . The hardware structure of the TWS earphone provided by the present application can be, for example, Figure 3 the hardware structure of the TWS earphone shown in the embodiment. The embodiment of the present application is based on Figure 2 the embodiment, and a possible implementation of the noise reduction method for the TWS earphone is described in detail. As Figure 4 shown, the noise reduction method for the TWS earphone provided by the embodiment of the present application includes:
[0093] S401. When the TWS earphone is in the active noise reduction mode, obtain multi-modal signals, where the multi-modal signals include: air conduction noise, bone conduction vibration signal, and attitude data.
[0094] Step S401 is similar to the above step S201 and will not be elaborated here.
[0095] S402. Determine the corresponding attitude angle according to the attitude data.
[0096] S403. Determine whether the attitude angle is within a preset angle range; if so, execute step S404, if not, execute step S405.
[0097] Among them, the posture angle indicates, for example, the inclination angle of the wearer's head relative to the direction of gravity. The preset angle range can be set by the wearer himself / herself, or can be obtained by the TWS earphone based on big data calculation.
[0098] If the posture angle is within the preset angle range, it indicates that the wearer's head is tilted, that is, the wearer is currently in a leaning state; if the posture angle is not within the preset angle range, it indicates that the wearer's head may not be tilted, that is, the wearer is not currently in a leaning state.
[0099] S404. Determine whether the vibration intensity of the bone conduction vibration signal is within the preset intensity range; if so, execute step S406, if not, execute step S405.
[0100] Among them, the vibration intensity can describe the magnitude of the vibration energy of an object, and is determined by its acceleration and displacement during the main vibration. The greater the vibration intensity, the stronger the shock feeling of the wearer.
[0101] When it is determined that the posture angle is within the preset angle range, that is, the wearer is currently in a leaning state, it is also necessary to determine whether the current vibration intensity will affect the use effect of the TWS earphone.
[0102] If the vibration intensity of the bone conduction vibration signal is within the preset intensity range, it indicates that the current scene vibration is relatively strong, which may affect the use effect of the TWS earphone by the wearer. Therefore, it can be determined that the current scene is a high-vibration scene;
[0103] If the vibration intensity of the bone conduction vibration signal is not within the preset intensity range, it indicates that the current scene vibration is not very strong, which may not affect the use effect of the TWS earphone by the wearer, or the impact caused is not easily noticeable. Therefore, it can be determined that the current scene is a low-vibration scene.
[0104] S405. Determine that the current scene is a low-vibration scene, and perform noise reduction processing on the TWS earphone based on the air conduction noise.
[0105] Among them, when the current scene is a low-vibration scene, since the vibration intensity in this scene is weak, it may not affect the use effect of the wearer, so it is only necessary to directly perform active noise reduction processing based on the air conduction noise.
[0106] It can be understood that in this embodiment, in a low-vibration scene, only noise reduction processing is performed based on the air conduction noise, which can not only achieve the active noise reduction effect, but also save computing power.
[0107] S406. Determine that the current scene is a high-vibration scene.
[0108] S407. Determine a first noise reduction signal based on the air-conducted noise, and determine a second noise reduction signal based on the bone-conducted vibration signal.
[0109] Among them, a possible implementation of determining the first noise reduction signal based on the air-conducted noise may be, for example, to first perform high-frequency filtering on the air-conducted noise, and then perform data analysis on the filtered air-conducted noise to obtain the corresponding first noise reduction signal. When performing data analysis, a lightweight model can be used, or a solution for determining the noise reduction signal in the prior art can be adopted.
[0110] It can be understood that in this step, there is no clear timing relationship between the process of determining the first noise reduction signal and the process of determining the second noise reduction signal. The first noise reduction information can be determined first, the second noise reduction signal can be determined first, or the first noise reduction signal and the second noise reduction signal can be determined simultaneously.
[0111] Continue to refer to Figure 3 , the determination of the first noise reduction signal can be implemented, for example, by the first noise reduction module 51 in Figure 3 the embodiment, and the determination of the second noise reduction signal can be implemented, for example, by the second noise reduction module 52 in Figure 3 the embodiment.
[0112] In a possible implementation, the multi-modal signal further includes: an electromyogram (EMG) signal. A possible implementation of determining the second noise reduction signal based on the bone-conducted vibration signal includes, for example:
[0113] Perform baseline calibration processing on the EMG signal to obtain corresponding characteristic parameters; perform low-pass filtering on the bone-conducted vibration signal, and based on the characteristic parameters, perform feature extraction on the processed bone-conducted vibration signal to obtain the second noise reduction signal.
[0114] Among them, when the muscle contracts, a tiny electrical signal (usually in the microvolt level) will be generated. The EMG signal can be, for example, the signal generated during the above-mentioned muscle electrical activity.
[0115] Continue to refer to Figure 3 , the EMG signal can be collected, for example, by the EMG induction device 7. Among them, the EMG induction device 7 can be, for example, an EMG sensor, or an integrated device with the function of detecting the EMG signal. It can be embedded, for example, on the surface in contact with the concha or the outside of the ear cap to ensure that the EMG induction device 7 can be in direct contact with the skin, facilitating the collection of the EMG signal.
[0116] It can be understood that the EMG signal can be first subjected to baseline calibration processing to obtain the corresponding EMG characteristic parameters of the wearer. Then, the bone conduction vibration signal is subjected to low-pass filtering processing to obtain the corresponding bone conduction noise. Since the bone conduction noise at this time may contain interference signals such as EMG signals, the EMG signal in the bone conduction noise can be removed based on the characteristic parameters, that is, the bone conduction noise is subjected to feature extraction to obtain the second noise signal.
[0117] S408. Perform phase calibration and superposition processing on the first noise reduction signal and the second noise reduction signal to obtain the target noise reduction signal.
[0118] S409. Perform noise reduction processing based on the target noise reduction signal.
[0119] The noise reduction method of the TWS earphone provided by the embodiment of the present application determines the corresponding attitude angle based on the pose data of the wearer, and when the attitude angle is within the preset angle range, determines whether the vibration intensity of the vibration signal is within the preset intensity range. If so, it is determined as a high vibration scenario, and if not, it is determined as a low vibration scenario; since the scenario is determined jointly based on the attitude data and the vibration signal, the scenario determination is more accurate; and this method adopts different noise reduction methods for different scenarios, achieving the effect of automatically switching the noise reduction mode. At the same time, this method realizes the noise reduction of low-frequency noise and high-frequency noise in the high vibration scenario, and realizes the noise reduction of high-frequency noise in the low vibration scenario, ensuring the noise reduction stability and improving the wearer experience.
[0120] A possible implementation process of the noise reduction method of the TWS earphone described in the above embodiment will be described in detail below.
[0121] Continue to refer to Figure 3 , after the wearer turns on the active noise reduction mode, the first microphone of the TWS earphone detects the environmental sound signal, the vibration sensing device detects the vibration signal, the EMG sensing device detects the EMG signal of the wearer, and at the same time the attitude sensing device obtains the pose data of the wearer.
[0122] The first processing module performs signal filtering processing and signal conversion processing on the vibration signal and the EMG signal to convert the vibration signal into a signal corresponding to the actual listening experience;
[0123] The second processing module determines whether the user is currently in a relying state based on the pose data. When in a relying state, it controls the second noise reduction module to turn on; when not in a relying state, it controls the second noise reduction module to turn off;
[0124] When the second noise reduction module is in the on state, it will perform noise reduction processing on the signal corresponding to the actual listening experience converted from the vibration signal to obtain the reverse signal corresponding to the bone conduction noise;
[0125] When the TWS earphone is in the active noise reduction mode, the first noise reduction module is always turned on. Based on the environmental sound signal, it performs noise reduction processing to obtain the reverse signal corresponding to the air-conducted noise;
[0126] After obtaining the reverse signal corresponding to the bone-conducted noise and the reverse signal corresponding to the air-conducted noise, phase calibration and superposition processing are performed on the two, and the result is output through the output module.
[0127] This method adopts corresponding noise reduction methods for different scenarios, realizes dynamic adjustment of the noise reduction method, avoids signal conflicts, ensures the effect of noise reduction stability, and at the same time can ensure that the wearer has a good noise reduction effect in any scenario.
[0128] In a possible implementation, the TWS earphone further includes: a second microphone and a third noise reduction module. See also Figure 3 , the second microphone 32 can be, for example, the feedback microphone on the TWS earphone, which is mainly used to collect the ambient noise signal in the wearer's ear. It can be understood that after playing the reverse signal through the output module, although the noise reduction effect is achieved, the content currently played by the TWS earphone may become new noise.
[0129] Therefore, the second microphone 32 is used to collect the ambient noise signal in the ear, and then the third noise reduction module 53 is used to perform noise reduction processing on the ambient noise signal in the ear, so as to prevent the current playback content of the TWS earphone from affecting the subsequent playback content.
[0130] Figure 5 This is a schematic structural diagram of a noise reduction device for a TWS earphone provided by an embodiment of the present application. As Figure 5 shown, the noise reduction device 500 for a TWS earphone provided by an embodiment of the present application includes:
[0131] An acquisition module 501, configured to acquire a multi-modal signal when the TWS earphone is in the active noise reduction mode, where the multi-modal signal includes: air-conducted noise, bone-conducted vibration signal, and attitude data;
[0132] A determination module 502, configured to determine the current scenario based on the attitude data and the bone-conducted vibration signal;
[0133] A processing module 503, configured to perform noise reduction processing on the TWS earphone based on the air-conducted noise and the bone-conducted vibration signal when the current scenario is a high-vibration scenario.
[0134] In a possible implementation, the device further includes: a judgment module 504;
[0135] The determination module 502 is configured to determine the corresponding attitude angle according to the attitude data;
[0136] The determination module 504 is configured to determine whether the attitude angle is within a preset angle range; and in the case where the attitude angle is within the preset angle range, determine whether the vibration intensity of the bone conduction vibration signal is within a preset intensity range.
[0137] The determination module 502 is further configured to determine the current scenario as a high vibration scenario in the case where the vibration intensity is within the preset intensity range.
[0138] In a possible implementation manner, the determination module 502 is configured to determine a first noise reduction signal based on the air conduction noise; and determine a second noise reduction signal based on the bone conduction vibration signal.
[0139] The processing module 503 is configured to perform phase calibration and superposition processing on the first noise reduction signal and the second noise reduction signal to obtain a target noise reduction signal, and perform noise reduction processing based on the target noise reduction signal.
[0140] In a possible implementation manner, the multimodal signal further includes: an electromyogram signal. The determination module 502 is configured to perform baseline calibration processing on the electromyogram signal to obtain corresponding characteristic parameters; and perform low-pass filtering processing on the bone conduction vibration signal, and perform feature extraction on the processed bone conduction vibration signal based on the characteristic parameters to obtain the second noise reduction signal.
[0141] In a possible implementation manner, the determination module 502 is further configured to determine the current scenario as a low vibration scenario in the case where the attitude angle is not within the preset angle range, or the vibration intensity is not within the preset intensity range.
[0142] In a possible implementation manner, the processing module 503 is further configured to perform noise reduction processing on the TWS earphone based on the air conduction noise in the case where the current scenario is a low vibration scenario.
[0143] The noise reduction device of a TWS earphone provided in this embodiment can execute the noise reduction method of the TWS earphone provided in the above method embodiment, and its implementation principle and technical effect are similar, which will not be elaborated here in this embodiment.
[0144] Figure 6 This is a schematic structural diagram of a TWS earphone provided in an embodiment of the present application. As Figure 6 shown, the electronic device 600 may include at least one processor 601, at least one storage medium 602, and a communication interface 603. Among them, at least one processor 601 is used to implement the method provided in the above embodiments of the present application.
[0145] At least one memory 602 for storing computer-executable instructions and / or data. The memory 602 is coupled to the processor 601. The coupling in the embodiments of the present application is an indirect coupling or communication connection between devices, units or modules, which can be electrical, mechanical or other forms for information interaction between devices, units or modules. The processor 601 may cooperate with the memory 602. The processor 601 may execute the computer-executable instructions stored in the memory 602. At least one of the at least one memory may be included in the processor.
[0146] A communication interface 603 for communicating with other devices through a transmission medium, so that the electronic device 600 can communicate with other devices. The communication interface 603 may be, for example, a transceiver, an interface, a bus, a circuit or a device capable of implementing a transceiver function. The processor 601 may use the communication interface 603 to transmit and receive data and / or information and is used to implement the method provided in the above embodiments of the present application. For specific details, refer to the detailed description in the foregoing embodiments and will not be elaborated here.
[0147] In the embodiments of the present application, the specific connection medium between the above-mentioned processor 601, memory 602 and communication interface 603 is not limited. In the embodiments of the present application Figure 6 it is connected by a bus 604 between the processor 601, the memory 602 and the communication interface 603. The bus 604 is Figure 6 represented by a thick line in, and the connection manners between other components are only for illustrative purposes and are not limited thereto. The bus may be divided into an address bus, a data bus, a control bus, etc. For the sake of convenience of representation, Figure 6 only one thick line is used to represent it in, but it does not mean that there is only one bus or one type of bus.
[0148] In the embodiments of the present application, a computer-readable storage medium is further provided, on which a computer program is stored. When the computer program is executed by a processor, the technical solutions of the above method embodiments are implemented. The implementation principle and technical effects are similar and will not be elaborated here.
[0149] In the embodiments of the present application, a computer program product is further provided, including a computer program. When the computer program is executed by a processor, the technical solutions of the above method embodiments are implemented. The implementation principle and technical effects are similar and will not be elaborated here.
[0150] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this application.
[0151] It is further noted that although the steps in the flowchart are shown in sequence according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.
[0152] It should be understood that the above device embodiments are illustrative only, and the devices of this application can also be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.
[0153] In addition, without special instructions, in each embodiment of this application, each functional unit / module can be integrated in one unit / module, or each unit / module can exist physically alone, or two or more units / modules can be integrated together. The above integrated unit / module can be implemented in the form of hardware or in the form of a software program module.
[0154] When the integrated unit / module is implemented in the form of hardware, the hardware can be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic storage medium or magneto-optical storage medium, such as resistive random access memory (RRAM), dynamic random access memory (DRAM), static random access memory (SRAM), enhanced dynamic random access memory (EDRAM), high-bandwidth memory (HBM), hybrid memory cube (HMC), etc.
[0155] When the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. And the aforementioned memory includes: USB flash drives, read-only memory (ROM), random access memory (RAM), mobile hard disks, magnetic disks, or optical discs and other various media that can store program codes.
[0156] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.
[0157] Other embodiments of the present application will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. The present application is intended to cover any variations, uses, or adaptations of the present application, which follow the general principles of the present application and include known common general knowledge or conventional technical means in the technical field not disclosed in the present application. The specification and examples are only illustrative, and the true scope and spirit of the present application are pointed out by the following claims.
[0158] It should be understood that the present application is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.
Claims
1. A noise reduction method for TWS earphones, characterized in that, The method includes: When the TWS earphone is in the active noise reduction mode, acquiring multi-modal signals, where the multi-modal signals include: air-conducted noise, bone-conducted vibration signals, and attitude data; Determining a current scenario based on the attitude data and the bone-conducted vibration signals; When the current scenario is a high-vibration scenario, performing noise reduction processing on the TWS earphone based on the air-conducted noise and the bone-conducted vibration signals.
2. The method according to claim 1, characterized in that The determining a current scenario based on the attitude data and the bone-conducted vibration signals includes: Determining a corresponding attitude angle according to the attitude data; Judging whether the attitude angle is within a preset angle range; If so, judging whether the vibration intensity of the bone-conducted vibration signal is within a preset intensity range; When the vibration intensity is within the preset intensity range, determining that the current scenario is a high-vibration scenario.
3. The method according to claim 1, wherein The performing noise reduction processing on the TWS earphone based on the air-conducted noise and the bone-conducted vibration signals includes: Determining a first noise reduction signal based on the air-conducted noise; Determining a second noise reduction signal based on the bone-conducted vibration signals; Performing phase calibration and superposition processing on the first noise reduction signal and the second noise reduction signal to obtain a target noise reduction signal; Performing noise reduction processing based on the target noise reduction signal.
4. The method according to claim 3, wherein The multi-modal signals further include: electromyogram signals, and the determining a second noise reduction signal based on the bone-conducted vibration signals includes: Performing baseline calibration processing on the electromyogram signals to obtain corresponding characteristic parameters; Performing low-pass filtering processing on the bone-conducted vibration signals, and performing feature extraction on the processed bone-conducted vibration signals based on the characteristic parameters to obtain the second noise reduction signal.
5. The method according to claim 2, wherein The method further includes: When the attitude angle is not within the preset angle range, or the vibration intensity is not within the preset intensity range, determining that the current scenario is a low-vibration scenario.
6. The method according to claim 1 or 5, characterized in that The method further includes: When the current scenario is a low-vibration scenario, performing noise reduction processing on the TWS earphone based on the air-conducted noise.
7. A noise reduction device for TWS earphones, characterized in that, The device includes: An acquisition module, configured to acquire multi-modal signals when the TWS earphone is in the active noise reduction mode, where the multi-modal signals include: air-conducted noise, bone-conducted vibration signals, and attitude data; A determination module, configured to determine a current scenario based on the attitude data and the bone-conducted vibration signals; A processing module, configured to perform noise reduction processing on the TWS earphone based on the air-conducted noise and the bone-conducted vibration signals when the current scenario is a high-vibration scenario.
8. The noise reduction device for a TWS earphone according to claim 7, wherein The determination module is configured to determine a first noise reduction signal based on the air-conducted noise; and determine a second noise reduction signal based on the bone-conducted vibration signals; The processing module is configured to perform phase calibration and superposition processing on the first noise reduction signal and the second noise reduction signal to obtain a target noise reduction signal, and perform noise reduction processing based on the target noise reduction signal.
9. A TWS earphone, characterized in that, Includes: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 6.
10. A computer-readable storage medium, characterized in that, Computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, they are used to implement the method according to any one of claims 1 to 6.