Earphone multi-sensor fused intelligent hearing protection control method

Abstract

The invention discloses an earphone multi-sensor fusion intelligent hearing protection control method, and relates to the technical field of intelligent earphones, and the earphone multi-sensor fusion intelligent hearing protection control method comprises the following steps: S1, configuring a multi-sensor system; s2, transmitting the acquired data to a control unit by each sensor; s3, establishing a correlation model between the environment sound intensity and the user hearing safety threshold by using a deep learning algorithm; s4, evaluating the hearing state of the user through a biological signal analysis algorithm; s5, determining whether the earphone is in a normal wearing state; s6, the control unit starts a sound attenuation module; s7, performing attenuation control on the sound with different frequencies; through the fusion of various sensors, the environment sound intensity can be accurately obtained in real time, and protection can be carried out in a more targeted manner; a digital signal processing technology is adopted to carry out independent attenuation control on sounds with different frequencies, so that the influence of a user on normal perception of audio information is avoided.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent earphones, and in particular to an intelligent hearing protection control method for earphone multi-sensor fusion. Background Art

[0002] In modern life, noise pollution poses an increasingly serious threat to people's hearing health. Traditional hearing protection measures mainly rely on a single sound intensity sensor to monitor environmental sounds and protect hearing through simple volume adjustment; however, this method has obvious limitations and cannot comprehensively and accurately evaluate and protect the user's hearing; the headphones in the prior art do not use the fusion of multiple sensors to obtain real-time and accurate information on environmental sound intensity, user hearing status and headphone wearing conditions, which is not convenient for targeted hearing protection; therefore, in view of this situation, there is an urgent need to develop an intelligent hearing protection control method for headphone multi-sensor fusion to meet actual needs. Summary of the invention

[0003] In view of this, the present invention aims to address the deficiencies in the prior art, and its main purpose is to provide an intelligent hearing protection control method for headphone multi-sensor fusion. Through the fusion of multiple sensors, it can obtain environmental sound intensity, user hearing status and headphone wearing condition information in real time and accurately, and can provide more targeted protection; it uses digital signal processing technology to independently attenuate sounds of different frequencies to avoid affecting the user's normal perception of audio information due to excessive attenuation of certain frequency sounds.

[0004] To achieve the above purpose, the present invention adopts the following technical solutions: An intelligent hearing protection control method based on multi-sensor fusion of headphones comprises the following steps: S1. Configure a multi-sensor system including at least a sound intensity sensor, a user hearing status sensor, and an earphone wearing status sensor; S2, each sensor transmits the collected data to the control unit, and the control unit pre-processes the data, including noise removal and data normalization operations; S3. Based on the preprocessed data, a deep learning algorithm is used to establish a correlation model between the ambient sound intensity and the user's hearing safety threshold, so as to accurately determine whether the ambient sound intensity exceeds the user's hearing safety threshold; S4, based on the data of the user's hearing status sensor, using a biosignal analysis algorithm to evaluate the user's current hearing status in real time; S5. Determine whether the headset is in a normal wearing state based on the data from the headset wearing state sensor, and if not, trigger a corresponding prompt or protection mechanism; S6. When the ambient sound intensity exceeds the user's hearing safety threshold and the user's hearing is vulnerable or the earphone is not worn properly, the control unit starts the sound attenuation module to perform real-time attenuation processing on the sound transmitted to the earphone, and the attenuation degree is dynamically adjusted according to the ambient sound intensity and the user's hearing status; S7, the sound attenuation module uses digital signal processing technology to independently attenuate sounds of different frequencies to better protect the user's hearing.

[0005] As a preferred solution: the user hearing status sensor is a sensor based on the bioimpedance principle, which reflects the change of hearing status by detecting the change of electrical impedance of the user's ear tissue.

[0006] As a preferred solution: the sound attenuation module adopts an adaptive filtering algorithm, which can automatically adjust the attenuation parameters according to the characteristics of the ambient sound; the adaptive filtering algorithm includes an initialization stage and an iterative update stage.

[0007] As a preferred solution: when the sound attenuation module is started, the vibration reminder function is triggered, and the vibration of the earphone is used to remind the user that the ambient sound intensity is too high and the user needs to pay attention to hearing protection.

[0008] As a preferred solution: the intelligent hearing protection control method establishes a historical data storage unit for recording the ambient sound intensity, the user's hearing status and the execution of hearing protection control measures, so as to facilitate subsequent data analysis and model optimization.

[0009] As a preferred solution: the sound attenuation module is provided with an emergency shut-off button. When the user needs to stop the sound attenuation immediately under special circumstances, the emergency shut-off button is pressed, and the button has an anti-mis-touch component.

[0010] As a preferred solution: when performing data preprocessing, posture recognition is performed on the data of the headphone wearing status sensor to eliminate false triggering caused by improper headphone wearing posture.

[0011] As a preferred solution: the intelligent hearing protection control method also includes establishing a user hearing profile and providing a hearing protection solution for the user based on the user's long-term hearing data and usage habits.

[0012] As a preferred solution: after the ambient sound intensity drops below a safety threshold, the sound attenuation module will gradually restore the original intensity of the sound to avoid discomfort to the user caused by sudden sound changes.

[0013] As a preferred solution: the intelligent hearing protection control method is compatible with various types of headphones, including wired headphones and wireless headphones; the intelligent hearing protection control method is combined with voice recognition.

[0014] Compared with the prior art, the present invention has obvious advantages and beneficial effects. Specifically, it can be seen from the above technical solution that: First, through the integration of multiple sensors, it can obtain information about the ambient sound intensity, the user's hearing status, and the wearing condition of the headphones in real time and accurately. Based on this information, it can accurately activate the sound attenuation and reminder functions to effectively prevent the user's hearing from being damaged in a noisy environment. Compared with the traditional single hearing protection method, it can provide more targeted protection. Second, it can accurately monitor the intensity of ambient sound, the user's hearing condition and the wearing condition of the headphones in real time. Through the coordinated work of multiple sensors, it can ensure that it can detect whether the ambient sound poses a threat to the user's hearing at any time, providing comprehensive and reliable protection for the user's hearing. Third, digital signal processing technology is used to independently control the attenuation of sounds of different frequencies, and targeted attenuation can be performed according to the degree of impact of sounds of different frequencies on hearing. This can protect the user's hearing more precisely than the traditional overall attenuation method, and avoid affecting the user's normal perception of audio information due to excessive attenuation of certain frequency sounds.

[0015] In order to more clearly illustrate the structural features and effects of the present invention, it is described in detail below in conjunction with the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a flow chart of the intelligent hearing protection control method of the headset multi-sensor fusion of the present invention. DETAILED DESCRIPTION

[0017] The present invention Figure 1 As shown, an intelligent hearing protection control method based on multi-sensor fusion of headphones includes the following steps: S1. Configure a multi-sensor system that includes at least a sound intensity sensor, a user hearing status sensor, and an earphone wearing status sensor; the sound intensity sensor is used to monitor the intensity of ambient sound in real time, the user hearing status sensor is used to detect the user's hearing condition, and the earphone wearing status sensor is used to sense the wearing condition of the earphone; multiple sensors work together to provide a comprehensive data basis for subsequent accurate judgment and protection of hearing. The fusion of multiple types of sensors can more comprehensively perceive various information related to hearing, such as sound intensity, the user's own hearing status, and the earphone wearing condition, laying the foundation for subsequent intelligent processing and protection measures.

[0018] S2, each sensor transmits the collected data to the control unit, and the control unit pre-processes the data, including noise removal and data normalization operations; Removing noise and performing data normalization operations can improve the quality and stability of data, reduce the impact of noise interference factors on subsequent analysis and processing, make model building and status judgment based on preprocessed data more accurate and reliable, and provide a good data prerequisite for the effective operation of subsequent links.

[0019] S3. Based on the preprocessed data, a deep learning algorithm is used to establish a correlation model between the ambient sound intensity and the user's hearing safety threshold, so as to accurately determine whether the ambient sound intensity exceeds the user's hearing safety threshold; By using deep learning algorithms to establish a relationship between ambient sound intensity and the user's hearing safety threshold, it can accurately determine whether the ambient sound poses a threat to the user's hearing safety. Through the powerful modeling capabilities of deep learning, the relationship between sound intensity and hearing safety can be more accurately grasped, providing a basis for timely initiation of protective measures and effectively avoiding hearing damage.

[0020] S4, based on the data of the user's hearing status sensor, using a biosignal analysis algorithm to evaluate the user's current hearing status in real time; The hearing status can be assessed in real time using a biosignal analysis algorithm based on the user's hearing status sensor data, allowing timely understanding of changes in the user's current hearing condition. The biosignal analysis algorithm can accurately capture subtle changes in the user's ear tissue electrical impedance biosignals, thereby quickly and accurately assessing the hearing status and providing a basis for subsequent targeted protection.

[0021] S5. Determine whether the headset is in a normal wearing state based on the data from the headset wearing state sensor, and if not, trigger a corresponding prompt or protection mechanism; Combining the headphone wearing status sensor data to determine whether the headphone is worn normally and triggering the corresponding mechanism can ensure that subsequent hearing protection actions are performed only when the headphone is worn normally, avoiding false triggering due to improper wearing, and ensuring the accuracy and effectiveness of hearing protection.

[0022] S6. When the ambient sound intensity exceeds the user's hearing safety threshold and the user's hearing is vulnerable or the earphone is not worn properly, the control unit starts the sound attenuation module to perform real-time attenuation processing on the sound transmitted to the earphone, and the attenuation degree is dynamically adjusted according to the ambient sound intensity and the user's hearing status; When the conditions are met, the sound attenuation module is started and the attenuation degree is dynamically adjusted, which can effectively reduce the sound intensity transmitted to the headphones at critical moments to protect the user's hearing. The attenuation degree is dynamically adjusted according to the ambient sound intensity and the user's hearing status, making the protection more targeted and flexible, and better adapting to different usage scenarios and user needs.

[0023] S7, the sound attenuation module uses digital signal processing technology to independently attenuate sounds of different frequencies to better protect the user's hearing.

[0024] It has a remote control function and can receive remote commands to adjust hearing protection parameters and strategies, such as adjusting the hearing safety threshold, through wireless connection with external devices; The intelligent hearing protection control method is compatible with various types of headphones, including wired headphones, wireless headphones and audio devices of different brands and models, and can operate stably in different usage environments; Regularly perform self-inspection and calibration on the multi-sensor system and control unit to ensure the accuracy of each sensor and the normal operation of the control unit to ensure the reliability of hearing protection control.

[0025] Regular self-inspection and calibration are performed to ensure the accuracy of each sensor and the normal operation of the control unit. It can operate stably in various complex usage environments and will not experience performance degradation or failure due to environmental changes or long-term use, providing users with long-term and stable hearing protection.

[0026] The data processing of the sound intensity sensor is as follows: a denoising algorithm based on wavelet transform is used. Wavelet transform can decompose the signal into different frequency scales. By setting a suitable wavelet basis and threshold function, the high-frequency noise part is threshold processed and set to zero or compressed appropriately to remove the noise. By collecting sound intensity data in different noise environments, a comparative test is first performed before and after denoising.

[0027] The user hearing status sensor data processing is specifically as follows: Sensor data processing method based on the principle of bioimpedance: by applying a weak current to the user's ear, the impedance change of the ear tissue is measured. The sensor usually adopts a specific electrode design and measurement circuit to ensure the accuracy and stability of the measurement. In data processing, the original impedance data will be filtered to remove high-frequency interference and low-frequency drift; effect evaluation data: volunteers with different hearing status are selected and tested in quiet environments and different noise environments. Measure the changing trend of the impedance data within a specific time and compare it with the known changes in hearing status.

[0028] Through the integration of multiple sensors, it can obtain information on ambient sound intensity, user hearing status and headphone wearing conditions in real time and accurately, and accurately activate sound attenuation and reminder functions based on this information, effectively preventing users from hearing damage in noisy environments. Compared with the traditional single hearing protection method, it can provide more targeted protection; it can accurately monitor ambient sound intensity, user hearing status and headphone wearing conditions in real time, and through the collaborative work of multiple sensors, it can ensure that it can detect whether ambient sound poses a threat to user hearing at any time. Once it is found that the ambient sound intensity exceeds the user's hearing safety threshold and the user's hearing is in a vulnerable state or the headphones are not worn normally, the sound attenuation protection measures are immediately activated to effectively prevent the user's hearing from being damaged due to long-term exposure to noise environments, providing comprehensive and reliable protection for the user's hearing; digital signal processing technology is used to independently attenuate sounds of different frequencies, and targeted attenuation can be performed according to the degree of influence of sounds of different frequencies on hearing, which can protect user hearing more precisely than the traditional overall attenuation method, and avoid affecting the user's normal perception of audio information due to excessive attenuation of certain frequency sounds.

[0029] The user hearing status sensor is a sensor based on the bioelectrical impedance principle, which reflects the change of hearing status by detecting the change of electrical impedance of the user's ear tissue.

[0030] By detecting changes in the electrical impedance of ear tissue to reflect changes in hearing status, this method is non-invasive and can reflect subtle changes in hearing in real time and sensitively. Compared with other traditional methods, it can more accurately obtain user hearing status information and provide a more accurate basis for hearing protection.

[0031] The sound attenuation module adopts an adaptive filtering algorithm, which can automatically adjust the attenuation parameters according to the characteristics of the ambient sound; the adaptive filtering algorithm includes an initialization phase and an iterative update phase.

[0032] It can automatically adjust the attenuation parameters according to the characteristics of the ambient sound to make the attenuation more in line with the actual environmental needs. The adaptive filtering algorithm can adapt to the changes in the ambient sound in real time and automatically adjust the attenuation parameters to ensure effective sound attenuation in various complex environments, protecting hearing without affecting the user's perception of normal sound.

[0033] When the sound attenuation module is started, the vibration reminder function is triggered, and the vibration of the earphones is used to remind the user that the ambient sound intensity is too high and that hearing protection is needed.

[0034] The earphones vibrate to remind users that the ambient sound intensity is too high, adding a reminder method for hearing protection. The vibration reminder can remind users to pay attention to hearing protection in another way while the sound is attenuated. This two-pronged approach can increase users' attention to and timeliness of hearing protection.

[0035] The intelligent hearing protection control method establishes a historical data storage unit for recording the ambient sound intensity, the user's hearing status and the execution of hearing protection control measures, so as to facilitate subsequent data analysis and model optimization.

[0036] It is used to record various relevant situations for data analysis and model optimization. It can accumulate a large amount of usage data to provide data support for the subsequent improvement and optimization of hearing protection control methods. Through the analysis of historical data, it can continuously improve the model and control strategy, and improve the effectiveness and accuracy of hearing protection.

[0037] The sound attenuation module is provided with an emergency shut-off button. When the user needs to stop the sound attenuation immediately under special circumstances, the emergency shut-off button is pressed to achieve the purpose, and the button has an anti-mis-touch component.

[0038] It meets the needs of users to immediately stop sound attenuation in special circumstances and has an anti-accidental touch design. The anti-accidental touch design ensures that the sound attenuation will not be turned off by mistake in non-emergency situations, while the emergency shut-off button provides users with a guarantee to stop sound attenuation in time in special circumstances, taking into account both hearing protection and meeting users' special needs.

[0039] During data preprocessing, posture recognition is performed on the data of the headphone wearing status sensor to eliminate false triggering caused by improper headphone wearing posture.

[0040] The intelligent hearing protection control method also includes establishing a user hearing profile and providing a hearing protection plan for the user based on the user's long-term hearing data and usage habits.

[0041] After the ambient sound intensity drops below the safety threshold, the sound attenuation module will gradually restore the original intensity of the sound to avoid discomfort to the user caused by sudden sound changes; gradually restoring the original intensity of the sound during the sound attenuation process avoids discomfort to the user caused by sudden sound changes, allowing users to enjoy music or other audio content while also getting effective hearing protection, thereby improving the user experience.

[0042] The intelligent hearing protection control method is compatible with various types of headphones, including wired headphones and wireless headphones; the intelligent hearing protection control method is combined with voice recognition; it is compatible with various types of headphones, whether wired or wireless headphones, and audio devices of different brands and models, and can operate well, meeting the usage needs of different users and expanding the scope of application of the product; combined with voice recognition, users can adjust the parameters and strategies of hearing protection through voice commands, such as adjusting the hearing safety threshold, which increases the convenience and flexibility of use. At the same time, the establishment of a historical data storage unit can analyze a large amount of usage data, provide a basis for subsequent model optimization, and make hearing protection more accurate and personalized.

[0043] The design emphasis of the present invention is: First, through the integration of multiple sensors, it can obtain information about the ambient sound intensity, the user's hearing status, and the wearing condition of the headphones in real time and accurately. Based on this information, it can accurately activate the sound attenuation and reminder functions to effectively prevent the user's hearing from being damaged in a noisy environment. Compared with the traditional single hearing protection method, it can provide more targeted protection. Second, it can accurately monitor the intensity of ambient sound, the user's hearing condition and the wearing condition of the headphones in real time. Through the coordinated work of multiple sensors, it can ensure that it can detect whether the ambient sound poses a threat to the user's hearing at any time, providing comprehensive and reliable protection for the user's hearing. Third, digital signal processing technology is used to independently control the attenuation of sounds of different frequencies, and targeted attenuation can be performed according to the degree of impact of sounds of different frequencies on hearing. This can protect the user's hearing more precisely than the traditional overall attenuation method, and avoid affecting the user's normal perception of audio information due to excessive attenuation of certain frequency sounds.

[0044] The above description is only a preferred embodiment of the present invention and does not limit the technical scope of the present invention. Therefore, any slight modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention are still within the scope of the technical solution of the present invention.

Claims

1. An intelligent hearing protection control method based on multi-sensor fusion of headphones, characterized by: The steps include: S1. Configure a multi-sensor system including at least a sound intensity sensor, a user hearing status sensor, and an earphone wearing status sensor; S2, each sensor transmits the collected data to the control unit, and the control unit pre-processes the data, including noise removal and data normalization operations; S3. Based on the preprocessed data, a deep learning algorithm is used to establish a correlation model between the ambient sound intensity and the user's hearing safety threshold, so as to accurately determine whether the ambient sound intensity exceeds the user's hearing safety threshold; S4, based on the data of the user's hearing status sensor, using a biosignal analysis algorithm to evaluate the user's current hearing status in real time; S5. Determine whether the headset is in a normal wearing state based on the data from the headset wearing state sensor, and if not, trigger a corresponding prompt or protection mechanism; S6. When the ambient sound intensity exceeds the user's hearing safety threshold and the user's hearing is vulnerable or the earphone is not worn properly, the control unit starts the sound attenuation module to perform real-time attenuation processing on the sound transmitted to the earphone, and the attenuation degree is dynamically adjusted according to the ambient sound intensity and the user's hearing status; S7, the sound attenuation module uses digital signal processing technology to independently control the attenuation of sounds of different frequencies.

2. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: The user hearing status sensor is a sensor based on the bioelectrical impedance principle, which reflects the change of the hearing status by detecting the change of the electrical impedance of the user's ear tissue.

3. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: The sound attenuation module adopts an adaptive filtering algorithm, which can automatically adjust the attenuation parameters according to the characteristics of the ambient sound; the adaptive filtering algorithm includes an initialization phase and an iterative update phase.

4. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: When the sound attenuation module is started, the vibration reminder function is triggered, and the vibration of the earphones is used to remind the user that the ambient sound intensity is too high and that hearing protection is needed.

5. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: The intelligent hearing protection control method establishes a historical data storage unit to record the ambient sound intensity, the user's hearing status and the implementation of hearing protection control measures, so as to facilitate subsequent data analysis and model optimization.

6. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: The sound attenuation module is provided with an emergency shut-off button. When the user needs to stop the sound attenuation immediately under special circumstances, it can be achieved by pressing the emergency shut-off button, and the button has an anti-mis-touch component.

7. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: During data preprocessing, posture recognition is performed on the data of the headphone wearing status sensor to eliminate false triggering caused by improper headphone wearing posture.

8. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: The intelligent hearing protection control method also includes establishing a user hearing profile and providing the user with a hearing protection plan based on the user's long-term hearing data and usage habits.

9. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: After the ambient sound intensity drops below the safety threshold, the sound attenuation module will gradually restore the original intensity of the sound to avoid discomfort to the user caused by sudden sound changes.

10. The intelligent hearing protection control method of headset multi-sensor fusion as claimed in claim 1, characterized in that: The intelligent hearing protection control method is compatible with multiple types of headphones, including wired headphones and wireless headphones; the intelligent hearing protection control method is combined with voice recognition.

Images