Method and system for correcting phase difference of audio signal by intelligent earphone

Abstract

The invention provides an audio signal phase difference correction method and system of an intelligent earphone, and is applied to the field of audio signals. According to the invention, the characteristic data of the ears of the user, including the shape, size, auricle and other information, are collected, and the frequency response curve and phase correction value of the ears of the user are generated, so that personalized correction of the intelligent earphone can be realized, the intelligent earphone can automatically adjust the phase of the audio signal according to the ear characteristics of each user, and the user experience is improved. According to the method and the device, the content, including types, parameters and functions, of the filter of the intelligent earphone is synchronously adjusted according to the characteristic data and the personalized correction curve of the ears of the users, the audio processing effect of the intelligent earphone can be further optimized, and more personalized audio experience suitable for the users is provided.

Description

Technical Field

[0001] The present invention relates to the field of audio signals, and in particular to a method and system for correcting phase differences of audio signals for smart headphones. Background Art

[0002] Currently, when users use smart headphones, since each person's ears are different in shape and size, this may lead to differences in the perception of the same audio signal, especially in frequency response and phase response. How smart headphones can correct phase differences so that the audio signal performs consistently in the ears of different users has become a technical problem that needs to be solved. Summary of the invention

[0003] The present invention aims to solve the problem of how to make audio signals appear consistent in the ears of different users by correcting phase differences, and provides a method and system for correcting phase differences of audio signals by smart headphones.

[0004] The present invention adopts the following technical means to solve the technical problem: The present invention provides a method for correcting the phase difference of an audio signal by a smart headset, comprising: Based on the built-in sensor preset in the smart headset, the characteristic data of the user's ear is collected, wherein the characteristic data specifically includes the ear shape, ear size and ear auricle; Determining whether the characteristic data is pre-recorded by the smart headset; If not, the sound propagation area of ​​the user's ear is analyzed according to the ear image and measurement data pre-acquired by the smart headset, the user's ear is frequency scanned using the preset frequency of the smart headset, the propagation path of the frequency in the user's ear is acquired, the frequency parameters of the user's ear are collected from the propagation path, and the frequency response curve of the user's ear is generated, wherein the ear image specifically includes the shape of the helix, the curve of the auricle and the size of the earlobe, and the frequency parameters specifically include sound attenuation, sound enhancement and sound distortion; Determining whether a preset phase response difference is detected in the frequency response curve; If so, the phase correction value at different frequencies is identified according to the frequency response curve, the correction curve of the user's ear is constructed based on the phase correction value, the preset phase of the smart headset is adjusted by applying the correction curve, and the preset filter content is synchronously replaced according to the characteristic data and the correction curve to generate personalized setting content for the user's ear for the smart headset, wherein the filter content specifically includes filter type, filter parameters and filter function.

[0005] Furthermore, before the step of pre-acquiring the ear image and measurement data according to the smart headset, it also includes: Using preset scanning content to collect point cloud data within a preset range of the user's ear, and constructing a virtual three-dimensional model of the user's ear based on the point cloud data; Determining whether the virtual three-dimensional model conforms to a preset three-dimensional surface; If not, the point cloud data is subjected to preset processing, and the preset surface reconstruction content is applied to generate a corresponding continuous three-dimensional model for the processed point cloud data, and the ear image and the measurement data are extracted from the continuous three-dimensional model, wherein the preset processing specifically includes cleaning processing, alignment processing and reconstruction processing.

[0006] Furthermore, the step of obtaining a propagation path of the frequency in the user's ear, collecting frequency parameters of the user's ear from the propagation path, and generating a frequency response curve of the user's ear includes: Based on the preset range of the frequency, transmitting sound signals to the user's ears in sequence, wherein the sound signals specifically include pure frequency tones and frequency combinations; Determining whether the sound signal can be returned from the user's ear and receive a preset amplitude content; If possible, the amplitude value of each frequency point is calculated according to the amplitude content, the amplitude size between the various frequency points is identified, the relative intensity of the sound signal at different frequency points is collected according to the amplitude size, the relative intensity is divided using the preset stage content, and the frequency response curve is generated.

[0007] Furthermore, the step of identifying the phase correction value at different frequencies according to the frequency response curve further includes: Collecting frequency points to be phase corrected from the frequency response curve, and calculating phase correction values ​​corresponding to the frequency points using a preset correction algorithm; Determining whether the phase correction value matches the usage scenario preset by the user; If not, a corresponding coverage frequency range is generated based on the correction curve, the usage scenario is selected within the coverage frequency range to calibrate the frequency of the smart headset, and the preset listening frequency range of the smart headset is switched, wherein the listening frequency range specifically includes a low frequency range, a mid-frequency range and a high frequency range.

[0008] Furthermore, before the step of constructing the correction curve of the user's ear based on the phase correction value, the step further includes: Based on the frequency range covered by the calibration curve, collecting frequency axis information of the calibration curve, wherein the frequency axis information specifically includes a slope and a curvature; Determining whether the frequency axis information meets the correction effect preset by the user; If not, receive the real-time instructions input by the user to the smart headset, dynamically adjust the preset amplitude and preset order of the correction curve according to the correction effect, generate the user's correction log information for the correction curve based on the dynamic adjustment content, and record the user's usage scenarios and application requirements for the correction curve in the correction log information, wherein the amplitude specifically refers to the height of the peak or valley value of the correction curve, and the order specifically refers to the complexity and flexibility of the correction curve.

[0009] Further, the step of determining whether the frequency response curve detects a preset phase response difference includes: Based on the phase angle preset by the smart headset, obtaining a phase response corresponding to the measurement data; Determining whether the phase response matches a standard response preset by the smart headset; If not, then collect the phase difference of the phase response at different frequencies, identify the trend data of the phase difference, and detect the regular content of the phase difference from the trend data, wherein the regular content is specifically a repetitive pattern or anomaly within the frequency range.

[0010] Furthermore, the step of collecting characteristic data of the user's ear based on the preset built-in sensor of the smart headset includes: Using a capacitive sensor preset in the smart headset to identify the contact distance between the user's ear and the capacitive sensor; Determining whether the contact distance reaches a preset distance; If so, the contact area corresponding to the auricle is detected, and the capacitance value is collected by applying the capacitive sensor based on the contact area, and the characteristic data of the user's ear is generated according to the change distribution corresponding to the capacitance value.

[0011] The present invention also provides a phase difference correction system for an audio signal by a smart headset, comprising: A collection module, used to collect characteristic data of the user's ear based on a preset built-in sensor of the smart headset, wherein the characteristic data specifically includes ear shape, ear size and ear auricle; A judgment module, used to judge whether the characteristic data is pre-recorded by the smart headset; an execution module, configured to, if not, analyze the sound propagation area of ​​the user's ear according to the ear image and measurement data pre-acquired by the smart headset, perform a frequency scan on the user's ear using a preset frequency of the smart headset, acquire a propagation path of the frequency in the user's ear, collect frequency parameters of the user's ear from the propagation path, and generate a frequency response curve of the user's ear, wherein the ear image specifically includes an auricle shape, an auricle curve, and an earlobe size, and the frequency parameters specifically include sound attenuation, sound enhancement, and sound distortion; A second judgment module is used to judge whether the frequency response curve detects a preset phase response difference; The second execution module is used to identify the phase correction value at different frequencies according to the frequency response curve, construct the correction curve of the user's ear based on the phase correction value, apply the correction curve to adjust the preset phase of the smart headset, and synchronously replace the preset filter content according to the characteristic data and the correction curve to generate personalized setting content for the user's ear for the smart headset, wherein the filter content specifically includes filter type, filter parameters and filter function.

[0012] Furthermore, it also includes: A construction module, used to collect point cloud data within a preset range of the user's ear using preset scanning content, and construct a virtual three-dimensional model of the user's ear based on the point cloud data; A third judgment module is used to judge whether the virtual three-dimensional model conforms to a preset three-dimensional surface; The third execution module is used to, if not, perform preset processing on the point cloud data, apply preset surface reconstruction content to generate a corresponding continuous three-dimensional model for the processed point cloud data, and extract the ear image and the measurement data from the continuous three-dimensional model, wherein the preset processing specifically includes cleaning processing, alignment processing and reconstruction processing.

[0013] Furthermore, the execution module includes: A transmitting unit, configured to transmit sound signals to the user's ears in sequence based on a preset range of the frequencies, wherein the sound signals specifically include pure frequency tones and frequency combinations; A determination unit, used to determine whether the sound signal can be returned from the user's ear and receive a preset amplitude content; The execution unit is used to calculate the amplitude value of each frequency point according to the amplitude content, identify the amplitude size between the various frequency points, collect the relative intensity of the sound signal at different frequency points according to the amplitude size, divide the relative intensity using the preset stage content, and generate the frequency response curve.

[0014] The present invention provides a method and system for correcting the phase difference of an audio signal by a smart headset, which has the following beneficial effects: The present invention can realize personalized correction of smart headphones by collecting characteristic data of user ears, including information such as shape, size and auricle, and generating frequency response curves and phase correction values ​​of user ears, so that the smart headphones can automatically adjust the phase of audio signals according to the ear characteristics of each user to ensure consistent performance in the ears of different users. At the same time, according to the characteristic data of the user's ear and the personalized correction curve, the filter content of the smart headphones, including type, parameters and functions, is synchronously adjusted, which can further optimize the audio processing effect of the smart headphones and provide a more personalized and user-friendly audio experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A schematic diagram of a flow chart of an embodiment of a method for correcting phase differences of audio signals by a smart headset of the present invention; Figure 2 The present invention is a block diagram of an embodiment of a phase difference correction system for audio signals of a smart headset. DETAILED DESCRIPTION

[0016] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. The implementation of the objectives, functional features and advantages of the present invention will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

[0017] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0018] Reference Figure 1 , is a method for correcting the phase difference of an audio signal by a smart headset in an embodiment of the present invention, comprising: S1: Based on the built-in sensor preset in the smart headset, collect characteristic data of the user's ear, wherein the characteristic data specifically includes ear shape, ear size and ear auricle; S2: Determine whether the characteristic data is pre-recorded by the smart headset; S3: If not, the sound propagation area of ​​the user's ear is analyzed according to the ear image and measurement data pre-acquired by the smart headset, the user's ear is frequency scanned using the preset frequency of the smart headset, the propagation path of the frequency in the user's ear is acquired, the frequency parameters of the user's ear are collected from the propagation path, and the frequency response curve of the user's ear is generated, wherein the ear image specifically includes the shape of the helix, the curve of the auricle and the size of the earlobe, and the frequency parameters specifically include sound attenuation, sound enhancement and sound distortion; S4: Determine whether the frequency response curve detects a preset phase response difference; S5: If so, identify the phase correction value at different frequencies according to the frequency response curve, construct the correction curve of the user's ear based on the phase correction value, apply the correction curve to adjust the preset phase of the smart headset, and synchronously replace the preset filter content according to the characteristic data and the correction curve to generate personalized setting content for the user's ear for the smart headset, wherein the filter content specifically includes filter type, filter parameters and filter function.

[0019] In this embodiment, the system is based on built-in sensors pre-installed in the smart headset, including a micro camera, an infrared sensor or a laser scanner. These sensors can be used to scan the user's ears, obtain their shape, size and possible features, and collect feature data of the user's ears. The feature data specifically includes ear shape, ear size and ear auricle. The system then determines whether these feature data have been pre-recorded by the smart headset to execute the corresponding steps; for example, when the system determines that the feature data of the user's ear has been pre-recorded by the smart headset, the system will consider that the smart headset has already recorded the relevant features of the user's ear, that is, there is no need to formulate relevant phase difference correction content for the user. The system will directly apply the filter content pre-set by the smart headset without adjusting it according to the feature data of the user's ear. These filter contents have been optimized to adapt to the ear characteristics of different users, thereby providing a better audio experience. At the same time, although the system does not need to perform phase difference correction, other settings such as volume or timbre parameters can still be adjusted according to the user's personal preferences and preferences. , which can help users get a more personalized and satisfactory audio experience, and the system can provide personalized suggestions or prompts based on the user's ear feature data that has been pre-recorded by the smart headset to help users make better use of the smart headset, such as providing suggestions on wearing methods and earplug selection to improve the comfort and quality of the audio experience; for example, when the system determines that the user's ear feature data has not been recorded by the smart headset, the system will consider that the user is wearing the smart headset for the first time, that is, it is necessary to formulate relevant phase difference correction content for the user. The system will pre-acquire the ear image and measurement data of the user's ear based on the smart headset. The ear image specifically includes the shape of the helix, the curve of the auricle and the size of the earlobe. By analyzing the sound propagation area of ​​the user's ear, the user's ear is frequency scanned using the pre-set frequency of the smart headset to obtain the frequency propagation path in the user's ear, and the frequency parameters in the user's ear are collected from these propagation paths. The frequency parameters specifically include sound attenuation, sound enhancement and sound distortion, and a unique frequency response curve for the user's ear is generated;The system can provide each user with a personalized audio experience by formulating phase difference correction content based on the characteristic data of the user's ear. That is, the phase of the audio signal is adjusted according to the characteristics of the user's auricle shape, size and earlobe size, so that the audio is more accurate and consistent when propagating in the user's ear, thereby providing sound quality that better meets the user's needs. At the same time, through frequency scanning and collecting frequency parameters in the user's ear, the system can generate an exclusive frequency response curve for the user's ear, which helps to optimize the audio output of the smart headset, improve the clarity, realism and balance of the audio, and allow users to enjoy higher quality music, voice and other audio content. In addition, since the phase difference correction content is based on the user's The system is formulated based on the user's personal auricle characteristics, so it can better adapt to the user's ear shape and size, reduce discomfort and fatigue, and help improve the comfort of users wearing smart headphones, so that they can enjoy audio content for a long time without feeling uncomfortable; then the system determines whether the user's exclusive frequency response curve detects the preset phase response difference to execute the corresponding steps; for example, when the system determines that the user's exclusive frequency response curve does not detect the preset phase response difference, the system will believe that the user's ear characteristics do not match the preset phase response difference, or the user's ears do not need phase correction, and the system will recheck and verify the user's ear feature data and frequency response The generation process of the response curve ensures the accuracy and reliability of the data, because there may be errors in the data collection or processing process, which need to be eliminated. At the same time, if it is detected that the user's ear feature data does not match the preset phase response difference, the system will reset the preset value, that is, re-adjust the preset phase difference correction content according to the user's actual auricle shape, size and characteristics to better adapt to the user's ear characteristics, and considering that each user's ear characteristics are unique and there may be certain individual differences, the system needs to consider and adapt to the ear characteristics of different users, rather than simply relying on the preset phase correction content; for example, when the system determines that the user's exclusive frequency When the frequency response curve detects a preset phase response difference, the system will consider that there is a certain difference between the user's ear characteristics and the preset phase difference, and corresponding correction processing is required. The system will identify the phase correction values ​​at different frequencies based on the frequency response curve, and build a correction curve for the user's ear based on each phase correction value. The correction curve is applied to adjust the pre-set phase of the smart headset, and the pre-set filter content is synchronously replaced according to the characteristic data of the user's ear and the correction curve. The filter content specifically includes the filter type, filter parameters and filter function, so as to generate the personalized setting content of the user's ear for the smart headset, that is, to formulate relevant phase difference correction content for the user;Based on the user's auricle feature data, the system can identify the phase correction values ​​at different frequencies, and build a user-specific correction curve based on these values. By applying these correction curves to the pre-set phase of the smart headset, personalized phase correction can be achieved for the user's ears, thereby ensuring the consistency and accuracy of the performance of the audio signal in the user's ears at different frequencies. At the same time, during the correction process, the system will adjust the filter content of the smart headset according to the user's auricle features and phase correction values, which helps to optimize the transmission and processing of audio signals, improve the clarity, accuracy and balance of the audio, and thus improve the audio quality. In addition, the personalized processing of phase difference correction can better adapt to the user's auricle features, reduce the discomfort and fatigue that may occur when wearing smart headsets, and help improve the user's wearing comfort, so that they can enjoy audio content for a long time without feeling uncomfortable. ;

[0020] In this embodiment, before step S3 of pre-acquiring the ear image and measurement data according to the smart headset, the method further includes: S301: using preset scanning content to collect point cloud data within a preset range of the user's ear, and constructing a virtual three-dimensional model of the user's ear based on the point cloud data; S302: Determine whether the virtual three-dimensional model conforms to a preset three-dimensional surface; S303: If not, the point cloud data is subjected to preset processing, and a preset surface reconstruction content is applied to generate a corresponding continuous three-dimensional model for the processed point cloud data, and the ear image and the measurement data are extracted from the continuous three-dimensional model, wherein the preset processing specifically includes cleaning processing, registration processing and reconstruction processing.

[0021] In this embodiment, the system uses a preset scanning content to collect point cloud data within a preset range of the user's ear, and constructs a virtual three-dimensional model of the user's ear based on the point cloud data. Then the system determines whether the virtual three-dimensional model conforms to the preset three-dimensional surface to execute the corresponding steps; for example, when the system determines that the point cloud data to construct the virtual three-dimensional model of the user's ear can conform to the preset three-dimensional surface, the system will consider that the actual shape of the user's ear is consistent with the preset standard model, or is within an acceptable error range. The system will confirm the accuracy and completeness of the point cloud data, and further check and verify the point cloud data to ensure that they can accurately reflect the actual shape of the user's auricle, and directly apply this model as a representative of the user's ear, that is, the system can use the model for subsequent processing and analysis, such as phase correction and filter adjustment, and the system can continuously monitor the user's feedback data during subsequent use, and further adjust and optimize the model as needed, and continuously improve the accuracy and realism of the model to improve the performance and user experience of the smart headset; for example, when the system determines that the point cloud data to construct the virtual three-dimensional model of the user's ear cannot conform to the preset three-dimensional surface, the system will consider that the actual shape of the user's ear is consistent with the preset standard model, or is within an acceptable error range. The system will confirm the accuracy and completeness of the point cloud data, and further check and verify the point cloud data to ensure that they can accurately reflect the actual shape of the user's auricle, and directly apply this model as a representative of the user's ear, that is, the system can use the model for subsequent processing and analysis, such as phase correction and filter adjustment, and the system can continuously monitor the user's feedback data during subsequent use, and further adjust and optimize the model as needed, and continuously improve the accuracy and realism of the model to improve the performance and user experience of the smart headset; When the system performs a pre-set surface on the point cloud data, the system will think that the actual shape of the user's ear does not conform to the preset standard model. The system will perform a pre-set processing on the point cloud data. The preset processing specifically includes cleaning processing, registration processing and reconstruction processing. The pre-set surface reconstruction content is used to generate a corresponding continuous three-dimensional model for the processed point cloud data, and the ear image and measurement data are extracted from the continuous three-dimensional model; the system can effectively improve the accuracy and quality of the data by performing pre-set processing on the point cloud data, including cleaning, registration and reconstruction steps, which helps to ensure that the finally generated continuous three-dimensional model can better reflect the actual auricle shape of the user, thereby improving the accuracy of subsequent processing and analysis. At the same time, applying the pre-set surface reconstruction content to generate a continuous three-dimensional model for the point cloud data can make the model more realistic and real, which helps the smart headset system to more accurately understand the user's auricle characteristics and provide a more reliable basis for subsequent personalized processing. In addition, the pre-set processing flow can reduce manual intervention to a certain extent and improve processing efficiency. That is, through the automated processing steps, the continuous three-dimensional model and related feature data of the user's ear can be obtained more quickly, providing a more convenient and efficient method for subsequent personalized processing and customization.

[0022] It should be noted that the point cloud data is subjected to a preset processing, and the preset processing specifically includes a cleaning process, a registration process, and a reconstruction process. Specific examples are as follows: Cleaning processing aims to remove noise, outliers or unnecessary parts in point cloud data to improve data quality and accuracy; for example, you can filter out points outside the measurement range of the distance sensor by setting a threshold, or remove noise by removing points with low density; Registration processing aims to fuse multiple point cloud data sets or data sets from different perspectives into a whole to obtain complete ear morphology information; for example, the point cloud data from different perspectives are aligned through the ICP (Iterative Closest Point) algorithm, or multiple data sets are registered using the feature matching algorithm, which can ensure that the coordinate systems between different data sets are consistent, making the final generated continuous 3D model more accurate and complete; Reconstruction processing aims to generate a continuous three-dimensional model from the processed point cloud data to represent the user's auricle shape; for example, a surface reconstruction algorithm can be used to convert the point cloud data into a continuous surface model, and a smooth and continuous three-dimensional surface can be automatically generated according to the density and distribution of the point cloud data. The final three-dimensional model can be used for subsequent analysis, visualization and processing.

[0023] In this embodiment, the step S3 of acquiring the propagation path of the frequency in the user's ear, collecting the frequency parameters of the user's ear from the propagation path, and generating the frequency response curve of the user's ear includes: S31: Based on the preset range of the frequency, transmitting sound signals to the user's ears in sequence, wherein the sound signals specifically include frequency pure tones and frequency combinations; S32: Determine whether the sound signal can be returned from the user's ear and receive a preset amplitude content; S33: If possible, the amplitude value of each frequency point is calculated according to the amplitude content, the amplitude size between the various frequency points is identified, the relative intensity of the sound signal at different frequency points is collected according to the amplitude size, the relative intensity is divided using the preset stage content, and the frequency response curve is generated.

[0024] In this embodiment, the system transmits sound signals to the user's ears in sequence based on a preset frequency range. The sound signals specifically include pure frequency tones and frequency combinations. The system then determines whether the sound signal can be returned from the user's ear and receive the preset amplitude content to execute the corresponding steps. For example, when the system determines that the sound signal transmitted to the user's ear cannot be returned from the user's ear and receive the preset amplitude content, the system will consider that there is an interruption or loss in signal transmission, resulting in the system being unable to recover the preset amplitude content from the user's ear. The system will check the transmission path of the sound signal, including the transmission from the smart headset to the ear. The system optimizes the path of the sound signal emitted to the user's ear and the path from the user's ear back to the system, ensuring that these paths are not blocked or interfered by any obstacles. At the same time, the sound signal emission method is optimized, such as adjusting the volume, frequency or direction of the emitted sound to ensure that the sound can be effectively transmitted to the user's ear. The user is advised to check the state of the ear by himself, such as whether there is earplug or earwax that causes the sound signal to be unable to be correctly transmitted or received. For example, when the system determines that the sound signal emitted to the user's ear can be returned from the user's ear and receive the preset amplitude content, the system will consider that the sound signal can be transmitted and received normally, and the system The system will calculate the amplitude value of each frequency point according to the amplitude content, identify the amplitude size between each frequency point, collect the relative strength of the sound signal at different frequency points according to different amplitude sizes, and divide the relative strength using the pre-set stage content to generate a user's exclusive frequency response curve; the system calculates the amplitude value of each frequency point according to the sound signal returned by the user's ear, identifies the amplitude size between each frequency point, and the system can generate a user's exclusive frequency response curve. Such a curve can more accurately reflect the user's perception and reception ability of sounds of different frequencies, thereby achieving personalized audio adjustment and optimization. At the same time, according to the user's exclusive frequency response curve, the system can make more precise adjustments and optimizations to the audio signal, that is, by understanding the user's auditory characteristics at different frequencies, the system can divide the relative strength according to the pre-set stage content, thereby adjusting the frequency response of the audio signal to make it more in line with the user's auditory needs and preferences, and the personalized frequency response curve can improve the user's perception and experience of audio. By adjusting according to the user's auditory characteristics, the system can optimize the transmission and performance of the audio signal in the user's ears, so that the user can enjoy music, voice or other sound content more clearly and comfortably.

[0025] It should be noted that a specific example of calculating the amplitude value of each frequency point according to the amplitude content is as follows: Suppose there is a sound signal with a duration of 1 second and a sampling rate of 44100 Hz (the standard audio sampling rate), which means that the signal consists of 44100 samples. First, the sound signal needs to be preprocessed, including removing the DC component and applying a windowing function to reduce spectrum leakage. After completing the necessary preprocessing, a clean sound signal can be obtained. Next, the discrete Fourier transform (DFT) is applied to convert the time domain signal into a frequency domain signal. For a signal with 44100 sampling points, we will get a spectrum array of length 44100, which contains the frequency domain representation of the signal. For each frequency point, its amplitude value can be calculated. Assuming that the frequency range is 0 Hz to 22050 Hz (half the sampling rate, i.e., the Nyquist frequency), the amplitude of each frequency point can be calculated. Assuming that the amplitude value at 1000 Hz needs to be calculated, first find the index of the frequency point closest to 1000 Hz in the frequency array, and then get the amplitude value of the frequency point from the spectrum array, i.e., this value represents the amplitude of the signal at 1000 Hz.

[0026] In this embodiment, the step S5 of identifying the phase correction values ​​at different frequencies according to the frequency response curve further includes: S51: collecting frequency points to be phase corrected from the frequency response curve, and calculating phase correction values ​​corresponding to the frequency points using a preset correction algorithm; S52: Determine whether the phase correction value matches the usage scenario preset by the user; S53: If not, a corresponding coverage frequency range is generated based on the correction curve, the usage scenario is selected within the coverage frequency range to calibrate the frequency of the smart headset, and the preset listening frequency range of the smart headset is switched, wherein the listening frequency range specifically includes a low frequency range, a mid-frequency range and a high frequency range.

[0027] In this embodiment, the system collects each frequency point to be phase corrected from the frequency response curve, applies a pre-set correction algorithm to calculate the phase correction values ​​corresponding to these frequency points, and then the system determines whether the phase correction value matches the user's pre-set usage scenario to execute the corresponding steps; for example, when the system determines that the phase correction value corresponding to the frequency point can match the user's pre-set usage scenario, the system will consider that the phase correction required by the user has been met, and the system can continue to operate according to the user's preset usage scenario. The system will adjust the sound signal according to these phase correction values ​​to ensure that the transmission and performance in the user's ears meet the user's preset usage scenario, and provide feedback to the user to inform that the phase correction has been successfully applied and that the sound signal has been adjusted according to the user's preset usage scenario, which can enhance the user's confidence and satisfaction with the system operation, and once the phase correction is completed and confirmed, the system can continue to perform subsequent operations, such as playing music or making calls, to meet the user's needs and expectations; for example, when the system determines that the phase correction value corresponding to the frequency point cannot match the user's pre-set usage scenario, the system will consider that the user's The smart headset cannot provide the phase correction. The system will generate a corresponding coverage frequency range based on the correction curve, select the usage scenario selected by the user within the coverage frequency range to correct the frequency of the smart headset, and finally switch the pre-set listening frequency range of the smart headset, which specifically includes a low frequency range, a medium frequency range, and a high frequency range. Although the system cannot fully match the usage scenario pre-set by the user, the coverage frequency range generated based on the correction curve and the selected usage scenario can still provide a hearing experience closer to the user's expectations, which can enhance the user's satisfaction with the smart headset and let them feel the value of personalized customization. At the same time, by correcting the frequency of the smart headset within the coverage frequency range and switching the listening frequency range according to the usage scenario selected by the user, the system meets the user's hearing needs as much as possible. Even if it cannot fully match the user's expectations, the system still tries its best to provide the most appropriate hearing settings, and despite the problem of phase correction not being able to match, the alternative solution provided by the system can still significantly improve the user's hearing experience, that is, through personalized frequency correction and listening frequency range adjustment, the smart headset can better adapt to the user's hearing characteristics and provide clearer and more comfortable sound perception.

[0028] It should be noted that the specific examples are as follows: The phase correction is calculated using a simple linear interpolation algorithm, assuming the phase response of the user's ear is measured at the following frequencies: 100 Hz: Phase response is -30°; 500 Hz: Phase response is -45°; 1000 Hz: Phase response is -60°; The standard phase response is: 100 Hz: Phase response is -20°; 500 Hz: Phase response is -35°; 1000 Hz: Phase response is -50°; Perform phase difference analysis and calculate the phase difference at each frequency point: 100 Hz: Phase difference = -30° - (-20°) = -10°; 500 Hz: Phase difference = -45° - (-35°) = -10°; 1000 Hz: Phase difference = -60° - (-50°) = -10°; Select the linear interpolation algorithm to calculate the phase correction value: 100 Hz: Phase correction value = -10°; 500 Hz: Phase correction value = -10°; 1000 Hz: Phase correction value = -10°; Based on the calculated phase correction value, a correction curve is generated. In the range of 100 Hz to 1000 Hz, the phase correction value is kept constant at -10°. The correction curve is applied to the phase response of the smart headset: For a 100 Hz audio signal, a phase correction value of -10° is applied; For a 500 Hz audio signal, a phase correction value of -10° is applied; For a 1000 Hz audio signal, a phase correction value of -10° is applied; In summary, by applying a preset correction algorithm to calculate the phase correction value corresponding to the frequency point, the system can accurately adjust the phase response of the smart headset to make it closer to the standard response, which helps to improve the accuracy and clarity of the audio signal and enhance the user's listening experience.

[0029] In this embodiment, before step S5 of constructing the correction curve of the user's ear based on the phase correction value, the method further includes: S501: Based on the frequency range covered by the calibration curve, collecting frequency axis information of the calibration curve, wherein the frequency axis information specifically includes a slope and a curvature; S502: Determine whether the frequency axis information meets the correction effect preset by the user; S503: If not, receiving the real-time instructions input by the user to the smart headset, dynamically adjusting the preset amplitude and preset order of the correction curve according to the correction effect, generating the correction log information of the correction curve by the user according to the dynamic adjustment content, and recording the usage scenarios and application requirements of the correction curve by the user in the correction log information, wherein the amplitude is specifically the height of the peak or valley value of the correction curve, and the order is specifically the complexity and flexibility of the correction curve.

[0030] In this embodiment, the system collects frequency axis information of the correction curve based on the frequency range covered by the correction curve, and the frequency axis information specifically includes slope and curvature. Then the system determines whether the frequency axis information meets the correction effect pre-set by the user to execute the corresponding steps; for example, when the system determines that the frequency axis information of the correction curve can meet the correction effect pre-set by the user, the system will consider that the smart headset has successfully adjusted the frequency axis according to the user's expectations to provide an auditory experience that meets the user's expectations. The system will adjust the frequency response of the smart headset according to the correction curve to ensure that the transmission and performance in the user's ears meet the correction effect pre-set by the user, and provide feedback to the user to inform that the correction curve has been successfully applied, that is, the smart headset has been adjusted according to the user's expectations, which can enhance the user's confidence and satisfaction with the system operation, and once the correction curve is successfully applied and confirmed, the system can continue to perform subsequent operations, such as playing music or making calls, to meet the user's needs and expectations; for example, when the system determines that the frequency axis information of the correction curve cannot meet the correction effect pre-set by the user, the system will consider that the smart headset cannot adjust the frequency axis according to the user's expectations. The system receives the real-time instructions input by the user to the smart headset, and dynamically adjusts the amplitude and order of the correction curve according to the correction effect. The amplitude is specifically the height of the peak or valley of the correction curve, and the order is specifically the complexity and flexibility of the correction curve. The correction log information of the user for the correction curve is generated according to the dynamic adjustment content, and the user's usage scenarios and application requirements for the correction curve are recorded in these correction log information; by receiving the real-time instructions of the user and dynamically adjusting the correction curve according to the correction effect, the system can respond to the user's needs in a timely manner, so as to ensure that the smart headset provides an auditory experience that meets the user's expectations under different usage scenarios and application requirements. At the same time, according to the real-time instructions and correction effect of the user, the system can dynamically adjust the amplitude and order of the correction curve to optimize the correction effect, so as to ensure that the correction curve can more accurately match the user's expected correction effect and provide more accurate hearing correction. The system generates the correction log information of the user for the correction curve, and records the user's usage scenarios and application requirements for the correction curve, which helps the system understand the user's preferences and habits, that is, this information can be used to optimize the correction algorithm of the smart headset and provide the user with more personalized hearing settings.

[0031] In this embodiment, the step S4 of determining whether the frequency response curve detects a preset phase response difference includes: S41: Acquire a phase response corresponding to the measurement data based on a phase angle preset by the smart headset; S42: Determine whether the phase response matches a standard response preset by the smart headset; S43: If not, then collect the phase difference of the phase response at different frequencies, identify the trend data of the phase difference, and detect the regular content of the phase difference from the trend data, wherein the regular content is specifically a repetitive pattern or anomaly within the frequency range.

[0032] In this embodiment, the system obtains the phase response corresponding to the measurement data based on the phase angle preset by the smart headset, and then the system determines whether these phase responses match the standard response preset by the smart headset to execute the corresponding steps; for example, when the system determines that the phase response of the measurement data can match the standard response preset by the smart headset, the system will consider that the smart headset has successfully corrected the phase response so that the audio signal performs consistently in the ears of different users. The system will adjust the phase response of the smart headset according to the measurement data to ensure that the audio signal performs consistently in the ears of different users, and verify the effect of the correction to ensure that the performance of the audio signal in the ears of different users is indeed consistent with expectations, such as playing a series of audio samples and checking their auditory effects in the ears of different users, and providing feedback to the user to inform that the correction has been successfully applied and that the audio signal performs consistently in the ears of different users, which can enhance the user's confidence and satisfaction with the operation of the system; for example, when the system determines that the phase response of the measurement data does not match the standard response preset by the smart headset, the system will consider that the phase response of the smart headset has successfully corrected the phase response so that the audio signal performs consistently in the ears of different users. When the smart headset has a pre-set standard response, the system will think that the smart headset has not corrected the phase response. The system will collect the phase difference of the phase response at different frequencies, identify the trend data of the phase difference, and detect the regular content of the phase difference from these trend data. The regular content is specifically a repetitive pattern or anomaly within the frequency range; by collecting the phase difference of the phase response at different frequencies and identifying its trend data, the system can more accurately locate the root cause of the phase difference problem, which helps the system understand why the phase response of the measured data does not match the preset standard response, so as to solve the problem in a targeted manner. At the same time, by detecting the regular content of the phase difference, the system can find repetitive patterns or anomalies within the frequency range, which helps the system understand the causes of the phase difference, so as to help formulate more effective correction strategies and optimize the phase response of the smart headset, and the identified regular content can be used to optimize the correction algorithm to better adapt to the changing trend of the phase difference, which can improve the accuracy and stability of the correction, thereby improving the auditory performance of the smart headset.

[0033] In this embodiment, the step S1 of collecting characteristic data of the user's ear based on the preset built-in sensor of the smart headset includes: S11: using a capacitive sensor preset in the smart headset to identify a contact distance between the user's ear and the capacitive sensor; S12: Determine whether the contact distance reaches a preset distance; S13: If yes, detect the contact area corresponding to the auricle, collect capacitance values ​​based on the contact area using the capacitive sensor, and generate characteristic data of the user's ear according to the change distribution corresponding to the capacitance values.

[0034] In this embodiment, the system uses a capacitive sensor pre-installed in the smart headset to identify the contact distance between the user's ear and the capacitive sensor, and then the system determines whether the contact distance reaches a preset distance to execute corresponding steps; for example, when the system determines that the contact distance between the user's ear and the capacitive sensor does not reach the preset distance, the system will consider that the user is not wearing the smart headset correctly, that is, the smart headset cannot perform the corresponding feature detection function, and the system will provide a prompt to the user to put on the smart headset again to ensure good contact, including through voice prompts, mobile phone application notifications or LED indicator lights on the smart headset, and issue a warning when incorrect wearing is detected, which can help the user adjust the wearing position in time to ensure the normal use of the smart headset; for example, when the system determines that the contact distance between the user's ear and the capacitive sensor has reached a preset distance, At this time, the system will assume that the user has worn the smart headset correctly, and the system will detect the contact area corresponding to the auricle, and use the capacitive sensor to collect the capacitance value based on the contact area, and generate the characteristic data of the user's ear according to the change distribution of the capacitance value; by detecting the contact area corresponding to the auricle and collecting the capacitance value, the system can more accurately obtain the shape and structural characteristics of the user's auricle, which helps the smart headset to more accurately adapt to the user's ear shape and provide a more fitting wearing experience. At the same time, using the data collected by the capacitive sensor, the system can more accurately identify the contact area of ​​the auricle and generate accurate characteristic data, which helps to improve the accuracy and reliability of feature detection, thereby improving the performance and user experience of the smart headset, and by analyzing the change distribution of the capacitance value, the system can evaluate the sensitivity and response performance of the capacitive sensor in different areas, which helps to optimize the sensor design and algorithm and improve the accuracy and stability of the smart headset.

[0035] Reference Figure 2 , is a phase difference correction system for audio signals by a smart headset in one embodiment of the present invention, comprising: The acquisition module 10 is used to collect characteristic data of the user's ear based on the preset built-in sensor of the smart headset, wherein the characteristic data specifically includes ear shape, ear size and ear auricle; A determination module 20, configured to determine whether the characteristic data is pre-recorded by the smart headset; The execution module 30 is used to, if not, analyze the sound propagation area of ​​the user's ear according to the ear image and measurement data pre-acquired by the smart headset, perform frequency scanning on the user's ear using the preset frequency of the smart headset, obtain the propagation path of the frequency in the user's ear, collect the frequency parameters of the user's ear from the propagation path, and generate a frequency response curve of the user's ear, wherein the ear image specifically includes the shape of the helix, the curve of the auricle, and the size of the earlobe, and the frequency parameters specifically include sound attenuation, sound enhancement, and sound distortion; A second judgment module 40 is used to judge whether a preset phase response difference is detected in the frequency response curve; The second execution module 50 is used to identify the phase correction value at different frequencies according to the frequency response curve, construct the correction curve of the user's ear based on the phase correction value, apply the correction curve to adjust the preset phase of the smart headset, and synchronously replace the preset filter content according to the characteristic data and the correction curve to generate personalized setting content of the user's ear for the smart headset, wherein the filter content specifically includes filter type, filter parameters and filter function.

[0036] In this embodiment, the acquisition module 10 is based on the built-in sensors pre-set in the smart headset, including a micro camera, an infrared sensor or a laser scanner. These sensors can be used to scan the user's ears, obtain their shape, size and possible features, and collect feature data of the user's ears. The feature data specifically includes ear shape, ear size and ear auricle. Then the judgment module 20 determines whether these feature data have been pre-recorded by the smart headset to execute the corresponding steps; for example, when the system determines that the feature data of the user's ear has been pre-recorded by the smart headset, the system will consider that the smart headset has already recorded the relevant features of the user's ear, that is, there is no need to formulate relevant phase difference correction content for the user. The system will directly apply the filter content pre-set by the smart headset without adjusting it according to the feature data of the user's ear. These filter contents have been optimized to adapt to the ear characteristics of different users, thereby providing a better audio experience. At the same time, although the system does not need to perform phase difference correction, other settings such as volume or timbre can still be adjusted according to the user's personal preferences and preferences. Parameters, which can help users get a more personalized and satisfactory audio experience, and the system can provide personalized suggestions or prompts based on the user's ear feature data that has been pre-recorded by the smart headset to help users make better use of the smart headset, such as providing suggestions on wearing methods and earplug selection to improve the comfort and quality of the audio experience; for example, when the system determines that the feature data of the user's ear has not been recorded by the smart headset, the execution module 30 will consider that the user is wearing the smart headset for the first time, that is, it is necessary to formulate relevant phase difference correction content for the user, and the system will pre-acquire the ear image and measurement data of the user's ear based on the smart headset. The ear image specifically includes the shape of the helix, the curve of the auricle and the size of the earlobe. By analyzing the sound propagation area of ​​the user's ear, the user's ear is frequency scanned using the preset frequency of the smart headset to obtain the frequency propagation path in the user's ear, and the frequency parameters in the user's ear are collected from these propagation paths. The frequency parameters specifically include sound attenuation, sound enhancement and sound distortion, and a unique frequency response curve for the user's ear is generated;The system can provide each user with a personalized audio experience by formulating phase difference correction content based on the characteristic data of the user's ear. That is, the phase of the audio signal is adjusted according to the characteristics of the user's auricle shape, size and earlobe size, so that the audio is more accurate and consistent when propagating in the user's ear, thereby providing sound quality that better meets the user's needs. At the same time, through frequency scanning and collecting frequency parameters in the user's ear, the system can generate an exclusive frequency response curve for the user's ear, which helps to optimize the audio output of the smart headset and improve the clarity, realism and balance of the audio, so that users can enjoy higher quality music, voice and other audio content. In addition, since the phase difference correction content is based on the user's individual The earphones are designed based on the characteristics of the human auricle, so they can better adapt to the shape and size of the user's ears, reduce discomfort and fatigue, and help improve the comfort of the user wearing the smart headphones, so that the user can enjoy the audio content for a long time without feeling uncomfortable; then the second judgment module 40 judges whether the user's exclusive frequency response curve detects the preset phase response difference to execute the corresponding steps; for example, when the system determines that the user's exclusive frequency response curve does not detect the preset phase response difference, the system will think that the user's ear characteristics do not match the preset phase response difference, or the user's ears do not need phase correction, and the system will recheck and verify the characteristic data and frequency response of the user's ear. The generation process of the response curve ensures the accuracy and reliability of the data, because there may be errors in the data collection or processing process, and these factors need to be eliminated. At the same time, if it is detected that the user's ear feature data does not match the preset phase response difference, the system will reset the preset value, that is, re-adjust the preset phase difference correction content according to the user's actual auricle shape, size and characteristics to better adapt to the user's ear characteristics, and considering that each user's ear characteristics are unique and there may be certain individual differences, the system needs to consider and adapt to the ear characteristics of different users, rather than simply relying on the preset phase correction content; for example, when the system determines that the user's exclusive frequency response When the curve detects a preset phase response difference, the second execution module 50 will consider that there is a certain difference between the user's ear characteristics and the preset phase difference, and corresponding correction processing is required. The system will identify the phase correction values ​​at different frequencies based on the frequency response curve, and build a correction curve for the user's ear based on each phase correction value. The correction curve is applied to adjust the pre-set phase of the smart headset, and the pre-set filter content is synchronously replaced according to the characteristic data of the user's ear and the correction curve. The filter content specifically includes the filter type, filter parameters and filter function, so as to generate the personalized setting content of the user's ear for the smart headset, that is, to formulate relevant phase difference correction content for the user;Based on the user's auricle feature data, the system can identify the phase correction values ​​at different frequencies, and build a user-specific correction curve based on these values. By applying these correction curves to the pre-set phase of the smart headset, personalized phase correction can be achieved for the user's ears, thereby ensuring the consistency and accuracy of the performance of the audio signal in the user's ears at different frequencies. At the same time, during the correction process, the system will adjust the filter content of the smart headset according to the user's auricle features and phase correction values, which helps to optimize the transmission and processing of audio signals, improve the clarity, accuracy and balance of the audio, and thus improve the audio quality. In addition, the personalized processing of phase difference correction can better adapt to the user's auricle features, reduce the discomfort and fatigue that may occur when wearing smart headsets, and help improve the user's wearing comfort, so that they can enjoy audio content for a long time without feeling uncomfortable. ;

[0037] In this embodiment, it also includes: A construction module, used to collect point cloud data within a preset range of the user's ear using preset scanning content, and construct a virtual three-dimensional model of the user's ear based on the point cloud data; A third judgment module is used to judge whether the virtual three-dimensional model conforms to a preset three-dimensional surface; The third execution module is used to, if not, perform preset processing on the point cloud data, apply preset surface reconstruction content to generate a corresponding continuous three-dimensional model for the processed point cloud data, and extract the ear image and the measurement data from the continuous three-dimensional model, wherein the preset processing specifically includes cleaning processing, alignment processing and reconstruction processing.

[0038] In this embodiment, the system uses a preset scanning content to collect point cloud data within a preset range of the user's ear, and constructs a virtual three-dimensional model of the user's ear based on the point cloud data. Then the system determines whether the virtual three-dimensional model conforms to the preset three-dimensional surface to execute the corresponding steps; for example, when the system determines that the point cloud data to construct the virtual three-dimensional model of the user's ear can conform to the preset three-dimensional surface, the system will consider that the actual shape of the user's ear is consistent with the preset standard model, or is within an acceptable error range. The system will confirm the accuracy and completeness of the point cloud data, and further check and verify the point cloud data to ensure that they can accurately reflect the actual shape of the user's auricle, and directly apply this model as a representative of the user's ear, that is, the system can use the model for subsequent processing and analysis, such as phase correction and filter adjustment, and the system can continuously monitor the user's feedback data during subsequent use, and further adjust and optimize the model as needed, and continuously improve the accuracy and realism of the model to improve the performance and user experience of the smart headset; for example, when the system determines that the point cloud data to construct the virtual three-dimensional model of the user's ear cannot conform to the preset three-dimensional surface, the system will consider that the actual shape of the user's ear is consistent with the preset standard model, or is within an acceptable error range. The system will confirm the accuracy and completeness of the point cloud data, and further check and verify the point cloud data to ensure that they can accurately reflect the actual shape of the user's auricle, and directly apply this model as a representative of the user's ear, that is, the system can use the model for subsequent processing and analysis, such as phase correction and filter adjustment, and the system can continuously monitor the user's feedback data during subsequent use, and further adjust and optimize the model as needed, and continuously improve the accuracy and realism of the model to improve the performance and user experience of the smart headset; When the system performs a pre-set surface on the point cloud data, the system will think that the actual shape of the user's ear does not conform to the preset standard model. The system will perform a pre-set processing on the point cloud data. The preset processing specifically includes cleaning processing, registration processing and reconstruction processing. The pre-set surface reconstruction content is used to generate a corresponding continuous three-dimensional model for the processed point cloud data, and the ear image and measurement data are extracted from the continuous three-dimensional model; the system can effectively improve the accuracy and quality of the data by performing pre-set processing on the point cloud data, including cleaning, registration and reconstruction steps, which helps to ensure that the finally generated continuous three-dimensional model can better reflect the actual auricle shape of the user, thereby improving the accuracy of subsequent processing and analysis. At the same time, applying the pre-set surface reconstruction content to generate a continuous three-dimensional model for the point cloud data can make the model more realistic and real, which helps the smart headset system to more accurately understand the user's auricle characteristics and provide a more reliable basis for subsequent personalized processing. In addition, the pre-set processing flow can reduce manual intervention to a certain extent and improve processing efficiency. That is, through the automated processing steps, the continuous three-dimensional model and related feature data of the user's ear can be obtained more quickly, providing a more convenient and efficient method for subsequent personalized processing and customization.

[0039] In this embodiment, the execution module includes: A transmitting unit, configured to transmit sound signals to the user's ears in sequence based on a preset range of the frequencies, wherein the sound signals specifically include pure frequency tones and frequency combinations; A determination unit, used to determine whether the sound signal can be returned from the user's ear and receive a preset amplitude content; The execution unit is used to calculate the amplitude value of each frequency point according to the amplitude content, identify the amplitude size between the various frequency points, collect the relative intensity of the sound signal at different frequency points according to the amplitude size, divide the relative intensity using the preset stage content, and generate the frequency response curve.

[0040] In this embodiment, the system transmits sound signals to the user's ears in sequence based on a preset frequency range. The sound signals specifically include pure frequency tones and frequency combinations. The system then determines whether the sound signal can be returned from the user's ear and receive the preset amplitude content to execute the corresponding steps. For example, when the system determines that the sound signal transmitted to the user's ear cannot be returned from the user's ear and receive the preset amplitude content, the system will consider that there is an interruption or loss in signal transmission, resulting in the system being unable to recover the preset amplitude content from the user's ear. The system will check the transmission path of the sound signal, including the transmission from the smart headset to the ear. The system optimizes the path of the sound signal emitted to the user's ear and the path from the user's ear back to the system, ensuring that these paths are not blocked or interfered by any obstacles. At the same time, the sound signal emission method is optimized, such as adjusting the volume, frequency or direction of the emitted sound to ensure that the sound can be effectively transmitted to the user's ear. The user is advised to check the state of the ear by himself, such as whether there is earplug or earwax that causes the sound signal to be unable to be correctly transmitted or received. For example, when the system determines that the sound signal emitted to the user's ear can be returned from the user's ear and receive the preset amplitude content, the system will consider that the sound signal can be transmitted and received normally, and the system The system will calculate the amplitude value of each frequency point according to the amplitude content, identify the amplitude size between each frequency point, collect the relative strength of the sound signal at different frequency points according to different amplitude sizes, and divide the relative strength using the pre-set stage content to generate a user's exclusive frequency response curve; the system calculates the amplitude value of each frequency point according to the sound signal returned by the user's ear, identifies the amplitude size between each frequency point, and the system can generate a user's exclusive frequency response curve. Such a curve can more accurately reflect the user's perception and reception ability of sounds of different frequencies, thereby achieving personalized audio adjustment and optimization. At the same time, according to the user's exclusive frequency response curve, the system can make more precise adjustments and optimizations to the audio signal, that is, by understanding the user's auditory characteristics at different frequencies, the system can divide the relative strength according to the pre-set stage content, thereby adjusting the frequency response of the audio signal to make it more in line with the user's auditory needs and preferences, and the personalized frequency response curve can improve the user's perception and experience of audio. By adjusting according to the user's auditory characteristics, the system can optimize the transmission and performance of the audio signal in the user's ears, so that the user can enjoy music, voice or other sound content more clearly and comfortably.

[0041] In this embodiment, the second execution module includes: A calculation unit, used to collect frequency points to be phase corrected from the frequency response curve, and calculate phase correction values ​​corresponding to the frequency points using a preset correction algorithm; A second judgment unit, used to judge whether the phase correction value matches the usage scenario preset by the user; The second execution unit is used to generate a corresponding coverage frequency range based on the correction curve if not, select the usage scenario within the coverage frequency range to calibrate the frequency of the smart headset, and switch the preset listening frequency range of the smart headset, wherein the listening frequency range specifically includes a low frequency range, a medium frequency range and a high frequency range.

[0042] In this embodiment, the system collects each frequency point to be phase corrected from the frequency response curve, applies a pre-set correction algorithm to calculate the phase correction values ​​corresponding to these frequency points, and then the system determines whether the phase correction value matches the user's pre-set usage scenario to execute the corresponding steps; for example, when the system determines that the phase correction value corresponding to the frequency point can match the user's pre-set usage scenario, the system will consider that the phase correction required by the user has been met, and the system can continue to operate according to the user's preset usage scenario. The system will adjust the sound signal according to these phase correction values ​​to ensure that the transmission and performance in the user's ears meet the user's preset usage scenario, and provide feedback to the user to inform that the phase correction has been successfully applied and that the sound signal has been adjusted according to the user's preset usage scenario, which can enhance the user's confidence and satisfaction with the system operation, and once the phase correction is completed and confirmed, the system can continue to perform subsequent operations, such as playing music or making calls, to meet the user's needs and expectations; for example, when the system determines that the phase correction value corresponding to the frequency point cannot match the user's pre-set usage scenario, the system will consider that the user's The smart headset cannot provide the phase correction. The system will generate a corresponding coverage frequency range based on the correction curve, select the usage scenario selected by the user within the coverage frequency range to correct the frequency of the smart headset, and finally switch the pre-set listening frequency range of the smart headset, which specifically includes a low frequency range, a medium frequency range, and a high frequency range. Although the system cannot fully match the usage scenario pre-set by the user, the coverage frequency range generated based on the correction curve and the selected usage scenario can still provide a hearing experience closer to the user's expectations, which can enhance the user's satisfaction with the smart headset and let them feel the value of personalized customization. At the same time, by correcting the frequency of the smart headset within the coverage frequency range and switching the listening frequency range according to the usage scenario selected by the user, the system meets the user's hearing needs as much as possible. Even if it cannot fully match the user's expectations, the system still tries its best to provide the most appropriate hearing settings, and despite the problem of phase correction not being able to match, the alternative solution provided by the system can still significantly improve the user's hearing experience, that is, through personalized frequency correction and listening frequency range adjustment, the smart headset can better adapt to the user's hearing characteristics and provide clearer and more comfortable sound perception.

[0043] In this embodiment, it also includes: A second acquisition module, configured to acquire frequency axis information of the calibration curve based on the frequency range covered by the calibration curve, wherein the frequency axis information specifically includes a slope and a curvature; A fourth judgment module, used to judge whether the frequency axis information meets the correction effect preset by the user; a fourth execution module, for, if not, receiving real-time instructions input by the user to the smart headset, dynamically adjusting the preset amplitude and preset order of the correction curve according to the correction effect, generating correction log information of the correction curve by the user according to the dynamic adjustment content, and recording the user's usage scenarios and application requirements of the correction curve in the correction log information, wherein the amplitude is specifically the height of the peak or valley value of the correction curve, and the order is specifically the complexity and flexibility of the correction curve.

[0044] In this embodiment, the system collects frequency axis information of the correction curve based on the frequency range covered by the correction curve, and the frequency axis information specifically includes slope and curvature. Then the system determines whether the frequency axis information meets the correction effect pre-set by the user to execute the corresponding steps; for example, when the system determines that the frequency axis information of the correction curve can meet the correction effect pre-set by the user, the system will consider that the smart headset has successfully adjusted the frequency axis according to the user's expectations to provide an auditory experience that meets the user's expectations. The system will adjust the frequency response of the smart headset according to the correction curve to ensure that the transmission and performance in the user's ears meet the correction effect pre-set by the user, and provide feedback to the user to inform that the correction curve has been successfully applied, that is, the smart headset has been adjusted according to the user's expectations, which can enhance the user's confidence and satisfaction with the system operation, and once the correction curve is successfully applied and confirmed, the system can continue to perform subsequent operations, such as playing music or making calls, to meet the user's needs and expectations; for example, when the system determines that the frequency axis information of the correction curve cannot meet the correction effect pre-set by the user, the system will consider that the smart headset cannot adjust the frequency axis according to the user's expectations. The system receives the real-time instructions input by the user to the smart headset, and dynamically adjusts the amplitude and order of the correction curve according to the correction effect. The amplitude is specifically the height of the peak or valley of the correction curve, and the order is specifically the complexity and flexibility of the correction curve. The correction log information of the user for the correction curve is generated according to the dynamic adjustment content, and the user's usage scenarios and application requirements for the correction curve are recorded in these correction log information; by receiving the real-time instructions of the user and dynamically adjusting the correction curve according to the correction effect, the system can respond to the user's needs in a timely manner, so as to ensure that the smart headset provides an auditory experience that meets the user's expectations under different usage scenarios and application requirements. At the same time, according to the real-time instructions and correction effect of the user, the system can dynamically adjust the amplitude and order of the correction curve to optimize the correction effect, so as to ensure that the correction curve can more accurately match the user's expected correction effect and provide more accurate hearing correction. The system generates the correction log information of the user for the correction curve, and records the user's usage scenarios and application requirements for the correction curve, which helps the system understand the user's preferences and habits, that is, this information can be used to optimize the correction algorithm of the smart headset and provide the user with more personalized hearing settings.

[0045] In this embodiment, the second determination module further includes: An acquisition unit, configured to acquire a phase response corresponding to the measurement data based on a phase angle preset by the smart headset; A third judgment unit, used to judge whether the phase response matches a standard response preset by the smart headset; The third execution unit is used to collect the phase difference of the phase response at different frequencies, identify the trend data of the phase difference, and detect the regular content of the phase difference from the trend data, wherein the regular content is specifically a repetitive pattern or anomaly within the frequency range.

[0046] In this embodiment, the system obtains the phase response corresponding to the measurement data based on the phase angle preset by the smart headset, and then the system determines whether these phase responses match the standard response preset by the smart headset to execute the corresponding steps; for example, when the system determines that the phase response of the measurement data can match the standard response preset by the smart headset, the system will consider that the smart headset has successfully corrected the phase response so that the audio signal performs consistently in the ears of different users. The system will adjust the phase response of the smart headset according to the measurement data to ensure that the audio signal performs consistently in the ears of different users, and verify the effect of the correction to ensure that the performance of the audio signal in the ears of different users is indeed consistent with expectations, such as playing a series of audio samples and checking their auditory effects in the ears of different users, and providing feedback to the user to inform that the correction has been successfully applied and that the audio signal performs consistently in the ears of different users, which can enhance the user's confidence and satisfaction with the operation of the system; for example, when the system determines that the phase response of the measurement data does not match the standard response preset by the smart headset, the system will consider that the phase response of the smart headset has successfully corrected the phase response so that the audio signal performs consistently in the ears of different users. When the smart headset has a pre-set standard response, the system will think that the smart headset has not corrected the phase response. The system will collect the phase difference of the phase response at different frequencies, identify the trend data of the phase difference, and detect the regular content of the phase difference from these trend data. The regular content is specifically a repetitive pattern or anomaly within the frequency range; by collecting the phase difference of the phase response at different frequencies and identifying its trend data, the system can more accurately locate the root cause of the phase difference problem, which helps the system understand why the phase response of the measured data does not match the preset standard response, so as to solve the problem in a targeted manner. At the same time, by detecting the regular content of the phase difference, the system can find repetitive patterns or anomalies within the frequency range, which helps the system understand the causes of the phase difference, so as to help formulate more effective correction strategies and optimize the phase response of the smart headset, and the identified regular content can be used to optimize the correction algorithm to better adapt to the changing trend of the phase difference, which can improve the accuracy and stability of the correction, thereby improving the auditory performance of the smart headset.

[0047] In this embodiment, the acquisition module further includes: An identification unit, configured to use a capacitive sensor preset in the smart headset to identify a contact distance between the user's ear and the capacitive sensor; A fourth determination unit, used to determine whether the contact distance reaches a preset distance; The fourth execution unit is used to detect the contact area corresponding to the auricle, apply the capacitive sensor to collect capacitance values ​​based on the contact area, and generate characteristic data of the user's ear according to the change distribution corresponding to the capacitance values.

[0048] In this embodiment, the system uses a capacitive sensor pre-installed in the smart headset to identify the contact distance between the user's ear and the capacitive sensor, and then the system determines whether the contact distance reaches a preset distance to execute corresponding steps; for example, when the system determines that the contact distance between the user's ear and the capacitive sensor does not reach the preset distance, the system will consider that the user is not wearing the smart headset correctly, that is, the smart headset cannot perform the corresponding feature detection function, and the system will provide a prompt to the user to put on the smart headset again to ensure good contact, including through voice prompts, mobile phone application notifications or LED indicator lights on the smart headset, and issue a warning when incorrect wearing is detected, which can help the user adjust the wearing position in time to ensure the normal use of the smart headset; for example, when the system determines that the contact distance between the user's ear and the capacitive sensor has reached a preset distance, At this time, the system will assume that the user has worn the smart headset correctly, and the system will detect the contact area corresponding to the auricle, and use the capacitive sensor to collect the capacitance value based on the contact area, and generate the characteristic data of the user's ear according to the change distribution of the capacitance value; by detecting the contact area corresponding to the auricle and collecting the capacitance value, the system can more accurately obtain the shape and structural characteristics of the user's auricle, which helps the smart headset to more accurately adapt to the user's ear shape and provide a more fitting wearing experience. At the same time, using the data collected by the capacitive sensor, the system can more accurately identify the contact area of ​​the auricle and generate accurate characteristic data, which helps to improve the accuracy and reliability of feature detection, thereby improving the performance and user experience of the smart headset, and by analyzing the change distribution of the capacitance value, the system can evaluate the sensitivity and response performance of the capacitive sensor in different areas, which helps to optimize the sensor design and algorithm and improve the accuracy and stability of the smart headset.

[0049] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for correcting the phase difference of an audio signal by a smart headset, characterized in that: The following steps are involved: Based on the built-in sensor preset in the smart headset, the characteristic data of the user's ear is collected, wherein the characteristic data specifically includes the ear shape, ear size and ear auricle; Determining whether the characteristic data is pre-recorded by the smart headset; If not, the sound propagation area of ​​the user's ear is analyzed according to the ear image and measurement data pre-acquired by the smart headset, the user's ear is frequency scanned using the preset frequency of the smart headset, the propagation path of the frequency in the user's ear is acquired, the frequency parameters of the user's ear are collected from the propagation path, and the frequency response curve of the user's ear is generated, wherein the ear image specifically includes the shape of the helix, the curve of the auricle and the size of the earlobe, and the frequency parameters specifically include sound attenuation, sound enhancement and sound distortion; Determining whether a preset phase response difference is detected in the frequency response curve; If so, the phase correction value at different frequencies is identified according to the frequency response curve, the correction curve of the user's ear is constructed based on the phase correction value, the preset phase of the smart headset is adjusted by applying the correction curve, and the preset filter content is synchronously replaced according to the characteristic data and the correction curve to generate personalized setting content for the user's ear for the smart headset, wherein the filter content specifically includes filter type, filter parameters and filter function.

2. The method for correcting the phase difference of an audio signal by a smart headset according to claim 1, characterized in that: Before the step of pre-acquiring the ear image and measurement data according to the smart headset, the method further includes: Using preset scanning content to collect point cloud data within a preset range of the user's ear, and constructing a virtual three-dimensional model of the user's ear based on the point cloud data; Determining whether the virtual three-dimensional model conforms to a preset three-dimensional surface; If not, the point cloud data is subjected to preset processing, and the preset surface reconstruction content is applied to generate a corresponding continuous three-dimensional model for the processed point cloud data, and the ear image and the measurement data are extracted from the continuous three-dimensional model, wherein the preset processing specifically includes cleaning processing, alignment processing and reconstruction processing.

3. The method for correcting the phase difference of an audio signal by a smart headset according to claim 1, characterized in that: The step of obtaining the propagation path of the frequency in the user's ear, collecting the frequency parameters of the user's ear from the propagation path, and generating the frequency response curve of the user's ear includes: Based on the preset range of the frequency, transmitting sound signals to the user's ears in sequence, wherein the sound signals specifically include pure frequency tones and frequency combinations; Determining whether the sound signal can be returned from the user's ear and receive a preset amplitude content; If possible, the amplitude value of each frequency point is calculated according to the amplitude content, the amplitude size between the various frequency points is identified, the relative intensity of the sound signal at different frequency points is collected according to the amplitude size, the relative intensity is divided using the preset stage content, and the frequency response curve is generated.

4. The method for correcting the phase difference of an audio signal by a smart headset according to claim 1, characterized in that: The step of identifying the phase correction values ​​at different frequencies according to the frequency response curve further includes: Collecting frequency points to be phase corrected from the frequency response curve, and calculating phase correction values ​​corresponding to the frequency points using a preset correction algorithm; Determining whether the phase correction value matches the usage scenario preset by the user; If not, a corresponding coverage frequency range is generated based on the correction curve, the usage scenario is selected within the coverage frequency range to calibrate the frequency of the smart headset, and the preset listening frequency range of the smart headset is switched, wherein the listening frequency range specifically includes a low frequency range, a mid-frequency range and a high frequency range.

5. The method for correcting the phase difference of an audio signal by a smart headset according to claim 1, characterized in that: Before the step of constructing the correction curve of the user's ear based on the phase correction value, the method further includes: Based on the frequency range covered by the calibration curve, collecting frequency axis information of the calibration curve, wherein the frequency axis information specifically includes a slope and a curvature; Determining whether the frequency axis information meets the correction effect preset by the user; If not, receive the real-time instructions input by the user to the smart headset, dynamically adjust the preset amplitude and preset order of the correction curve according to the correction effect, generate the user's correction log information for the correction curve based on the dynamic adjustment content, and record the user's usage scenarios and application requirements for the correction curve in the correction log information, wherein the amplitude specifically refers to the height of the peak or valley value of the correction curve, and the order specifically refers to the complexity and flexibility of the correction curve.

6. The method for correcting the phase difference of an audio signal by a smart headset according to claim 1, characterized in that: The step of determining whether the frequency response curve detects a preset phase response difference includes: Based on the phase angle preset by the smart headset, obtaining a phase response corresponding to the measurement data; Determining whether the phase response matches a standard response preset by the smart headset; If not, then collect the phase difference of the phase response at different frequencies, identify the trend data of the phase difference, and detect the regular content of the phase difference from the trend data, wherein the regular content is specifically a repetitive pattern or anomaly within the frequency range.

7. The method for correcting the phase difference of an audio signal by a smart headset according to claim 1, characterized in that: The step of collecting characteristic data of the user's ear based on the preset built-in sensor of the smart headset includes: Using a capacitive sensor preset in the smart headset to identify the contact distance between the user's ear and the capacitive sensor; Determining whether the contact distance reaches a preset distance; If so, the contact area corresponding to the auricle is detected, and the capacitance value is collected by applying the capacitive sensor based on the contact area, and the characteristic data of the user's ear is generated according to the change distribution corresponding to the capacitance value.

8. A phase difference correction system for audio signals by smart headphones, characterized in that: include: A collection module, used to collect characteristic data of the user's ear based on a preset built-in sensor of the smart headset, wherein the characteristic data specifically includes ear shape, ear size and ear auricle; A judgment module, used to judge whether the characteristic data is pre-recorded by the smart headset; an execution module, configured to, if not, analyze the sound propagation area of ​​the user's ear according to the ear image and measurement data pre-acquired by the smart headset, perform a frequency scan on the user's ear using a preset frequency of the smart headset, acquire a propagation path of the frequency in the user's ear, collect frequency parameters of the user's ear from the propagation path, and generate a frequency response curve of the user's ear, wherein the ear image specifically includes an auricle shape, an auricle curve, and an earlobe size, and the frequency parameters specifically include sound attenuation, sound enhancement, and sound distortion; A second judgment module is used to judge whether the frequency response curve detects a preset phase response difference; The second execution module is used to identify the phase correction value at different frequencies according to the frequency response curve, construct the correction curve of the user's ear based on the phase correction value, apply the correction curve to adjust the preset phase of the smart headset, and synchronously replace the preset filter content according to the characteristic data and the correction curve to generate personalized setting content for the user's ear for the smart headset, wherein the filter content specifically includes filter type, filter parameters and filter function.

9. The phase difference correction system for audio signals by smart earphones according to claim 8, characterized in that: Also includes: A construction module, used to collect point cloud data within a preset range of the user's ear using preset scanning content, and construct a virtual three-dimensional model of the user's ear based on the point cloud data; A third judgment module is used to judge whether the virtual three-dimensional model conforms to a preset three-dimensional surface; The third execution module is used to, if not, perform preset processing on the point cloud data, apply preset surface reconstruction content to generate a corresponding continuous three-dimensional model for the processed point cloud data, and extract the ear image and the measurement data from the continuous three-dimensional model, wherein the preset processing specifically includes cleaning processing, alignment processing and reconstruction processing.

10. The phase difference correction system for audio signals by smart earphones according to claim 8, characterized in that: The execution module includes: A transmitting unit, configured to transmit sound signals to the user's ears in sequence based on a preset range of the frequencies, wherein the sound signals specifically include pure frequency tones and frequency combinations; A determination unit, used to determine whether the sound signal can be returned from the user's ear and receive a preset amplitude content; The execution unit is used to calculate the amplitude value of each frequency point according to the amplitude content, identify the amplitude size between the various frequency points, collect the relative intensity of the sound signal at different frequency points according to the amplitude size, divide the relative intensity using the preset stage content, and generate the frequency response curve.

Images