Audio processing method and system of wearable acoustic equipment

Abstract

The invention provides an audio processing method and system for wearable acoustic equipment, and belongs to the technical field of audio processing, and the method comprises the steps: calculating the equipment wearing fitting degree of the acoustic equipment based on a contact pressure data sequence of the acoustic equipment and the auricle of a target user, a device offset angle of the acoustic device relative to the auricle of the user is calculated based on the spatial attitude data of the acoustic device. And determining a dynamic leakage transfer function based on the equipment wearing fit degree and the equipment deviation angle. And calculating an environment compensation coefficient based on the environment parameters. And predicting a leakage signal mixed in the initial acoustic signal based on the dynamic leakage transfer function and the environmental compensation coefficient. Extracting pure environment noise from the initial acoustic signal based on the leakage signal, generating a noise reduction parameter based on the pure environment noise, and performing audio noise reduction processing on the acoustic equipment based on the noise reduction parameter. According to the audio processing method and system of the wearable acoustic equipment, the audio leakage signal prediction accuracy can be improved, and the audio noise reduction effect of the open type wearable acoustic equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of audio processing technology, and more specifically, to an audio processing method and system for wearable acoustic devices. Background Art

[0002] With the continuous development of wearable technology, users' demand for sound quality and auditory experience is increasing. Traditional noise reduction devices often use closed designs. While they can effectively reduce ambient noise, they reduce the user's connection to the outside world and even pose safety risks. Existing technologies have conducted preliminary research on open-type wearable noise reduction devices. However, current research still suffers from inaccurate calculation of leakage signals, resulting in poor audio noise reduction effects. Summary of the Invention

[0003] The purpose of this application is to provide an audio processing method and system for wearable acoustic devices to improve the accuracy of leakage signal prediction and thereby improve the audio noise reduction effect of wearable acoustic devices.

[0004] According to a first aspect of an embodiment of the present application, there is provided an audio processing method for a wearable acoustic device, comprising: Calculating the fit of the acoustic device based on a contact pressure data sequence between the acoustic device and the target user's auricle, and calculating the device offset angle of the acoustic device relative to the user's auricle based on spatial posture data of the acoustic device; the contact pressure data sequence is monitored by pressure sensors provided at different device contact points, and the spatial posture data is monitored by an IMU sensor; Determining a dynamic leakage transfer function based on the device wearing fit and the device offset angle; and calculating an environmental compensation coefficient based on environmental parameters; The leakage signal mixed in the initial acoustic signal is predicted based on the dynamic leakage transfer function and the environmental compensation coefficient; the pure environmental noise is extracted from the initial acoustic signal based on the leakage signal, a noise reduction parameter is generated based on the pure environmental noise, and audio noise reduction processing is performed on the acoustic device based on the noise reduction parameter.

[0005] According to a second aspect of an embodiment of the present application, there is provided an audio processing system for a wearable acoustic device, comprising: A device wearing analysis module is configured to calculate the fit of the acoustic device based on a contact pressure data sequence between the acoustic device and the target user's auricle, and to calculate the device offset angle of the acoustic device relative to the user's auricle based on the acoustic device's spatial posture data; the contact pressure data sequence is monitored by pressure sensors located at different device contact points, and the spatial posture data is monitored by an IMU sensor; a leakage compensation calculation module, configured to determine a dynamic leakage transfer function based on the wear fit of the device and the device offset angle; and calculate an environmental compensation coefficient based on environmental parameters; The noise reduction module is used to predict the leakage signal mixed in the initial acoustic signal based on the dynamic leakage transfer function and the environmental compensation coefficient; extract pure environmental noise from the initial acoustic signal based on the leakage signal, generate noise reduction parameters based on the pure environmental noise, and perform audio noise reduction processing on the acoustic device based on the noise reduction parameters.

[0006] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein when the processor executes the computer program, the steps of the audio processing method of the wearable acoustic device are implemented.

[0007] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the audio processing method of the wearable acoustic device are implemented.

[0008] The beneficial effects of the audio processing method and system for wearable acoustic devices provided in the embodiments of the present application are as follows: the embodiments of the present application calculate the wearing fit of the device through the contact pressure data monitored by the pressure sensor, and determine the dynamic leakage transfer function in combination with the device offset angle obtained by the IMU sensor, which can more accurately predict the leakage signal. Compared with the existing technology, the accuracy of the prediction of the leakage signal is improved, thereby effectively improving the noise reduction effect, allowing users to obtain a quiet auditory environment even in open-type wearing conditions.

[0009] The embodiment of this application retains the advantages of open devices connecting to the outside world, avoids the safety risks brought by closed designs, and optimizes sound quality. Using environmental parameters to calculate the compensation coefficient can make the device adapt to different environments and enhance the adaptability and stability of noise reduction. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0011] Figure 1 A schematic flow chart of an audio processing method for a wearable acoustic device provided in one embodiment of the present application; Figure 2A structural block diagram of an audio processing system for a wearable acoustic device provided in one embodiment of the present application; Figure 3 A schematic block diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0012] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0013] In order to make the purpose, technical solutions and advantages of this application clearer, specific embodiments will be described below with reference to the accompanying drawings.

[0014] Please refer to Figure 1 , Figure 1 This is a flowchart of an audio processing method for a wearable acoustic device provided in an embodiment of the present application. The method may include S101 to S103.

[0015] S101: Calculate the fit of the acoustic device based on a series of contact pressure data between the acoustic device and the target user's auricle, and calculate the device offset angle of the acoustic device relative to the user's auricle based on the spatial posture data of the acoustic device. The contact pressure data series is monitored by pressure sensors installed at different device contact points, and the spatial posture data is monitored by an IMU sensor.

[0016] In this embodiment, the device offset angle includes a horizontal offset angle and a vertical offset angle.

[0017] Calculating a device offset angle of the acoustic device relative to the user's auricle based on the spatial posture data of the acoustic device, including: The device coordinate system is used to calculate the horizontal and vertical offset angles of the acoustic device relative to the user's auricle based on the spatial posture data of the acoustic device.

[0018] The device coordinate system uses the sound output direction of the acoustic device's speaker as the positive Z-axis direction, the geometric center of the user's auricle as the origin, and the horizontal direction parallel to the user's head as the positive X-axis direction.

[0019] In this embodiment, the contact pressure data sequence is a series of pressure data monitored by pressure sensors installed at different contact points between the acoustic device and the user's auricle. The contact pressure data sequence can reflect the change in the pressure of each contact point between the acoustic device and the auricle over time. The device wearing fit is used to quantify the degree of fit between the acoustic device and the target user's auricle. The spatial posture data is monitored by an inertial measurement unit (IMU) sensor and is used to describe the posture of the device in space. For example, the IMU can have a built-in accelerometer, gyroscope, and magnetometer, and the spatial posture data can include the pitch angle, yaw angle, and roll angle of the acoustic device.

[0020] The device offset angle can include horizontal and vertical offset angles, which represent the horizontal and vertical deviation angles of the acoustic device relative to the user's auricle. The device coordinate system is a coordinate system established to determine the position and orientation of the acoustic device in space. The device coordinate system uses the sound output direction of the acoustic device's speaker as the positive Z-axis direction, the geometric center of the user's auricle as the origin, the horizontal direction parallel to the user's head as the positive X-axis direction, and the upward direction perpendicular to the XZ plane as the positive Y-axis direction.

[0021] The pressure sensor in this embodiment monitors contact pressure data sequences and uses a specific algorithm to calculate the fit of the device to determine how tightly the device fits the auricle. The IMU sensor monitors the device's spatial posture data and, using the device coordinate system, converts this data into horizontal and vertical offset angles relative to the user's auricle to determine the device's posture.

[0022] The fit of the device affects sound leakage, and the offset angle affects the sound propagation path and noise reduction effectiveness. By monitoring parameters such as the fit and offset angle in real time, this embodiment can dynamically adjust the noise reduction strategy based on the user's actual wearing situation, improving the noise reduction effect and user experience.

[0023] For example, in open wearable headphones, the position and fit of the headphones will change when the user is exercising. This embodiment calculates the device wearing fit and offset angle by real-time monitoring of the contact pressure data sequence and spatial posture data. If the device wearing fit decreases, it means that the headphones are loose. At this time, the noise reduction effect can be appropriately enhanced to compensate for the possible increased leakage. If a large horizontal offset of the headphones is detected, the output direction of the noise reduction signal can be adjusted to ensure that the noise reduction effect is not affected, so that users can enjoy clear sound quality and good noise reduction experience while exercising.

[0024] S102: Determine a dynamic leakage transfer function based on the device wearing fit and the device offset angle, and calculate an environmental compensation coefficient based on environmental parameters.

[0025] In this embodiment, the dynamic leakage transfer function (DLTF) reflects how the characteristics of the speaker signal leaking into the microphone change with wearer status. The value of the DLTF changes dynamically with factors such as the fit of the device and the device offset angle. The environmental compensation coefficient adjusts the characteristics of the leakage signal in different environments, primarily used to correct for the impact of environmental factors on the leakage signal.

[0026] In this embodiment, both the wearing state of the acoustic device and environmental factors affect the leakage and propagation of speaker sound. This embodiment adjusts the amplitude and phase of the leakage signal based on the device's wearing fit and offset angle, and then modifies its propagation characteristics in combination with environmental parameters, thereby predicting more accurate acoustic signal leakage. By determining a dynamic leakage transfer function and an environmental compensation coefficient, this embodiment can more accurately predict the leakage signal, improve the accuracy of extracting pure ambient noise from mixed signals, and enhance the noise reduction effect.

[0027] S103: Predicting a leakage signal mixed in the initial acoustic signal based on the dynamic leakage transfer function and the environmental compensation coefficient. Extracting pure environmental noise from the initial acoustic signal based on the leakage signal, generating noise reduction parameters based on the pure environmental noise, and performing audio noise reduction processing on the acoustic device based on the noise reduction parameters.

[0028] In this embodiment, predicting the leakage signal mixed in the initial acoustic signal based on the dynamic leakage transfer function and the environment compensation coefficient includes: The leakage transfer characteristic is calculated based on the dynamic leakage transfer function and the environmental compensation coefficient.

[0029] The initial acoustic signal and the leakage transfer characteristic are multiplied to obtain the leakage signal mixed in the initial acoustic signal.

[0030] In this embodiment, extracting pure ambient noise from the initial acoustic signal based on the leakage signal includes: The leakage signal is subtracted from the initial acoustic signal to obtain the pure ambient noise.

[0031] In this embodiment, the leakage transfer characteristic can reflect the leakage characteristics of the initial acoustic signal in the current wearing state and environment, including amplitude and phase information. The initial acoustic signal refers to the original mixed acoustic signal received by the microphone, which includes the ambient noise and the sound signal leaked from the speaker to the microphone. The leakage signal is the part of the sound signal leaked from the speaker to the microphone mixed in the initial acoustic signal. Pure ambient noise refers to the signal containing only real ambient noise obtained by removing the leakage signal from the initial acoustic signal containing the leakage signal and ambient noise. The noise reduction parameters are generated based on the pure ambient noise and are used to control the acoustic device to perform noise reduction operations.

[0032] For example, when a user wears open headphones to listen to music, part of the sound emitted by the speaker will leak into the microphone outside the acoustic device. This part of the leaked sound is mixed with the ambient noise, which will cause the microphone to misjudge it as part of the ambient noise, resulting in a deviation in the noise reduction algorithm and poor noise reduction effect. This embodiment uses a dynamic leakage transfer function and an environmental compensation coefficient to simulate the leakage of the initial acoustic signal during the propagation process, obtain the leakage transfer characteristics, and then predict the leakage signal. This embodiment subtracts the leakage signal from the initial acoustic signal to extract pure ambient noise. Based on the characteristics of the pure ambient noise, corresponding noise reduction parameters are generated for subsequent noise reduction processing.

[0033] For example, if the acoustic device is tilted, the sound leakage path will change. When the wind speed is high, the propagation of sound leakage will be affected. In this embodiment, pressure sensors are set at different contact points between the acoustic device and the user's auricle to continuously monitor the contact pressure data sequence. At the same time, this embodiment also uses an IMU sensor to collect the spatial posture data of the acoustic device, including pitch angle, yaw angle, and roll angle. In addition, environmental sensors are used to collect environmental parameters such as temperature, humidity, air pressure, etc.

[0034] This embodiment uses a specific algorithm to calculate the fit of the device based on the contact pressure data sequence collected by the pressure sensor, thereby determining the tightness of the device's fit against the auricle. This embodiment uses the device coordinate system to convert the spatial posture data collected by the IMU sensor into the horizontal and vertical offset angles of the acoustic device relative to the user's auricle to determine the device's posture.

[0035] This embodiment adjusts the amplitude and phase of the leakage signal according to the wearing fit of the device and the device offset angle, and determines the dynamic leakage transfer function. At the same time, this embodiment calculates the environmental compensation coefficient in combination with the environmental parameters to correct the characteristics of the leakage signal in different environments. This embodiment combines the dynamic leakage transfer function and the environmental compensation coefficient to calculate the leakage transfer characteristics. This embodiment uses the leakage transfer characteristics to predict the leakage signal mixed in the initial acoustic signal. By subtracting the leakage signal from the initial acoustic signal, the pure environmental noise can be extracted. In this way, the corresponding noise reduction parameters can be generated by analyzing the characteristics of the pure environmental noise, and the noise reduction parameters can be applied to the acoustic device to control the speaker to emit a reverse sound wave with an opposite phase and equal amplitude to the environmental noise to achieve a noise reduction effect.

[0036] During this process, this embodiment monitors the device's fit, offset angle, and environmental parameters in real time. Based on the dynamic changes in these parameters, the dynamic leakage transfer function, environmental compensation coefficient, and noise reduction parameters are adjusted in a timely manner to ensure that the acoustic device achieves optimal noise reduction under various wearing conditions and environmental conditions.

[0037] As can be seen from the above, open-type devices cannot be physically sealed and suffer from sound leakage. Active sound leakage must be offset to allow the noise reduction algorithm to focus on ambient noise. This embodiment calculates the device's fit using contact pressure data monitored by a pressure sensor, and combines this with the device's offset angle obtained by an IMU sensor to determine a dynamic leakage transfer function. This more accurately predicts leakage signals compared to existing technologies, improving the accuracy of leakage signal predictions and effectively enhancing audio noise reduction, allowing users to enjoy a quiet listening environment even when wearing open-type devices.

[0038] This embodiment retains the advantages of open devices with external connectivity, avoids the safety risks associated with closed designs, and optimizes sound quality. By monitoring the wearing status and environmental parameters in real time and dynamically adjusting the sound leakage prediction algorithm, this embodiment achieves more precise cancellation. This addresses the issue of fixed audio noise reduction parameters in traditional solutions that cannot adapt to wearer changes, thereby improving the audio noise reduction effect.

[0039] In one embodiment of the present application, the contact pressure data sequence includes contact pressure data subsequences monitored by various pressure sensors within the same time period.

[0040] The device wearing fit of the acoustic device is calculated based on a contact pressure data sequence between the acoustic device and the target user's auricle, including: The contact pressure data sequence is substituted into the fit calculation function to calculate the device wearing fit of the acoustic device.

[0041] The fit calculation function is:

[0042] Where C represents the fit of the device, n represents the total number of pressure sensors, represents the weight coefficient corresponding to the i-th pressure sensor, represents the contact pressure data subsequence collected by the i-th pressure sensor, Represents the maximum contact pressure data that can be monitored by the i-th pressure sensor.

[0043] In this embodiment, the value range of the device wearing fit is 0~1, where 0 means completely loose and 1 means tight fit. The pressure sensor data refers to the real-time pressure value of each contact point, which is collected by multiple piezoresistive sensors distributed at contact points such as ear hooks and earplugs, and can reflect the local contact force. The weight coefficient refers to the contribution weight of the sensor position to the fit, such as the weight of the tragus contact point, the weight of the anti-tragus contact point, etc. The sum of the weight coefficients corresponding to multiple pressure sensors is 1, which is preset by the device structure design. The maximum contact pressure refers to the maximum measurable pressure calibrated by each pressure sensor, which is used for normalization processing to eliminate the difference in the pressure sensor range. The dynamic leakage transfer function can reflect the leakage characteristics of the speaker signal to the external microphone, such as amplitude attenuation, phase shift, etc., which can change dynamically with the wearing state.

[0044] In this embodiment, the fit calculation function calculates fit through weighted averaging. A higher fit indicates a smaller gap between the speaker and the auricle, resulting in lower sound leakage. The weight coefficients corresponding to different pressure sensors are used to quantify the contribution of different contact points to the device's fit. This determination requires a combination of ergonomics, device structural design, and measured data.

[0045] For example, the main support areas such as the tragus and antitragus are contact points that have a great impact on the stability of the device. The pressure changes at these locations directly determine whether the device is loose, and their weights should be relatively higher (such as 0.3-0.4). The weight coefficients corresponding to secondary contact points such as the edge of the ear hook and the auxiliary support points on the outside of the auricle should be relatively low (such as 0.1-0.2) because they have less impact on the fit. If the contact points close to the speaker or microphone are loose, it will significantly increase sound leakage, and their weight coefficients need to be higher than those far away from the core acoustic components. The weights of sensors in left and right symmetrical positions should be equal, such as the weights of the left and right ear hook contact points are both 0.25 to ensure that the fit calculation is not biased towards one side.

[0046] For example, it is assumed that pressure sensors are installed at the three key positions where the acoustic device contacts the auricle, the antitragus, and the tail of the ear hook, and the contact area corresponding to each sensor is marked, such as Sensor1 corresponds to the tragus, Sensor2 corresponds to the antitragus, and Sensor3 corresponds to the tail of the ear hook. This embodiment preliminarily assigns weights based on the importance of the auricle support structure, such as a weight coefficient of 0.4 for the tragus, a weight coefficient of 0.3 for the antitragus, and a weight coefficient of 0.3 for the ear hook. When the user wears the acoustic device for the first time, the pressure value of each pressure sensor is recorded and the initial fit is calculated. This embodiment plays a calibration signal and measures the leakage amplitude. If the difference between the measured leakage amplitude and the predicted leakage amplitude is higher than a preset threshold, the weight coefficient is fine-tuned to ensure that the difference between the measured value and the predicted value meets the preset conditions. This embodiment collects user wearing data for a long time, and dynamically adjusts the weight coefficient to adapt to individual auricle differences through the LMS algorithm or reinforcement learning. For example, the weight of the tragus contact point of user J is gradually optimized to 0.45 because the pressure change at this position is more sensitive.

[0047] For example, Sensor 1 (tragus contact point): It has high anatomical importance. The sound leakage test shows that for every 1N increase in pressure, the sound leakage amplitude decreases by 0.6dB. The weight coefficient is 0.45. Sensor 2 (contact point on the tragus): key position for horizontal support. For every 1N increase in pressure, the sound leakage amplitude decreases by 0.5dB. The weight coefficient is 0.40. Sensor 3 (earhook tail): Auxiliary support. Pressure changes have little effect on sound leakage. For every 1N increase in pressure, the sound leakage amplitude decreases by 0.2dB. The weighting coefficient is 0.15.

[0048] Reasonable weight distribution can improve the correlation between fit and actual sound leakage amplitude. This embodiment optimizes the weights to reduce the fluctuation of noise reduction depth when open-back headphones are worn loosely, thereby improving the user's subjective experience.

[0049] This embodiment employs weighted fusion of pressure data from multiple contact points to avoid errors from a single sensor and accurately identify changes in the tightness of the device. This embodiment also differentiates the contribution of each contact point to fit through weight coefficients, ensuring that the fit calculation meets the mechanical stability requirements of the device. This embodiment can adapt to different users' auricle shapes and wearing habits, providing basic parameters that match the actual wearing state for subsequent leakage compensation, thereby enhancing the noise reduction system's robustness to changes in wearing state.

[0050] In one embodiment of the present application, determining a dynamic leakage transfer function based on a device wearing fit and a device offset angle includes: The baseline leakage transfer function is obtained based on the simulated auricle model.

[0051] Calculates the leakage amplitude compensation factor based on the device fit.

[0052] A propagation path difference from a speaker to a microphone of the acoustic device is calculated based on the device offset angle, and an angular phase compensation factor is calculated based on the propagation path difference.

[0053] A dynamic leakage transfer function is determined based on the reference leakage transfer function, the leakage amplitude compensation factor, and the angular phase compensation factor.

[0054] In this embodiment, the dynamic leakage transfer function is:

[0055] in, represents the dynamic leakage transfer function, C represents the fit of the device, f represents the sound frequency of the initial acoustic signal, α represents the horizontal offset angle, β represents the vertical offset angle, represents the fit amplitude compensation factor, represents the baseline leakage transfer function, represents the angle phase compensation factor, and j represents the imaginary unit.

[0056] In this embodiment, the simulated auricle model is a mathematical model that simulates the acoustic properties of a real auricle. Parameters include auricle shape, size, and material acoustic properties. The wind speed compensation factor is used to compensate for high-frequency attenuation. Higher wind speeds result in greater high-frequency leakage attenuation. The temperature compensation factor is used to correct for sound velocity. Increasing temperature increases sound velocity and reduces phase shift. The air pressure compensation factor is used to compensate for low-frequency attenuation. Lower air pressure increases low-frequency attenuation.

[0057] Exemplarily, this embodiment constructs a simulated auricle model based on parameters in a standard wearing state, plays a broadband swept frequency signal on the simulated auricle model, collects the outer microphone signal, and calculates a baseline leakage transfer function as a standard reference function for leakage characteristics. When the fit decreases, the fit amplitude compensation factor increases, and the actual leakage amplitude increases compared to the compensation amplitude in the baseline leakage transfer function, further compensating for the increased sound leakage caused by looseness. When the offset angle changes, the phase is adjusted by the angle phase compensation factor to ensure that the noise cancellation signal is aligned with the leakage phase.

[0058] This embodiment constructs a dynamic leakage transfer function by combining the device wearing fit and the device offset angle. It can dynamically compensate for the amplitude and phase changes of speaker leakage, accurately predict the sound leakage characteristics under different wearing conditions, and solve the problem of noise reduction failure caused by looseness and tilt of the device. It significantly improves the accuracy and stability of noise reduction in complex scenarios, allowing open devices to achieve efficient noise reduction while maintaining environmental awareness.

[0059] In one embodiment of the present application, the environmental parameters include wind speed, temperature and air pressure.

[0060] Calculate the environmental compensation coefficient based on environmental parameters, including: Substitute wind speed, temperature and air pressure into the environmental compensation function to obtain the environmental compensation coefficient.

[0061] The environmental compensation function is:

[0062] in, represents the environmental compensation coefficient, f represents the sound frequency of the initial acoustic signal, env represents the environmental parameter, v represents the wind speed, T represents the temperature, and P represents the air pressure. represents the wind speed compensation factor, represents the temperature compensation factor, Indicates the air pressure compensation factor.

[0063] In this embodiment, the environment compensation function multiplies the three compensation factors to obtain a comprehensive environment compensation coefficient, which is used to modify the dynamic leakage transfer function to ensure that the sound leakage signal prediction conforms to the sound wave propagation law in the current environment.

[0064] For example, high-speed airflow introduces turbulent noise and alters the propagation path of high-frequency sound waves, causing additional attenuation or distortion in the sound leakage signals collected by the outer microphones. Sound velocity varies with temperature, and temperature differences can cause phase delays in sound wave propagation, affecting the phase alignment accuracy of the noise cancellation signal. Air pressure changes affect air density, which in turn alters the attenuation characteristics of low-frequency sound waves. Low-density air attenuates low-frequency signals more significantly.

[0065] Traditional open noise reduction equipment does not take into account the dynamic changes of environmental parameters, and the sound leakage model is fixed, resulting in increased sound leakage prediction deviation and reduced noise reduction effect in outdoor scenes such as strong winds, high and low temperatures, and plateaus. This embodiment ensures that the noise reduction system can work stably under different climatic conditions by compensating for high-frequency sound leakage attenuation through wind speed compensation, correcting the effect of sound velocity changes on phase through temperature correction, and adjusting low-frequency leakage characteristics through air pressure adjustment. This embodiment responds to the impact of environmental changes on sound leakage propagation in real time, avoids leakage signal prediction deviations caused by fluctuations in environmental parameters, and improves the separation accuracy of environmental noise and sound leakage in mixed signals; this embodiment provides a unified cross-environmental noise reduction framework for open equipment, solves the performance fluctuation problem of traditional solutions caused by environmental differences, and ensures that the noise reduction effect is not significantly affected by external conditions.

[0066] The audio processing method of the wearable acoustic device corresponding to the above embodiment, Figure 2 This is a structural block diagram of an audio processing system for a wearable acoustic device provided in one embodiment of the present application. For ease of illustration, only the parts related to the embodiment of the present application are shown. Figure 2 The audio processing system 20 of the wearable acoustic device includes: a device wearing analysis module 21, a leakage compensation calculation module 22 and a noise reduction module 23.

[0067] The device wear analysis module 21 is configured to calculate the fit of the acoustic device based on the contact pressure data sequence between the acoustic device and the target user's auricle, and to calculate the device offset angle of the acoustic device relative to the user's auricle based on the acoustic device's spatial posture data. The contact pressure data sequence is monitored by pressure sensors installed at different device contact points, and the spatial posture data is monitored by an IMU sensor.

[0068] The leakage compensation calculation module 22 is configured to determine a dynamic leakage transfer function based on the device wearing fit and the device offset angle, and calculate an environmental compensation coefficient based on environmental parameters.

[0069] The noise reduction module 23 is configured to predict a leakage signal mixed in the initial acoustic signal based on the dynamic leakage transfer function and the environmental compensation coefficient. The module extracts pure environmental noise from the initial acoustic signal based on the leakage signal, generates noise reduction parameters based on the pure environmental noise, and performs audio noise reduction processing on the acoustic device based on the noise reduction parameters.

[0070] In one embodiment of the present application, the contact pressure data sequence includes contact pressure data subsequences monitored by each pressure sensor within the same time period. The device wearing analysis module 21 is specifically configured to substitute the contact pressure data sequence into a fit calculation function to calculate the fit of the acoustic device.

[0071] The fit calculation function is:

[0072] Where C represents the fit of the device, n represents the total number of pressure sensors, represents the weight coefficient corresponding to the i-th pressure sensor, represents the contact pressure data subsequence collected by the i-th pressure sensor, Represents the maximum contact pressure data that can be monitored by the i-th pressure sensor.

[0073] In one embodiment of the present application, the device offset angle includes a horizontal offset angle and a vertical offset angle. The device wearing analysis module 21 is specifically configured to calculate the horizontal offset angle and the vertical offset angle of the acoustic device relative to the user's auricle based on the spatial posture data of the acoustic device using the device coordinate system.

[0074] The device coordinate system uses the sound output direction of the acoustic device's speaker as the positive Z-axis direction, the geometric center of the user's auricle as the origin, and the horizontal direction parallel to the user's head as the positive X-axis direction.

[0075] In one embodiment of the present application, the leakage compensation calculation module 22 is specifically configured to obtain a reference leakage transfer function based on a simulated auricle model.

[0076] Calculates the leakage amplitude compensation factor based on the device fit.

[0077] A propagation path difference from a speaker to a microphone of the acoustic device is calculated based on the device offset angle, and an angular phase compensation factor is calculated based on the propagation path difference.

[0078] A dynamic leakage transfer function is determined based on the reference leakage transfer function, the leakage amplitude compensation factor, and the angular phase compensation factor.

[0079] In one embodiment of the present application, the environmental parameters include wind speed, temperature, and air pressure. The leakage compensation calculation module 22 is specifically configured to substitute wind speed, temperature, and air pressure into the environmental compensation function to obtain an environmental compensation coefficient.

[0080] The environmental compensation function is:

[0081] in, represents the environmental compensation coefficient, f represents the sound frequency of the initial acoustic signal, env represents the environmental parameter, v represents the wind speed, T represents the temperature, and P represents the air pressure. represents the wind speed compensation factor, represents the temperature compensation factor, Indicates the air pressure compensation factor.

[0082] In one embodiment of the present application, the noise reduction module 23 is specifically configured to calculate the leakage transfer characteristic based on the dynamic leakage transfer function and the environment compensation coefficient.

[0083] The initial acoustic signal and the leakage transfer characteristic are multiplied to obtain the leakage signal mixed in the initial acoustic signal.

[0084] In one embodiment of the present application, the dynamic leakage transfer function is:

[0085] in, represents the dynamic leakage transfer function, C represents the fit of the device, f represents the sound frequency of the initial acoustic signal, α represents the horizontal offset angle, β represents the vertical offset angle, represents the fit amplitude compensation factor, represents the baseline leakage transfer function, represents the angle phase compensation factor, which is determined by α and β, and j represents the imaginary unit.

[0086] See also Figure 3 , Figure 3 This is a schematic block diagram of an electronic device provided in one embodiment of the present application. Figure 3The electronic device 300 in the embodiment shown may include: one or more processors 301, one or more input devices 302, one or more output devices 303, and one or more memories 304. The processors 301, input devices 302, output devices 303, and memories 304 communicate with each other via a communication bus 305. The memory 304 is used to store computer programs, which include program instructions. The processor 301 is used to execute the program instructions stored in the memory 304. The processor 301 is configured to call the program instructions to execute the functions of the modules in the above-mentioned system embodiments, such as Figure 2 The device shown has the functions of wearing analysis module 21, leakage compensation calculation module 22 and noise reduction module 23.

[0087] It should be understood that in the embodiment of the present application, the processor 301 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0088] The input device 302 may include a touchpad, a fingerprint collection sensor (for collecting user fingerprint information and fingerprint direction information), a microphone, etc. The output device 303 may include a display (LCD, etc.), a speaker, etc.

[0089] The memory 304 may include a read-only memory and a random access memory, and provides instructions and data to the processor 301. A portion of the memory 304 may also include a non-volatile random access memory. For example, the memory 304 may also store information about the device type.

[0090] In a specific implementation, the processor 301, input device 302, and output device 303 described in the embodiments of the present application can execute the implementation methods described in the first and second embodiments of the audio processing method for the wearable acoustic device provided in the embodiments of the present application, and can also execute the implementation methods of the electronic device 300 described in the embodiments of the present application, which will not be repeated here.

[0091] In another embodiment of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, all or part of the process of the method in the above embodiment is implemented. The computer program can also be used to instruct related hardware to complete the process. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of each of the above method embodiments are implemented. The computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium.

[0092] The computer-readable storage medium can be an internal storage unit of the electronic device in any of the aforementioned embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium can also be an external storage device of the electronic device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. Furthermore, the computer-readable storage medium can include both an internal storage unit of the electronic device and an external storage device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium can also be used to temporarily store data that has been output or is about to be output.

[0093] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0094] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the electronic devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0095] In the several embodiments provided in this application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the system embodiments described above are merely schematic. For example, the division of units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces or units, or can be an electrical, mechanical or other form of connection.

[0096] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0097] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0098] The above are only specific embodiments of the present application, but the scope of protection of the present application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and such modifications or substitutions should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. An audio processing method for a wearable acoustic device, characterized in that: include: Calculating the fit of the acoustic device based on a contact pressure data sequence between the acoustic device and the target user's auricle, and calculating the device offset angle of the acoustic device relative to the user's auricle based on spatial posture data of the acoustic device; the contact pressure data sequence is monitored by pressure sensors provided at different device contact points, and the spatial posture data is monitored by an IMU sensor; Determining a dynamic leakage transfer function based on the device wearing fit and the device offset angle; and calculating an environmental compensation coefficient based on environmental parameters; The leakage signal mixed in the initial acoustic signal is predicted based on the dynamic leakage transfer function and the environmental compensation coefficient; the pure environmental noise is extracted from the initial acoustic signal based on the leakage signal, a noise reduction parameter is generated based on the pure environmental noise, and audio noise reduction processing is performed on the acoustic device based on the noise reduction parameter.

2. The audio processing method for a wearable acoustic device according to claim 1, wherein: The contact pressure data sequence includes contact pressure data subsequences collected by each pressure sensor within the same time period; The calculating the device wearing fit of the acoustic device based on the contact pressure data sequence between the acoustic device and the auricle of the target user includes: Substituting the contact pressure data sequence into a fit calculation function to calculate the fit of the acoustic device; The fit calculation function is: Where C represents the fit of the device, n represents the total number of pressure sensors, represents the weight coefficient corresponding to the i-th pressure sensor, represents the contact pressure data subsequence collected by the i-th pressure sensor, Represents the maximum contact pressure data that can be monitored by the i-th pressure sensor.

3. The audio processing method for a wearable acoustic device according to claim 1, wherein: The device offset angle includes a horizontal offset angle and a vertical offset angle; The calculating, based on the spatial posture data of the acoustic device, a device offset angle of the acoustic device relative to the user's auricle includes: Calculate the horizontal and vertical offset angles of the acoustic device relative to the user's auricle based on the spatial posture data of the acoustic device using the device coordinate system; The device coordinate system has the sound output direction of the speaker of the acoustic device as the positive direction of the Z axis, the geometric center of the user's auricle as the origin, and the horizontal direction parallel to the user's head as the positive direction of the X axis.

4. The audio processing method for a wearable acoustic device according to claim 1, wherein: The determining of a dynamic leakage transfer function based on the device wearing fit and the device offset angle includes: The baseline leakage transfer function is obtained based on the simulated auricle model; Calculating a leakage amplitude compensation factor based on the wear fit of the device; Calculating a propagation path difference from a speaker to a microphone of an acoustic device based on the device offset angle, and calculating an angular phase compensation factor based on the propagation path difference; A dynamic leakage transfer function is determined based on the reference leakage transfer function, the leakage magnitude compensation factor, and the angular phase compensation factor.

5. The audio processing method for a wearable acoustic device according to claim 1, wherein: The environmental parameters include wind speed, temperature and air pressure; The calculating of the environmental compensation coefficient based on the environmental parameters includes: Substitute wind speed, temperature and air pressure into the environmental compensation function to obtain the environmental compensation coefficient; The environmental compensation function is: in, represents the environmental compensation coefficient, f represents the sound frequency of the initial acoustic signal, env represents the environmental parameter, v represents the wind speed, T represents the temperature, and P represents the air pressure. represents the wind speed compensation factor, represents the temperature compensation factor, Indicates the air pressure compensation factor.

6. The audio processing method for a wearable acoustic device according to claim 1, wherein: The predicting of the leakage signal mixed in the initial acoustic signal based on the dynamic leakage transfer function and the environment compensation coefficient includes: calculating a leakage transfer characteristic based on the dynamic leakage transfer function and the environmental compensation coefficient; The initial acoustic signal and the leakage transfer characteristic are multiplied to obtain a leakage signal mixed in the initial acoustic signal.

7. The audio processing method for a wearable acoustic device according to claim 4, wherein: The dynamic leakage transfer function is: in, represents the dynamic leakage transfer function, C represents the fit of the device, f represents the sound frequency of the initial acoustic signal, α represents the horizontal offset angle, β represents the vertical offset angle, represents the fit amplitude compensation factor, represents the baseline leakage transfer function, represents the angle phase compensation factor, which is determined by α and β, and j represents the imaginary unit.

8. An audio processing system for a wearable acoustic device, characterized in that: include: A device wearing analysis module is configured to calculate the fit of the acoustic device based on a contact pressure data sequence between the acoustic device and the target user's auricle, and to calculate the device offset angle of the acoustic device relative to the user's auricle based on the acoustic device's spatial posture data; the contact pressure data sequence is monitored by pressure sensors located at different device contact points, and the spatial posture data is monitored by an IMU sensor; a leakage compensation calculation module, configured to determine a dynamic leakage transfer function based on the wear fit of the device and the device offset angle; and calculate an environmental compensation coefficient based on environmental parameters; The noise reduction module is used to predict the leakage signal mixed in the initial acoustic signal based on the dynamic leakage transfer function and the environmental compensation coefficient; extract pure environmental noise from the initial acoustic signal based on the leakage signal, generate noise reduction parameters based on the pure environmental noise, and perform audio noise reduction processing on the acoustic device based on the noise reduction parameters.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images