Noise reduction system, method and equipment based on sound field adaptive adjustment and storage medium

Abstract

The invention discloses a noise reduction system, method and device based on sound field adaptive adjustment and a storage medium, and relates to the technical field of noise reduction processing, the noise reduction system comprises a main device and a calibration device which are in communication connection with each other, the main device is used for outputting preset specific audio data; the calibration device is used for collecting specific audio data output by the main device at a plurality of collection positions in an open scene to obtain first collected audio data, and sending the first collected audio data to the main device; and the main device is used for carrying out sound field calibration on a plurality of acquisition positions according to the received first acquisition audio data, and optimizing a preset active noise reduction model according to a sound field calibration result, so as to carry out noise reduction processing in the open scene according to the optimized active noise reduction model. According to the invention, the noise reduction effect in an open scene can be improved.

Description

Technical Field

[0001] The present application relates to a specific field of noise reduction processing technology, and in particular to a noise reduction system, method, device and storage medium based on adaptive adjustment of sound field. Background Art

[0002] Active noise cancellation technology can effectively reduce environmental noise and has been widely used in headphones, automobiles and other fields. However, due to the development and optimization process of the active noise reduction algorithm used by active noise cancellation technology, it cannot adapt to cover the sound field layout that cannot be predicted in advance after sales. Therefore, for open places such as homes and industries, when using active noise cancellation technology for noise reduction processing, the noise reduction processing effect is poor, and there may even be an increase in noise in some locations. Therefore, how to improve the noise reduction effect in open scenes has become an urgent problem that needs to be solved.

[0003] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of the present application is to provide a noise reduction system, method, device and storage medium based on adaptive adjustment of the sound field, aiming to solve the technical problem of how to improve the noise reduction effect in open scenes.

[0005] To achieve the above object, the present application proposes a noise reduction system based on adaptive adjustment of the sound field, the noise reduction system comprising a main device and a calibration device connected to each other for communication,

[0006] The master device is used to output preset specific audio data;

[0007] The calibration device is used to collect the specific audio data output by the main device at multiple collection positions in an open scene to obtain first collected audio data, and send the first collected audio data to the main device;

[0008] The main device is used to perform sound field calibration at multiple collection positions according to the received first collected audio data, and optimize the preset active noise reduction model according to the sound field calibration result, so as to perform noise reduction processing in the open scene according to the optimized active noise reduction model.

[0009] In one embodiment, the main device includes a speaker and a controller connected to each other.

[0010] The speaker is used to output preset specific audio data;

[0011] The controller is used to perform sound field calibration at multiple collection positions according to the received first collected audio data, and optimize the preset active noise reduction model according to the sound field calibration result.

[0012] In one embodiment, the calibration device includes a first audio acquisition component and a first communication interface connected to each other, wherein the first audio acquisition component includes a first microphone;

[0013] The first microphone is used to collect specific audio data output by the main device at multiple collection positions in an open scene to obtain first collected audio data, and send the first collected audio data to the controller through the first communication interface.

[0014] In one embodiment, the calibration device includes a first position acquisition component connected to the first communication interface, and the first position acquisition component includes:

[0015] The first visual sensor is used to scan and acquire a first open scene image including the main device, and send the first open scene image to the controller through the first communication interface.

[0016] In one embodiment, the main device further includes a second position acquisition component connected to the controller, wherein the second position acquisition component includes a second visual sensor.

[0017] The second visual sensor is used to scan and acquire a second open scene image including the calibration device, and send the second open scene image to the controller;

[0018] The controller is used to perform spatial physical position calibration between the main device and the calibration device according to the first open scene image and the second open scene image, and determine the collection position in the open scene according to the spatial physical position calibration result.

[0019] In one embodiment, the main device further includes a second audio collection component connected to the controller, wherein the second audio collection component includes a second microphone.

[0020] The second microphone is used to collect environmental noise data in the open scene and send the environmental noise data to the controller;

[0021] The controller is configured to generate noise reduction audio data corresponding to the ambient noise data based on the optimized active noise reduction algorithm, and send the noise reduction audio data to the speaker;

[0022] The speaker is used to output the noise reduction audio data.

[0023] In one embodiment, the second audio collection component further includes a third microphone, wherein the second microphone is located on a side close to the noise source in the open scene, and the third microphone is located on a side close to the user.

[0024] The third microphone is used to collect second collected audio data after the noise reduction audio data performs noise reduction processing on the ambient noise data generated by the noise source, and send the second collected audio data to the controller;

[0025] The controller is used to optimize parameters of the active noise reduction model according to the second collected audio data.

[0026] In addition, to achieve the above-mentioned purpose, the present application also provides a noise reduction method based on adaptive adjustment of sound field, which is applied to a main device connected to a calibration device in a noise reduction system based on adaptive adjustment of sound field, and the noise reduction method based on adaptive adjustment of sound field comprises the following steps:

[0027] Outputting preset specific audio data, wherein the calibration device is used to collect the specific audio data output by the main device at multiple collection positions in an open scene to obtain collected audio data, and send the collected audio data to the main device;

[0028] The collected audio data collected by the calibration device at multiple collection positions is received, and a preset active noise reduction algorithm is optimized according to the collected audio data, so as to perform noise reduction processing on the noise in the open scene according to the optimized active noise reduction algorithm.

[0029] In addition, to achieve the above-mentioned objectives, the present application also provides a noise reduction device based on adaptive adjustment of sound field, and the noise reduction device based on adaptive adjustment of sound field includes: a noise reduction system based on adaptive adjustment of sound field as described in any of the above items, a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the noise reduction method based on adaptive adjustment of sound field as described above.

[0030] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the noise reduction method based on adaptive adjustment of the sound field as described above are implemented.

[0031] In an embodiment of the present application, a noise reduction system based on adaptive adjustment of sound fields is provided, including a main device and a calibration device that are communicatively connected to each other, the main device being used to output preset specific audio data, the calibration device being used to collect the specific audio data output by the main device at multiple collection positions in an open scene, to obtain first collected audio data, and to send the first collected audio data to the main device, the main device performing sound field calibration at multiple collection positions according to the received first collected audio data, and optimizing an active noise reduction model according to the sound field calibration result, so as to perform noise reduction processing in an open scene according to the optimized active noise reduction model. That is, the sound field of the main device can be calibrated by the calibration device, and the calibration device can perform sound field calibration on the main device at multiple different collection positions in an open scene. Therefore, when the main device after sound field calibration performs noise reduction processing on the environmental noise in the subsequent process, it can directly generate corresponding noise reduction audio data according to the optimized active noise reduction model, and output the noise reduction audio data to perform noise reduction processing on the open scene. Moreover, since the sound field calibration has been performed at multiple collection positions by the calibration device, the main device can perform noise reduction processing according to different sound field positions when performing noise reduction processing on the open scene, thereby avoiding the phenomenon of increased noise in some positions, and improving the noise reduction effect in the open scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0033] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0034] Figure 1 This is a schematic diagram of the connection between the main device and the calibration device in the first embodiment of the noise reduction system based on adaptive adjustment of the sound field of this application;

[0035] Figure 2 This is a schematic diagram of the connection between a main device and multiple calibration devices in the first embodiment of the noise reduction system based on adaptive adjustment of the sound field of this application;

[0036] Figure 3 This is a structural diagram of a main device and a calibration device in the second embodiment of the noise reduction system based on adaptive adjustment of the sound field of the present application;

[0037] Figure 4 This is a schematic diagram of the steps of the noise reduction method based on adaptive adjustment of the sound field in this application;

[0038] Figure 5 This is a schematic diagram of the device architecture of the noise reduction device based on adaptive adjustment of the sound field in this application.

[0039] Description of Figure Numbers:

[0040]

[0041]

[0042] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0043] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0044] In order to better understand the technical solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0045] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components in a certain specific posture. If the specific posture changes, the directional indication will also change accordingly.

[0046] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features limited to "first" and "second" may explicitly or implicitly include at least one of the features. In addition, if "and / or" or "and / or" appears in the full text, its meaning includes three parallel schemes. Taking "A and / or B" as an example, it includes scheme A, or scheme B, or a scheme that satisfies both A and B. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in the field to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0047] The present application proposes a noise reduction system based on adaptive adjustment of the sound field.

[0048] Please refer to Figure 1 In the first embodiment of the noise reduction system based on adaptive sound field adjustment proposed in the present application, the noise reduction system based on adaptive sound field adjustment includes a main device 100 and a calibration device 200 which are communicatively connected to each other.

[0049] The main device 100 is used to output preset specific audio data;

[0050] The calibration device 200 is used to collect specific audio data output by the main device at multiple collection positions in an open scene, obtain first collected audio data, and send the first collected audio data to the main device;

[0051] The main device 100 is used to perform sound field calibration at multiple collection positions according to the received first collected audio data, and optimize the preset active noise reduction model according to the sound field calibration result, so as to perform noise reduction processing in an open scene according to the optimized active noise reduction model.

[0052] In this embodiment, the main device 100 may be a device or terminal with an active noise reduction function. The main device 100 is provided with an active noise elimination technology, such as an active noise reduction model. The main device 100 may perform noise reduction processing on the noise detected in the environment according to the built-in active noise reduction model, such as performing noise reduction processing in open places such as homes and industries. Optionally, the calibration device 200 may be used to perform sound field calibration on the main device 100 so that the noise reduction effect of the main device 100 is optimized. Optionally, the calibration device 200 may be a device held or worn by a user, or may be a movable device so as to collect audio data at different locations. Optionally, the communication connection between the main device 100 and the calibration device 200 may be a wired connection or a wireless connection, which is not limited here.

[0053] Optionally, the specific audio data may be test audio data set in advance, such as white noise, pink noise, pre-made voice or swept frequency sound test audio data. Optionally, the open scene may not be limited to a specific scene, such as a factory building in a factory environment, a kitchen in a home, a supermarket, etc. No limitation is made here. Optionally, the first collected audio data may be audio data collected by the calibration device 200 at the collection position for the specific audio data played by the main device 100. The collection position may be any position in the open scene, and the calibration device 200 may collect specific audio data once or multiple times at different collection positions.

[0054] Optionally, the sound field calibration can be to optimize and adjust the active noise reduction algorithm in the main device by measuring and analyzing the acoustic characteristics in the open scene to achieve the best sound experience and noise suppression effect. The active noise reduction algorithm may include an active noise reduction model. The active noise reduction algorithm may be an adaptive filter algorithm, a frequency domain adaptive filter algorithm, a multi-channel adaptive filter algorithm, etc., which are not limited here.

[0055] Optionally, in an open scene, there will be certain noise, such as noise generated by the operation of other devices. For example, in a kitchen, when a range hood is running, the range hood will generate certain noise, so it is necessary to perform noise reduction processing on the noise generated when the range hood is running. At this time, the noise generated when the range hood is running in the kitchen scene can be processed by the main device 100 in this embodiment. In order to achieve the noise reduction effect of the main device 100 in the kitchen scene, the sound field calibration of the main device 100 can be performed at different positions (i.e., the collection position) in the kitchen scene through the calibration device 200 to improve the noise reduction effect of the main device 100.

[0056] Optionally, the main device 100 can be set at any position in an open scene, without limitation, and can be a range hood, a washing machine, an air conditioner, a ventilation fan, and the like.

[0057] Optionally, the calibration device 200 can perform sound field calibration on the main device 100 at different collection positions in an open scene.

[0058] For example, the user holds or wears the calibration device 200 and performs sound field calibration at different locations (i.e., different collection locations) in an open scene (e.g., a kitchen, a living room, etc.). When performing sound field calibration, the main device 100 can output the test audio data set in advance as specific audio data.

[0059] The calibration device 200 will record the reverberation of specific audio data at different locations at different collection locations, that is, collect the specific audio data output by the main device 100 to obtain first collected audio data, and send the collected first collected audio data to the main device 100 in real time for analysis. That is, every time the calibration device 200 collects at least one segment of first collected audio data at a collection location, the collected first collected audio data will be sent to the main device 100. Optionally, the collection time corresponding to each segment of first collected audio data at different collection locations of the calibration device 200 can be the same, for example, all are 5s of first collected audio data.

[0060] Optionally, after receiving the first collected audio data sent by the calibration device 200, the master device 100 performs sound field calibration according to the first collected audio data. Optionally, since the calibration device 200 collects and sends the first collected audio data to the master device 100 at different collection positions, the master device 100 performs a sound field calibration operation each time it receives the first collected audio data sent by the calibration device 200. That is, the master device 100 can perform multiple sound field calibration operations.

[0061] Optionally, after receiving the first collected audio data, the main device 100 may perform basic data processing on the first collected audio data, including spectrum analysis and acoustic feature extraction. That is, when performing spectrum analysis, the time domain signal corresponding to the first collected audio data may be converted into a frequency signal using a fast Fourier transform. When performing acoustic feature extraction, key acoustic features may be extracted from the converted frequency signal, such as the frequency response of the amplitude and phase of the sound. Optionally, the main device 100 may determine the reverberation of the calibration device 200 at different collection positions based on the extracted acoustic features. For example, the attenuation time of the sound in the first collected audio data at different collection positions is calculated to obtain the reverberation time.

[0062] The main device 100 performs error calculation based on the first collected audio data sent by the calibration device 200, such as determining the difference between the specific audio data and the first collected audio data, to obtain an error signal, and optimizes the model parameters of the active noise reduction model based on the error signal, such as adjusting the coefficients of the adaptive filter.

[0063] After the calibration device 200 collects the first collected audio data at each collection position and sends the first collected audio data to the main device 100, it will move to the next collection position, collect the specific audio data output by the main device again, and send the first collected audio data collected again to the main device 100, so that the main device 100 can continue to calibrate the sound field. The main device 100 can collect the first collected audio data corresponding to multiple collection positions in the open scene and perform comprehensive analysis to ensure that the noise reduction effect in the entire open scene is uniform.

[0064] After completing the sound field calibration of the main device 100 based on the calibration device 200, the main device 100 can perform noise reduction processing in an open scene according to the optimized active noise reduction model stored in itself, so that the noise reduction effect at different positions in the open scene is uniform, avoiding the phenomenon of inconsistent noise or increased noise perceived by users at different positions.

[0065] In addition, in a scenario embodiment, multiple calibration devices 200 may be provided, and each calibration device 200 establishes a communication connection with the main device 100. Each calibration device 200 may be provided at a different collection position, collects specific audio data output by the main device, obtains first collected audio data, and sends the first collected audio data to the main device 100. The main device 100 may perform sound field calibration for the first collected audio data sent by each calibration device 200 to optimize the active noise reduction model. For example, Figure 2 As shown, in an open scene, if there are four calibration devices 200, one calibration device 200 can be arranged in the collection position A, one calibration device 200 can be arranged in the collection position B, one calibration device 200 can be arranged in the collection position C, and one calibration device 200 can be arranged in the collection position D. The main device 100 is set in the middle of the four calibration devices 200. After the main device outputs specific audio data, the four calibration devices 200 will all collect the specific audio data, obtain the first collected audio data, and send it to the main device 100. After receiving the first collected audio data sent by the four calibration devices 200, the main device 100 can process them in parallel or in sequence according to the priority set in advance, and all of them perform sound field calibration according to the first collected audio data, and optimize the preset active noise reduction model according to the sound field calibration result, so as to perform noise reduction processing in the open scene according to the optimized active noise reduction model.

[0066] In this embodiment, a noise reduction system based on adaptive adjustment of sound fields is provided, including a main device 100 and a calibration device 200 that are communicatively connected to each other. The main device 100 is used to output preset specific audio data, and the calibration device 200 is used to collect the specific audio data output by the main device 100 at multiple collection positions in an open scene to obtain first collected audio data, and send the first collected audio data to the main device 100. The main device 100 performs sound field calibration at multiple collection positions according to the received first collected audio data, and optimizes the active noise reduction model according to the sound field calibration result, so as to perform noise reduction processing in the open scene according to the optimized active noise reduction model. That is, the sound field of the main device 100 can be calibrated by the calibration device, and the calibration device 200 can perform sound field calibration on the main device 100 at multiple different collection positions in an open scene. Therefore, the main device 100 after sound field calibration can directly generate corresponding noise reduction audio data according to the optimized active noise reduction model when performing noise reduction processing on environmental noise in the subsequent process, and output the noise reduction audio data to perform noise reduction processing on the open scene. Moreover, since the sound field calibration has been performed at multiple collection positions by the calibration device, the main device 100 can perform noise reduction processing according to different sound field positions when performing noise reduction processing on the open scene, thereby avoiding the phenomenon of increased noise in some positions, and improving the noise reduction effect in the open scene.

[0067] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the first embodiment can be referred to the above introduction, and will not be described in detail later. Figure 3 , in the second embodiment of the noise reduction system based on adaptive adjustment of the sound field.

[0068] The main device 100 includes a speaker 120 and a controller 110 connected to each other;

[0069] The speaker 120 is used to output preset specific audio data;

[0070] The controller 110 is configured to perform sound field calibration at multiple collection positions according to the received first collected audio data, and optimize a preset active noise reduction model according to the sound field calibration result.

[0071] Optionally, in the main device 100, if sound field calibration is required, the controller 110 may first determine specific audio data for sound field calibration, send the specific audio data to the speaker 120, and then output the specific audio data to the open scene through the speaker 120.

[0072] Optionally, when determining the specific audio data for sound field calibration, the controller 110 may make the determination itself according to a pre-set rule, or may make the determination according to an instruction input by a user, which is not limited here.

[0073] Optionally, the host device 100 may further be provided with a second communication interface 130, and the second communication interface 130 is connected to the controller 110. The second communication interface 130 may be an interface capable of implementing a data communication function, such as a USB interface or a UWB interface.

[0074] After the calibration device 200 collects the first collected audio data at the collection position in the open scene, the first collected audio data may be sent to the controller 110 through the second communication interface 130 .

[0075] The controller 110 can perform sound field calibration on the first collected audio data after receiving the first collected audio data through the second communication interface 130, and can perform sound field calibration on multiple collection positions based on the first collected audio data at different collection positions, and optimize the active noise reduction model according to the sound field calibration results.

[0076] Optionally, the controller 110 may be provided with an analog-to-digital conversion module, an active noise reduction processing chip, a digital-to-analog conversion module and a power amplifier.

[0077] Optionally, after determining the specific audio data for sound field calibration, the controller 110 can convert the digital signal of the specific audio data into an analog signal through a digital-to-analog conversion module, and send it to a power amplifier for amplification, and then output it through a speaker to complete the output of the specific audio data to an open scene.

[0078] Optionally, after the calibration device 200 acquires the first acquired audio data at different acquisition positions, it sends the data to the controller 110 through the second communication interface 130. The analog-to-digital conversion module in the controller 110 converts the first acquired audio data into a digital signal, and inputs the converted digital signal into the active noise reduction processing chip. The active noise reduction processing chip determines the error based on the converted digital signal and the digital signal of the specific audio data, and optimizes the parameters of the active noise reduction model set in the active noise reduction processing chip based on the determined error.

[0079] In this embodiment, the main device 100 includes a speaker 120 and a controller 110 that are connected to each other, and specific audio data is output through the speaker 120, and sound field calibration processing is performed through the controller 120. Therefore, the effective sound field calibration of the main device 100 can be guaranteed, and the accuracy of the sound field calibration is improved.

[0080] Further, in a feasible embodiment, referring to Figure 3The calibration device 200 includes a first audio collection component 210 and a first communication interface 220 connected to each other, and the first audio collection component 210 includes a first microphone.

[0081] The first microphone is used to collect specific audio data output by the main device 100 at multiple collection positions in an open scene, obtain first collected audio data, and send the first collected audio data to the controller 110 through the first communication interface 220.

[0082] Optionally, the first audio collection component 210 may include a first microphone, or may include a microphone array composed of a plurality of first microphones, which is not limited here. The following is an example in which the first audio collection component 210 is the first microphone.

[0083] Optionally, the first communication interface 220 may be an interface capable of realizing a data communication function, such as a USB interface or a UWB interface. The calibration device 200 may establish a communication connection with the main device 100 through the first communication interface 220. And the first communication interface 220 in the calibration device 200 may establish a communication connection with the second communication interface 130 in the main device 100.

[0084] Optionally, the calibration device 200 can collect specific audio data output by the main device 100 through the first microphone at each collection position in the open scene to obtain first collected audio data, and send the first collected audio data to the main device 100 through the first communication interface 220. The second communication interface 130 in the main device 100 receives the specific audio data sent by the calibration device 200, and sends the specific audio data to the controller 110 so that the controller 110 performs sound field calibration.

[0085] Optionally, in a feasible embodiment, a first display module (such as a display) and a first power module (such as a lithium battery) may also be provided in the calibration device 200. Optionally, when the calibration device 200 collects the first collected audio data at the collection position through the first microphone, it may be displayed through the first display module. Optionally, the first power module provides power for the operation of the calibration device 200.

[0086] In this embodiment, the calibration device includes a first audio collection component 210 and a first communication interface 220 that are interconnected, and the first audio collection component 210 includes a first microphone. The first microphone collects first collected audio data at multiple collection positions in an open scene, and sends the first collected audio data to the controller 110 through the first communication interface 220, thereby ensuring the effective implementation of the sound field calibration for the main device 100.

[0087] Further, in a feasible embodiment, referring to Figure 3The calibration device 200 includes a first position acquisition component 230 connected to the first communication interface 220, and the first position acquisition component 230 includes a first visual sensor.

[0088] The first visual sensor is used to scan and acquire a first open scene image including the main device 100 , and send the first open scene image to the controller 110 through the first communication interface 220 .

[0089] Optionally, the first position acquisition component 230 includes a first visual sensor, and may also include a visual sensor array consisting of a plurality of visual sensors. This is not limited here. Optionally, the first visual sensor may be a 3D ToF device. The following is only exemplified by taking the first position acquisition component 230 as the first visual sensor as an example.

[0090] Optionally, in the calibration device, the first position acquisition component 230 and the first audio acquisition component 210 are connected to the first communication interface 220 respectively.

[0091] Optionally, when the calibration device 200 is in the acquisition position and is ready to start acquiring specific audio data output by the main device 100 through the first audio acquisition component 210, a three-dimensional image including the main device 100 can be scanned and acquired by the first visual sensor in the calibration device 200, and used as the first open scene image. The first position acquisition component 230 sends the first open scene image to the first communication interface 220, so as to send it to the main device 100 through the first communication interface 220. The main device receives the first open scene image sent by the calibration device 200 through the second communication interface 130, and sends the first open scene image to the controller 110. The controller 110 performs a spatial physical position calibration between the main device 100 and the calibration device 200 based on the received first open scene image to determine the acquisition position of the calibration device 200 relative to the main device 100.

[0092] Optionally, the calibration device 200 can scan and acquire a first open scene image including the main device through the first position acquisition component 230 at each acquisition position, and send the image to the main device 100 so that the main device 100 can perform a spatial physical position calibration between the main device 100 and the calibration device 200, and then determine the acquisition position of the calibration device 200 relative to the main device 100.

[0093] In this embodiment, the calibration device 200 includes a first position acquisition component 230 connected to the first communication interface 220, and the first position acquisition component 230 includes a first visual sensor for scanning and sending a first open scene image to the controller 110 through the first communication interface, so that the controller 110 can perform spatial physical position calibration between the main device 100 and the calibration device 200, thereby facilitating the subsequent effective sound field calibration of the main device 100.

[0094] Further, in a feasible embodiment, referring to Figure 3 The main device 100 includes a second position acquisition component 140 connected to the controller 110, and the second position acquisition component 140 includes a second visual sensor.

[0095] A second visual sensor, used for scanning and acquiring a second open scene image including the calibration device 200, and sending the second open scene image to the controller 110;

[0096] The controller 110 is used to perform spatial physical position calibration between the main device 100 and the calibration device 200 according to the first open scene image and the second open scene image, and determine the collection position in the open scene according to the spatial physical position calibration result.

[0097] Optionally, the second position acquisition component 140 includes a first visual sensor, and may also include a visual sensor array composed of a plurality of visual sensors. This is not limited here. Optionally, the second visual sensor may be a 3D ToF device. The following is only exemplified by taking the second position acquisition component 140 as a second visual sensor.

[0098] Optionally, when performing the spatial physical position calibration between the master device 100 and the calibration device 200, the master device 100 may acquire a second open scene image including the calibration device 200 through the second visual sensor, and acquire a first open scene image including the master device 100 through the first visual sensor in the calibration device 200. Both the first open scene image and the second open scene image are sent to the controller 110. Optionally, the first open scene image and the second open scene image may be three-dimensional stereo images.

[0099] Optionally, a position calibration module may be provided in the controller 110. After receiving a first open scene image including the main device 100 and a second open scene image including the calibration device 200, the controller 110 performs a spatial physical position calibration through the position calibration module to determine the spatial layout in the open scene, the three-dimensional spatial coordinates of the main device 100, the three-dimensional spatial coordinates of the calibration device 200, and the relative position relationship between the main device 100 and the calibration device 200 (including the relative distance, the orientation information between the two, etc.), and determines the acquisition position according to the three-dimensional spatial coordinates of the calibration device 100.

[0100] Optionally, when performing the spatial physical position calibration, the position calibration module may construct a three-dimensional coordinate system with the position of the main device 100 as the origin, and perform image recognition on the first open scene image and the second open scene image, and determine the three-dimensional spatial coordinates of the calibration device 200 in the three-dimensional coordinate system according to the two image recognition results, that is, the three-dimensional spatial coordinates of the calibration device 200, and the three-dimensional spatial coordinates of the calibration device 200 may be directly used as the acquisition position. And according to the image recognition result of the calibration device 200 in the second open scene image, the orientation information of the calibration device 200 relative to the main device 100 is determined. And the three-dimensional spatial coordinates of the main device 100 can be set as the origin coordinates, and the relative distance between the main device 100 and the calibration device 200 can be determined according to the three-dimensional spatial coordinates of the calibration device 200, and the spatial physical position calibration between the main device 100 and the calibration device 200 is completed according to the relative distance, orientation information, etc.

[0101] In this embodiment, a second position acquisition component 140 is also provided in the main device 100, including a second visual sensor for acquiring a second open scene image. The controller 110 performs spatial physical position calibration between the main device 100 and the calibration device 200 according to the first open scene image and the second open scene image, thereby facilitating the subsequent effective sound field calibration of the main device 100.

[0102] Further, in a feasible embodiment, referring to Figure 3 The main device 100 further includes a second audio collection component 150 connected to the controller 110, and the second audio collection component 150 includes a second microphone 151.

[0103] The second microphone 151 is used to collect environmental noise data in an open scene and send the environmental noise data to the controller 110;

[0104] The controller 110 is used to generate noise reduction audio data corresponding to the ambient noise data based on the optimized active noise reduction algorithm, and send the noise reduction audio data to the speaker 120;

[0105] The speaker 120 is used to output noise reduction audio data.

[0106] Optionally, the main device 100 can perform noise reduction processing in an open scene. Optionally, in an open scene, the second microphone 151 in the main device 100 will collect environmental noise data in the open scene and send the collected environmental noise data to the controller 110. The environmental noise data may be composed of noise generated by noise sources in the open scene, such as noise generated when a range hood is running.

[0107] Optionally, after collecting the environmental noise data, the second microphone 151 may convert the environmental noise data from a sound pressure signal into an electrical signal, and then send the electrical signal to the controller 110 .

[0108] Optionally, after receiving the ambient noise data, the controller 110 can process it based on the optimized active noise reduction algorithm, generate corresponding noise reduction audio data, and convert it from an electrical signal to a sound pressure signal and output it through the speaker 120 to achieve noise reduction processing of the ambient noise in the open scene.

[0109] In this embodiment, a second audio collection component 150 is also provided in the main device 100, including a second microphone 151, so that environmental noise data can be collected according to the second microphone 151, and noise reduction audio data corresponding to the environmental noise data can be generated through the controller 110, and output through the speaker 120 to achieve noise reduction processing of the environmental noise data in an open scene.

[0110] Further, in a feasible embodiment, referring to Figure 3 The second audio collection component 150 also includes a third microphone 152. The second microphone 151 is located on a side close to the noise source in the open scene, and the third microphone 152 is located on a side close to the user.

[0111] The third microphone 152 is used to collect second collected audio data after the noise reduction audio data performs noise reduction processing on the ambient noise data generated by the noise source, and send the second collected audio data to the controller 110;

[0112] The controller 110 is configured to optimize parameters of the active noise reduction model according to the second collected audio data.

[0113] Optionally, the second microphone 151 and the third microphone 152 may be provided in the main device 100 at the same time. In this case, the second microphone 151 may be used as a feedforward microphone, and the third microphone 152 may be provided as a feedback microphone. Optionally, the feedforward microphone is provided at a position close to the noise source to capture the noise signal and obtain the environmental noise data. The feedback microphone may be provided at a position close to the user's ear to collect the audio signal after the noise reduction processing (i.e., the collected second collected audio data).

[0114] For example, when the main device 100 is a smart headset, the second microphone 151 can be arranged on the outside of the smart headset, that is, facing the external environment, and the third microphone 152 is arranged inside the headset, such as inside the earmuff.

[0115] Optionally, after receiving the second collected audio data sent by the third microphone 152, the controller 110 may optimize the parameters of the active noise reduction model again according to the second collected audio data. That is, it is detected whether there is environmental noise data in the second collected audio data, and if there is, the parameters of the active noise reduction model are optimized until there is no environmental noise data in the second collected audio data newly acquired by the controller 110.

[0116] In this embodiment, the second audio collection component 150 also includes a third microphone 152 , and the active noise reduction model in the controller can be optimized by the second collected audio data collected by the third microphone 152 to improve the noise reduction effect of the main device 100 .

[0117] Furthermore, the embodiment of the present application also provides a noise reduction method based on adaptive adjustment of the sound field, which is applied to a main device connected to a calibration device in a noise reduction system based on adaptive adjustment of the sound field, referring to Figure 4 , the noise reduction method based on adaptive adjustment of the sound field includes the following steps:

[0118] Step S10, outputting preset specific audio data, wherein the calibration device is used to collect the specific audio data output by the main device at multiple collection positions in the open scene, obtain collected audio data, and send the collected audio data to the main device;

[0119] Step S20, receiving the collected audio data collected by the calibration device at multiple collection positions, and optimizing the preset active noise reduction algorithm according to the collected audio data, so as to perform noise reduction processing on the noise in the open scene according to the optimized active noise reduction algorithm.

[0120] The noise reduction method based on adaptive adjustment of the sound field provided in the present application can refer to any of the embodiments of the noise reduction system based on adaptive adjustment of the sound field described above, and can improve the noise reduction effect in open scenes. Compared with the prior art, the beneficial effects of the noise reduction method based on adaptive adjustment of the sound field provided in the present application are the same as the beneficial effects of the noise reduction system based on adaptive adjustment of the sound field provided in the above embodiments, and other technical features in the noise reduction method based on adaptive adjustment of the sound field are the same as the features disclosed in the above embodiment system, which will not be described in detail here.

[0121] The present application provides a noise reduction device based on adaptive adjustment of sound field, and the noise reduction device based on adaptive adjustment of sound field includes: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the noise reduction method based on adaptive adjustment of sound field in the above-mentioned embodiment 1.

[0122] Reference below Figure 5 , which shows a schematic diagram of the structure of a noise reduction device based on adaptive sound field adjustment suitable for implementing the embodiment of the present application. The noise reduction device based on adaptive sound field adjustment in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The noise reduction device based on adaptive adjustment of the sound field shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0123] like Figure 5As shown, the noise reduction device based on adaptive adjustment of the sound field may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM: Read Only Memory) 1002 or the program loaded from the storage device 1003 to the random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the device are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the noise reduction device based on the adaptive adjustment of the sound field to communicate with other devices wirelessly or by wire to exchange data. Although the noise reduction device based on the adaptive adjustment of the sound field with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or provided instead.

[0124] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0125] The noise reduction device based on adaptive sound field adjustment provided by the present application adopts the noise reduction method based on adaptive sound field adjustment in the above embodiment, which can improve the noise reduction effect in open scenes. Compared with the prior art, the beneficial effects of the noise reduction device based on adaptive sound field adjustment provided by the present application are the same as the beneficial effects of the noise reduction method based on adaptive sound field adjustment provided by the above embodiment, and the other technical features of the noise reduction device based on adaptive sound field adjustment are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0126] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0127] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0128] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the noise reduction method based on adaptive adjustment of the sound field in the above-mentioned embodiment.

[0129] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0130] The computer-readable storage medium may be included in the noise reduction device based on the adaptive adjustment of the sound field; or may exist independently without being assembled into the noise reduction device based on the adaptive adjustment of the sound field.

[0131] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the noise reduction device based on sound field adaptive adjustment, the noise reduction device based on sound field adaptive adjustment can execute the step flow in the above-mentioned noise reduction method based on sound field adaptive adjustment.

[0132] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0133] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0134] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0135] The readable storage medium provided in the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned noise reduction method based on adaptive adjustment of the sound field, and can improve the noise reduction effect in open scenes. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the present application are the same as the beneficial effects of the noise reduction method based on adaptive adjustment of the sound field provided in the above-mentioned embodiment, and will not be repeated here.

[0136] The present application also provides a computer program product, including a computer program, which implements the steps of the noise reduction method based on adaptive adjustment of the sound field as described above when the computer program is executed by a processor.

[0137] The computer program product provided by the present application can improve the noise reduction effect in open scenes. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the noise reduction method based on adaptive adjustment of the sound field provided by the above embodiment, which will not be repeated here.

[0138] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A noise reduction system based on adaptive adjustment of sound field, characterized in that: The noise reduction system includes a main device and a calibration device that are communicatively connected to each other. The master device is used to output preset specific audio data; The calibration device is used to collect the specific audio data output by the main device at multiple collection positions in an open scene to obtain first collected audio data, and send the first collected audio data to the main device; The main device is used to perform sound field calibration at multiple collection positions according to the received first collected audio data, and optimize the preset active noise reduction model according to the sound field calibration result, so as to perform noise reduction processing in the open scene according to the optimized active noise reduction model.

2. The noise reduction system based on adaptive adjustment of sound field according to claim 1, characterized in that: The main device includes a speaker and a controller connected to each other, The speaker is used to output preset specific audio data; The controller is used to perform sound field calibration at multiple collection positions according to the received first collected audio data, and optimize the preset active noise reduction model according to the sound field calibration result.

3. The noise reduction system based on adaptive adjustment of sound field according to claim 2, characterized in that: The calibration device comprises a first audio acquisition component and a first communication interface connected to each other, wherein the first audio acquisition component comprises a first microphone; The first microphone is used to collect specific audio data output by the main device at multiple collection positions in an open scene to obtain first collected audio data, and send the first collected audio data to the controller through the first communication interface.

4. The noise reduction system based on adaptive adjustment of sound field according to claim 3, characterized in that: The calibration device includes a first position acquisition component connected to the first communication interface, and the first position acquisition component includes: The first visual sensor is used to scan and acquire a first open scene image including the main device, and send the first open scene image to the controller through the first communication interface.

5. The noise reduction system based on adaptive adjustment of sound field according to claim 4, characterized in that: The main device further includes a second position acquisition component connected to the controller, wherein the second position acquisition component includes a second visual sensor. The second visual sensor is used to scan and acquire a second open scene image including the calibration device, and send the second open scene image to the controller; The controller is used to perform spatial physical position calibration between the main device and the calibration device according to the first open scene image and the second open scene image, and determine the collection position in the open scene according to the spatial physical position calibration result.

6. The noise reduction system based on adaptive adjustment of sound field according to claim 2, characterized in that: The main device further includes a second audio collection component connected to the controller, wherein the second audio collection component includes a second microphone. The second microphone is used to collect environmental noise data in the open scene and send the environmental noise data to the controller; The controller is configured to generate noise reduction audio data corresponding to the ambient noise data based on the optimized active noise reduction algorithm, and send the noise reduction audio data to the speaker; The speaker is used to output the noise reduction audio data.

7. The noise reduction system based on adaptive adjustment of sound field according to claim 6, characterized in that: The second audio collection component further includes a third microphone, wherein the second microphone is located on a side close to the noise source in the open scene, and the third microphone is located on a side close to the user. The third microphone is used to collect second collected audio data after the noise reduction audio data performs noise reduction processing on the ambient noise data generated by the noise source, and send the second collected audio data to the controller; The controller is used to optimize parameters of the active noise reduction model according to the second collected audio data.

8. A noise reduction method based on adaptive adjustment of sound field, characterized in that: A main device connected to a calibration device in a noise reduction system based on sound field adaptive adjustment is applied, and the noise reduction method based on sound field adaptive adjustment comprises the following steps: Outputting preset specific audio data, wherein the calibration device is used to collect the specific audio data output by the main device at multiple collection positions in an open scene to obtain collected audio data, and send the collected audio data to the main device; The collected audio data collected by the calibration device at multiple collection positions is received, and a preset active noise reduction algorithm is optimized according to the collected audio data, so as to perform noise reduction processing on the noise in the open scene according to the optimized active noise reduction algorithm.

9. A noise reduction device based on adaptive adjustment of sound field, characterized in that: The noise reduction device based on adaptive adjustment of the sound field comprises: a noise reduction system based on adaptive adjustment of the sound field as described in any one of claims 1 to 7, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the noise reduction method based on adaptive adjustment of the sound field as described in claim 8.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the noise reduction method based on adaptive adjustment of the sound field as claimed in claim 8 are implemented.

Images