Projection device and audio noise reduction method thereof

Abstract

The application relates to a projection device and an audio noise reduction method thereof, and relates to the field of audio processing. The projection device comprises a fan configured to cool the projection device, a microphone array comprising at least two microphones configured to collect audio data, and a controller connected with the microphone array and configured to control a first microphone to collect first audio data and a second microphone to synchronously collect second audio data, wherein the first microphone is a microphone in the microphone array close to a standard voice initiation position, the second microphone is a microphone in the microphone array close to the fan, and the first audio data is subjected to noise reduction processing according to the second audio data to obtain target audio data. The above technical scheme improves the definition of the target audio data, improves the noise reduction efficiency, and reduces the hardware cost investment without the need of introducing other hardware devices.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of audio processing, in particular to a projection device and an audio noise reduction method thereof. BACKGROUND

[0002] During the use of the projection device such as laser television, due to the light source irradiation and other reasons, the internal heat of the device is relatively high during operation, therefore, a fan is needed for cooling treatment to reduce the influence of heat on the service life of the projection device and ensure that the device can operate stably for a long time.

[0003] However, during the operation of the fan, the rotation of the fan blade will bring additional noise. In the case that the projection device is built-in with a voice recognition module, the fan noise will have a certain influence on the accuracy of the voice recognition function.

[0004] In the conventional technology, when the fan noise in the audio is processed, high-precision microphones and low-precision microphones are needed to collect the fan noise, and the drawing of the amplitude-frequency response correction curve and the loudspeaker correction curve of the low-precision microphone and the determination of the noise reduction period marker point are based on the collected data. Subsequently, during the use of the microphone, noise reduction is performed at the noise reduction period marker point position according to the amplitude-frequency response correction curve and the loudspeaker correction curve. The above-mentioned operation process is relatively complex and has low operation efficiency. SUMMARY

[0005] The present application provides a projection device and an audio noise reduction method thereof to solve the technical problem of the influence of fan noise on the voice recognition function in the prior art, while taking into account the operation efficiency.

[0006] In a first aspect, some embodiments provide a projection device, comprising:

[0007] a fan configured to cool the projection device;

[0008] a microphone array comprising at least two microphones configured to collect audio data;

[0009] a controller connected to the microphone array and configured to:

[0010] control the first microphone to collect first audio data and the second microphone to collect second audio data synchronously; wherein the first microphone is a microphone in the microphone array close to a standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan;

[0011] perform noise reduction processing on the first audio data according to the second audio data to obtain target audio data.

[0012] In some embodiments, a first microphone close to a standard voice initiation position in a microphone array and a second microphone close to the fan are set, and the first audio data synchronously collected by the first microphone is denoised according to the second audio data collected by the second microphone to obtain target audio data. In the above technical solution, since the second microphone is close to the fan, the fan noise features carried in the second audio data are more obvious; since the first microphone is close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, denoising the first audio data with the second audio data can avoid the situation that the denoising effect is not good due to the unobvious fan noise features, and ensures the clarity of the target audio data. In addition, the above technical solution does not need to draw the amplitude-frequency response correction curve of the low-precision microphone and the loudspeaker correction curve, and can filter the fan noise, reduce the operation amount of the noise filtering process, and improve the denoising efficiency. At the same time, in the denoising process, a pure software processing method is adopted, which only relies on the existing hardware equipment, without the need to introduce other hardware equipment, thereby reducing the hardware cost.

[0013] In a second aspect, some embodiments further provide an audio denoising method, comprising:

[0014] controlling a first microphone to collect first audio data and a second microphone to synchronously collect second audio data; wherein the first microphone is a microphone close to a standard voice initiation position in a microphone array; and the second microphone is a microphone close to the fan in the microphone array;

[0015] denoising the first audio data according to the second audio data to obtain target audio data.

[0016] In some embodiments, a first microphone close to a standard voice initiation position in a microphone array and a second microphone close to the fan are set, the first microphone is controlled to collect first audio data, the second microphone is controlled to synchronously collect second audio data, and the first audio data is denoised according to the second audio data to obtain target audio data. In the above technical solution, since the second microphone is close to the fan, the fan noise features carried in the second audio data are more obvious; since the first microphone is close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, denoising the first audio data with the second audio data can avoid the situation that the denoising effect is poor due to the unobvious fan noise features, and ensures the clarity of the target audio data. In addition, the above technical solution does not need to draw the amplitude-frequency response correction curve of the low-precision microphone and the loudspeaker correction curve, and can filter the fan noise, reduce the operation amount of the noise filtering process, and improve the denoising efficiency. At the same time, in the denoising process, a pure software processing method is adopted, which only relies on the existing hardware equipment, without the need to additionally introduce other hardware equipment, thereby reducing the hardware cost.

[0017] In a third aspect, some embodiments further provide an audio denoising device, comprising:

[0018] A collection control module is configured to control a first microphone to collect first audio data and a second microphone to synchronously collect second audio data; wherein the first microphone is a microphone close to a standard voice initiation position in a microphone array; and the second microphone is a microphone close to the fan in the microphone array;

[0019] A denoising processing module is configured to denoise the first audio data according to the second audio data to obtain target audio data.

[0020] The audio noise reduction device provided by the above embodiment sets a first microphone close to a standard voice initiation position in a microphone array and a second microphone close to the fan, controls the first microphone to collect first audio data and controls the second microphone to synchronously collect second audio data, performs noise reduction processing on the first audio data according to the second audio data by the noise reduction processing module, and obtains target audio data. In the above technical solution, the second microphone is close to the fan, so that the fan noise characteristics carried in the second audio data are more obvious; the first microphone is close to the standard voice initiation position, so that the voice data carried in the first audio data is more obvious in theory. Therefore, the second audio data is used to perform noise reduction processing on the first audio data, which can avoid the situation that the noise reduction effect is poor due to the unobvious fan noise characteristics, and ensures the clarity of the target audio data. In addition, the above technical solution does not need to draw the amplitude-frequency response correction curve of the low-precision microphone and the loudspeaker correction curve, and can filter the fan noise, reduces the operation amount of the noise filtering process, and improves the noise reduction efficiency. At the same time, in the noise reduction processing process, a pure software processing mode is adopted, which only relies on the existing hardware equipment and does not need to introduce other hardware equipment, thereby reducing the hardware cost.

[0021] In a fourth aspect, some embodiments further provide a computer readable storage medium having stored thereon a computer program, the computer program being executed by a processor to implement the following steps:

[0022] controlling a first microphone to collect first audio data and a second microphone to synchronously collect second audio data; wherein the first microphone is a microphone close to a standard voice initiation position in a microphone array; and the second microphone is a microphone close to the fan in the microphone array;

[0023] performing noise reduction processing on the first audio data according to the second audio data to obtain target audio data.

[0024] The readable storage medium provided by the above embodiment, in the process of executing the stored computer program, a first microphone close to a standard voice initiation position in a microphone array and a second microphone close to the fan are set, the first microphone is controlled to collect first audio data, the second microphone is controlled to synchronously collect second audio data, the first audio data is denoised according to the second audio data, and target audio data is obtained. In the above technical solution, since the second microphone is close to the fan, the fan noise features carried in the second audio data are more obvious; since the first microphone is close to the standard voice initiation position, the voice data carried in the first audio data is more obvious in theory. Therefore, the first audio data is denoised by using the second audio data, which can avoid the situation that the denoising effect is poor due to the fact that the fan noise features are not obvious, and ensures the clarity of the target audio data. In addition, the above technical solution does not need to draw the amplitude-frequency response correction curve of the low-precision microphone and the loudspeaker correction curve, and can filter the fan noise, which reduces the operation amount of the noise filtering process and improves the denoising efficiency. At the same time, in the denoising process, a pure software processing mode is adopted, which only relies on the existing hardware equipment, without the need to additionally introduce other hardware equipment, thereby reducing the hardware cost.

[0025] In a fifth aspect, some embodiments further provide a computer program product comprising a computer program which, when executed by a processor, implements the following steps:

[0026] controlling a first microphone to collect first audio data and a second microphone to synchronously collect second audio data; wherein the first microphone is a microphone close to a standard voice initiation position in a microphone array; and the second microphone is a microphone close to the fan in the microphone array;

[0027] denoising the first audio data according to the second audio data to obtain target audio data.

[0028] The computer program provided in the above embodiment, in the process of being executed, sets a first microphone close to a standard voice initiation position in a microphone array and a second microphone close to the fan, controls the first microphone to collect first audio data, controls the second microphone to synchronously collect second audio data, and performs noise reduction processing on the first audio data according to the second audio data to obtain target audio data. In the above technical solution, since the second microphone is close to the fan, the fan noise features carried in the second audio data are more obvious; since the first microphone is close to the standard voice initiation position, the voice data carried in the first audio data is more obvious in theory. Therefore, the second audio data is used to perform noise reduction processing on the first audio data, which can avoid the situation that the noise reduction effect is poor due to the fact that the fan noise features are not obvious, and ensures the clarity of the target audio data. In addition, the above technical solution does not need to draw the amplitude-frequency response correction curve of the low-precision microphone and the loudspeaker correction curve, and can filter the fan noise, reduce the operation amount of the noise filtering process, and improve the noise reduction efficiency. At the same time, in the noise reduction processing process, a pure software processing mode is adopted, which only relies on the existing hardware equipment, without the need to additionally introduce other hardware equipment, thereby reducing the hardware cost. BRIEF DESCRIPTION OF DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained without creative labor on the basis of these drawings.

[0030] Figure 1 The projection scene schematic diagram of the projection device provided by some embodiments of the present application;

[0031] Figure 2 The projection device optical path schematic diagram provided by some embodiments of the present application;

[0032] Figure 3 The projection device circuit architecture schematic diagram provided by some embodiments of the present application;

[0033] Figure 4 The projection device optical path schematic diagram provided by some embodiments of the present application;

[0034] Figure 5 The system framework schematic diagram for the projection device to realize display control provided by some embodiments of the present application;

[0035] Figure 6A schematic diagram of the relative positions of the microphone array and the fan in a projection device according to some embodiments of the present application;

[0036] Figure 7 A schematic diagram of a process for audio noise reduction according to some embodiments of the present application;

[0037] Figure 8 A schematic diagram of a process for selecting a first microphone according to some embodiments of the present application;

[0038] Figure 9A A schematic diagram of a process for selecting a first microphone according to some embodiments of the present application;

[0039] Figure 9B A schematic diagram of a first frequency response curve according to some embodiments of the present application;

[0040] Figure 9C A schematic diagram of a response bias curve according to some embodiments of the present application;

[0041] Figure 10 A schematic diagram of a process for selecting a second microphone according to some embodiments of the present application;

[0042] Figure 11 A schematic diagram of a process for audio noise reduction according to some embodiments of the present application;

[0043] Figure 12 A block diagram of an audio noise reduction device according to some embodiments of the present application;

[0044] Figure 13 An internal block diagram of a computer device according to one embodiment. DETAILED DESCRIPTION

[0045] Embodiments will be described in detail below with reference to the drawings. Descriptions of specific embodiments are offered herein in order to provide a thorough understanding of the applications. However, it will be apparent to one skilled in the art that embodiments of the present applications are susceptible to modifications beyond those explicitly described and / or illustrated herein. Accordingly, it is submitted that the present applications not be limited to those explicit embodiments, but rather the scope of the present applications is to be given by the appended claims and their equivalents.

[0046] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0047] The terms "first", "second", "third", and the like in the description and in the claims of the present application and above-described drawings are used for distinguishing between similar or identical objects and entities, and do not necessarily indicate a specific order or sequence, unless otherwise specified. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

[0048] The terms "comprises", "comprising", "includes", "including", "has", "having", and their variants are intended to cover and encompass both the assigned and unassigned members, for example, a product or apparatus comprising a list of components does not necessarily include all the components clearly listed, but can include other components not clearly listed or inherent to such products or apparatus.

[0049] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that can perform the functions related to that element.

[0050] The projection device is a device that can project media data onto a projection medium. The projection device can be connected to a computer, a broadcast network, the Internet, a VCD (Video Compact Disc), a DVD (Digital Versatile Disc Recordable), a game console, a DV, etc. through different interfaces to receive media data that needs to be projected. The media data includes, but is not limited to, images, videos, texts, etc. The projection medium includes, but is not limited to, walls, curtains, screens, etc.

[0051] Figure 1 The projection scene schematic diagram of the projection device provided for some embodiments of the present application is shown.

[0052] In some embodiments, the projection device can be a laser television. Taking the laser television as an example, referring to Figure 1 , the laser television can include a projection screen 1 and a projection host 2. The projection screen 1 is fixed on a first position (such as a television background wall, etc.), and the projection host 2 is placed on a second position. By adjusting the relationship between the first position and the second position, the projection host 2 is made to match the projection screen 1, that is, the second position is the best placement position of the projection host 2.

[0053] Figure 2 The light path schematic diagram of the projection device provided for some embodiments of the present application is shown.

[0054] The projection host 2 includes a projection assembly, which includes a laser light source 210, an optical machine 220, and a lens 230. The laser light source 210 provides illumination for the optical machine 220. The optical machine 220 modulates the light beam of the light source and outputs it to the lens 230. The lens 230 performs imaging and projects it to the projection screen 1, and the projection screen 1 presents the projection picture.

[0055] In some embodiments, the laser source 210 includes a laser assembly and an optical lens assembly. The beam emitted by the laser assembly can pass through the optical lens assembly to provide illumination for the optomechanical system 220. For example, the optical lens assembly requires a high level of environmental cleanliness and airtightness; while the chamber in which the laser assembly is installed can be sealed with a lower level of dustproof sealing to reduce sealing costs.

[0056] In some embodiments, the optical engine 220 may include a blue optical engine, a green optical engine, and a red optical engine, and may also include a heat dissipation system, a circuit control system, etc. The blue, green, and red optical engines constitute a three-color optical engine, which is used to modulate the laser that generates the user interface containing pixels. Overheating of the projection device can be avoided by reducing the operating current of the red optical engine integrated within the three-color optical engine.

[0057] In some embodiments, the light-emitting component of a laser TV can also be implemented using an LED light source.

[0058] Figure 3 This is a schematic diagram of the circuit architecture of a projection device provided in some embodiments of this application.

[0059] In some embodiments, see Figure 3 The projector 2 may include a display control circuit 240, a laser light source 210, at least one laser driver component 250, and at least one brightness sensor 260. The laser light source 210 may include at least one laser corresponding to each of the at least one laser driver component. Here, "at least one" refers to one or more, and "more than one" refers to two or more.

[0060] In some embodiments, the laser source 210 includes three lasers corresponding one-to-one with the laser driving assembly 250. These three lasers can be a blue laser 211, a red laser 212, and a green laser 213, respectively. The blue laser 211 emits blue laser light, the red laser 212 emits red laser light, and the green laser 213 emits green laser light. The laser driving assembly 250 can be implemented as including multiple sub-laser driving assemblies, each corresponding to a laser of a different color.

[0061] In some embodiments, the display control circuit 240 is used to output light control signals corresponding to different primary colors to the laser driving assembly 250 to drive the corresponding laser to emit light. For example, the light control signals include blue light control signals, red light control signals, and green light control signals. See also Figure 3The display control circuit 240 is connected with the laser driver assembly 250, and is configured to output at least one light control signal corresponding to each of the three primary colors of each frame of the multi-frame display image, and transmit the at least one light control signal to the corresponding laser driver assembly 250. For example, the display control circuit 240 can be a micro controller unit (MCU), also known as a single chip microcomputer.

[0062] In some embodiments, the laser television can realize adaptive adjustment. For example, by arranging a brightness sensor 260 in the light output path of the laser light source 210, the brightness sensor 260 can detect a first brightness value of the laser light source 210 and send the first brightness value to the display control circuit 240. The display control circuit 240 can obtain a second brightness value corresponding to the driving current of each laser, and when the difference between the second brightness value of the laser and the first brightness value of the laser is greater than a difference threshold value, it is determined that the laser has a COD (Catastrophic optical damage) failure. Then the display control circuit 240 can adjust the current control signal of the laser driver assembly corresponding to the laser until the difference is less than or equal to the difference threshold value, thereby eliminating the COD failure of the laser, reducing the damage rate of the laser, and improving the image display effect of the projection device.

[0063] Figure 4 A schematic diagram of the optical path of the projection device provided in some embodiments of the present application is shown.

[0064] In some embodiments, referring to Figure 4 The optical path structure includes a laser light source 210 and an optical assembly 214. The laser light source 210 can include independently arranged blue lasers 211, red lasers 212 and green lasers 213. The projection device can also be referred to as a three-color projection device. The blue lasers 211, the red lasers 212 and the green lasers 213 are all Mirai Console Loader (MCL) packaged lasers, which are small in size and conducive to compact arrangement of the optical path.

[0065] In some embodiments, the projection host 2 can include a controller including at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first interface to an n-th interface for input / output, a communication bus, and the like. The controller is connected with related hardware of the projection device, such as display control circuit, brightness sensor, distance sensor, image collector, and the like, for controlling functions of the projection device, such as projection, focusing, correction, calibration, on-off screen state adjustment, and the like.

[0066] In some embodiments, the projection device (e.g., a laser television) can be provided with a plurality of types of interfaces on the body, such as a power interface, a USB interface, an HDMI (High Definition Multimedia Interface) interface, a network cable interface, a VGA (Video Graphics Array) interface, a DVI (Digital Visual Interface) interface, and the like, for connecting a signal source for transmitting media.

[0067] In some embodiments, the projection device can directly enter a display interface of a last selected signal source, or a signal source selection interface, after being started, where the signal source can be one of a preset video on demand program, an HDMI interface, a USB interface, a live television interface, and the like. After a target signal source is selected by a user, the projection host 2 can acquire media data from the target signal source, and project the media data on the projection screen 1 for display.

[0068] In some embodiments, the projection host 2 can be configured with an image collector for cooperating with the projection host to realize related adjustment and control of the projection process. For example, the projection device can be configured with a 3D camera, a monocular camera, or a binocular camera.

[0069] In some embodiments, when performing projection picture correction, the projection host 2 can project a correction picture card on the projection screen 1, and control the image collector to collect a correction image containing the correction picture card and the edge of the screen, so as to calculate correction parameters according to the correction image, and control the light machine to automatically correct the projection picture according to the correction parameters, so as to make the picture projected by the projection host 2 consistent with the projection screen, and eliminate projection deviation.

[0070] Figure 5 A system framework schematic diagram for realizing display control of the projection device provided in some embodiments of the present application is shown.

[0071] In some embodiments, see Figure 5 The system framework includes an application service layer, a process communication framework, an operation layer, a framework layer, a correction service, a camera service, a time-of-flight service, and hardware and its drivers. The controller of the projector host 2 controls the overall system architecture and implements projection control of the projection device based on the underlying program logic, including but not limited to functions such as automatic screen entry, automatic obstacle avoidance, automatic focus adjustment, anti-glare, screen on / off control, automatic correction and fine-tuning of the projected image, etc.

[0072] In some embodiments, taking a laser TV as an example, the position of the projection screen 1 is fixed, while the position of the projector 2 may change. For example, the projector 2 may be placed on a TV cabinet, and may move when the user cleans or wipes the TV cabinet, or may shift due to sliding. The projector 2 can be configured with a sensor, such as a gyroscope, to detect changes in its position. During the movement of the projector 2, the gyroscope can sense the displacement of the projector 2 and actively collect position data. Then, the collected position data is sent to the application service layer through the framework layer to support the application data required for user interface interaction and application interaction. The position data can also be used by the controller for data calls in the algorithm service implementation.

[0073] In some embodiments, when performing the calibration service, the controller can call the position data detected by the gyroscope to determine whether the projector 2 has changed position. If the projector 2 has shifted, it can detect whether the offset of the projector 2 exceeds the local calibration range. If it exceeds the local adjustable range, the user is prompted to move the projector 2; if it does not exceed the local adjustable range, automatic calibration and / or fine-tuning calibration can be triggered. The automatic calibration process calculates calibration parameters by acquiring a calibration image containing a calibration chart and the screen edges using an image acquisition device. The fine-tuning calibration process projects a calibration interface containing multiple adjustable fine-tuning points, allowing the user to manually calibrate to a satisfactory projection effect by adjusting the position of any one or more target fine-tuning points.

[0074] In some embodiments, the projection host 2 is also equipped with a distance sensor for detecting distance. The distance sensor may be a time-of-flight (TOF) sensor. The time-of-flight sensor measures the distance between nodes by using the round-trip flight time of the signal between the transmitting end and the reflecting end. After the time-of-flight sensor collects the distance data, it sends the distance data to the time-of-flight service. After the time-of-flight service obtains the distance data, it sends the collected distance data to the application service layer through the process communication framework. The distance data will be used for data calls of the controller, user interface, program application and other interactive uses.

[0075] In some embodiments, the projection host 2 can also configure an image collector, which can be a monocular camera, a binocular camera, a depth camera or a 3D camera, etc. The image collector sends the collected image data to the camera service, and then the camera service sends the image data to the process communication framework and / or the correction service. The process communication framework sends the image data to the application service layer, which will be used for data calling of the controller, user interface, program application, etc.

[0076] In some embodiments, the projection correction parameters are fed back to the correction service through the process communication framework and the application service, and then the correction service sends the projection correction parameters to the operation layer of the projection device. The operating system generates correction instructions according to the projection correction parameters, and sends the correction signaling to the light engine control driving module, so that the light engine driving module adjusts the working condition of the light engine according to the projection correction parameters, and completes the automatic correction of the projection picture.

[0077] In some embodiments, when the correction instruction is detected, the projection device can correct the projection picture. The correlation between the distance, the horizontal included angle and the offset angle can be created in advance, and then the controller of the projection host 2 determines the target included angle between the light engine and the projection screen 1 at the current time by obtaining the current distance from the light engine to the projection screen 1 and combining the correlation, so as to realize the correction of the projection picture. The target included angle is specifically the included angle between the central axis of the light engine and the projection screen 1.

[0078] In some embodiments, the projection device can be refocused after the automatic correction is completed. The controller detects whether the automatic focusing function is enabled. If the automatic focusing function is not enabled, the controller ends the automatic focusing business. If the automatic focusing function is enabled, the controller performs focusing calculation according to the distance detection value of the time-of-flight sensor.

[0079] In some embodiments, the controller queries a preset mapping table according to the distance detection value of the time-of-flight sensor, the preset mapping table records the mapping relationship between the distance and the focal length, so as to obtain the focal length of the projection device corresponding to the distance detection value. Then the middleware sends the obtained focal length to the light engine of the projection device. After the light engine emits laser according to the above focal length, at least one image collector shoots the projection content image, the controller detects the definition of the projection content image to determine whether the current lens focal length is appropriate. If the focal length is not appropriate, focusing adjustment needs to be performed. The projection device adjusts the lens position and shoots, and compares the definition changes of the projection content images before and after the adjustment, to locate the focusing position with the highest definition.

[0080] If the determination result meets the preset completion condition, the control of the automatic focusing process is ended; if the determination result does not meet the preset completion condition, the middleware fine tunes the focal length parameter of the light machine of the projection device, for example, gradually fine tunes the focal length according to a preset step, and sets the adjusted focal length parameter to the light machine again, through multiple photographing, definition evaluation and other steps, and finally locks the optimal focal length through the definition comparison of the projection picture, so as to complete the automatic focusing.

[0081] In some embodiments, at least a lens, a distance sensor and an image collector are arranged on a first plane of the projection host 2, and the image collector can include one or more cameras. The first plane is a plane on the projection host 2 that is parallel to and opposite to the projection screen 1 during projection. It should be noted that the hardware and software configuration and system architecture of the projection device are not limited to the examples of the optional embodiments of the present application.

[0082] In the working process of the above projection device, cooling treatment needs to be performed by means of a fan due to the influence of light source irradiation and other factors. Referring to Figure 6 the relative position diagram of the microphone array and the fan in the projection device, since the fan generates additional noise during operation, in the case of starting the voice function, each microphone in the microphone array can collect this part of noise, so that the collected audio data is not clear, and the normal use of the voice function is affected.

[0083] In order to overcome the above problems, in some optional embodiments, referring to Figure 7 , an audio noise reduction method applied to a controller in a projection device can include the following steps:

[0084] S710, controlling the first microphone to collect first audio data, and the second microphone to synchronously collect second audio data.

[0085] The first microphone is a microphone in the microphone array close to the standard voice initiation position, that is, the signal source during wind noise optimization; and the second microphone is a microphone in the microphone array close to the fan, that is, the noise source during wind noise optimization.

[0086] The standard voice initiation position can be pre-set by a technician according to experience or a large number of tests, for example, it can be a position point at a preset distance from the center of the projection device. Optionally, the preset distance can be 25 cm.

[0087] The first microphone and the second microphone can be pre-set, and the selection mechanism of the first microphone and the second microphone is not limited in the embodiment, as long as the first microphone is close to the standard voice initiation position and the second microphone is close to the fan setting position.

[0088] It can be understood that, since the first microphone is close to the standard voice initiation position, the first microphone can be understood as a microphone capable of collecting clearer user voice instructions (i.e., valid voice information); accordingly, the valid voice information carried in the first audio data is more abundant. Since the second microphone is close to the fan, the second microphone can be understood as a microphone capable of collecting clearer fan noise; accordingly, the fan noise carried in the second audio data is more comprehensive.

[0089] Notably, controlling the first microphone and the second microphone to synchronously collect audio data can ensure that the collection environments of the collected audio data are the same, and avoid the situation that valid voice information is mistakenly filtered out due to different collection environments during subsequent noise reduction processing.

[0090] In an optional implementation, the first microphone can be controlled to collect first audio data, and the second microphone can be controlled to synchronously collect second audio data only when the voice function is turned on, thereby avoiding unnecessary data operation of the controller and wasting of computing resources when the voice function is not turned on.

[0091] Since the energy of the fan noise is positively correlated with the fan speed, i.e., the higher the fan speed, the louder the fan noise, in another optional implementation, the first microphone can be controlled to collect first audio data, and the second microphone can be controlled to synchronously collect second audio data when the voice function is turned on and the fan speed reaches a preset speed threshold. The preset speed threshold can be set or adjusted by a technician according to needs or experience, or repeatedly determined through a large number of tests. In this way, when the fan speed does not reach the preset speed threshold, the fan noise has little or no impact on the voice function, and it is unnecessary to use certain computing resources for subsequent fan noise filtering, thereby further saving unnecessary investment of computing resources.

[0092] S720, performing noise reduction processing on the first audio data according to the second audio data to obtain target audio data.

[0093] For example, noise feature data in the second audio data can be extracted, and the noise feature data can be deducted from the first audio data, so as to achieve the purpose of noise suppression and obtain relatively clear target audio data.

[0094] In some embodiments, a feature extraction network can be invoked to perform feature extraction on the second audio data to obtain noise feature data. The feature extraction network can be implemented based on a traditional machine learning model or a deep learning model, and the network structure of the feature extraction network is not limited in the present embodiment.

[0095] It is worth noting that the feature extraction network can be built-in locally in the projection device or set in a cloud server to reduce the computing cost of the projection device, and only the interface call of the feature extraction network is needed when feature extraction is required.

[0096] The optional embodiment sets the first microphone close to the standard voice initiation position in the microphone array and the second microphone close to the fan, and performs noise reduction processing on the first audio data synchronously collected by the first microphone according to the second audio data collected by the second microphone to obtain target audio data. In the technical solution, since the second microphone is close to the fan, the fan noise characteristics carried in the second audio data are more obvious; since the first microphone is close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, using the second audio data to perform noise reduction processing on the first audio data can avoid the situation that the noise reduction effect is not good due to the unobvious fan noise characteristics, and ensures the clarity of the target audio data. In addition, the technical solution does not need to draw the amplitude-frequency response correction curve of the low-precision microphone and the loudspeaker correction curve, and can filter out the fan noise, reduce the operation amount of the noise filtering process, and improve the noise reduction efficiency. At the same time, in the noise reduction processing process, a pure software processing mode is adopted, which only relies on the existing hardware equipment and does not need to introduce other hardware equipment, thereby reducing the hardware cost.

[0097] On the basis of the technical solutions of the above embodiments, the application also provides some optional embodiments, in which the selection mechanism of the first microphone is refined.

[0098] Referring to Figure 8 The first microphone selection step includes:

[0099] S810, control each microphone in the microphone array to collect the sound signal of the test frequency band emitted by the preset sound source arranged at the standard voice initiation position when the fan is not running, to obtain the first test audio of each microphone.

[0100] The preset sound source can be a test sound cone specially used for testing to emit the sound signal of the test frequency band. The test frequency band can be set by a technician according to needs or experience, or determined through a large number of tests, for example, it can be 100Hz-8000Hz.

[0101] It is worth noting that the preset sound source is arranged at the standard voice initiation position when the fan is not running, so that the fan running interference can be excluded

[0102] The user initiates a voice signal, and the first test audio collected by each microphone in the microphone array can be equivalent to audio data carrying effective voice information.

[0103] S820, for each microphone, performing spectrum analysis on the first test audio of the microphone to obtain a first frequency response curve of the microphone.

[0104] For each microphone, the time-domain signal is converted into a frequency-domain signal by performing spectrum analysis on the first test audio of the microphone, which can effectively obtain the sound intensity under different frequencies. The fluctuation of the sound intensity reflects the distribution of the effective information of the collected first test audio. Therefore, by converting the first test audio in the time domain into the first frequency response curve in the frequency domain, hidden information in the sound signal can be mined.

[0105] It is worth noting that, in the first test audio collection stage, in order to facilitate calculation, an additional microphone can be arranged at the center position of the microphone array, and the sound signal emitted by the preset sound source is corrected through the microphone, so that the first frequency response curve obtained by spectrum analysis is changed from an arch shape to a flat shape, so that the sound intensity of the first frequency response curve is more intuitive.

[0106] S830, selecting a first microphone from the microphones according to the first frequency response curves of the microphones.

[0107] For example, since the first test audio of different microphones is collected synchronously, the sound intensity difference of the first frequency response curves of different microphones can reflect the distance of different microphones from the preset sound source under the same frequency band. Therefore, by the difference between the first frequency response curves of the microphones, a first microphone relatively close to the preset sound source, i.e., close to the standard voice initiation position, can be selected from the microphones.

[0108] In some embodiments, a first key frequency band carrying relatively rich sound information can be selected from the test frequency band according to the peak and valley distribution of the first frequency response curves of the microphones; and a microphone corresponding to a curve segment with a larger (e.g., maximum) fluctuation amplitude in the curve segment corresponding to the first key frequency band in each first frequency response curve can be selected as the first microphone.

[0109] It should be noted that the selection of the first microphone can be performed when the projection device is manufactured, and the subsequent processing of the projection device can be directly based on the selection result. Of course, considering that the relative positional relationship between the microphones and the standard speech initiation position may be changed due to factors such as device aging, device maintenance, or component change in the subsequent projection device, the selection of the first microphone can also be performed periodically according to a preset period during the use of the projection device.

[0110] In the optional embodiments, the first frequency response curves carrying more abundant information are obtained by controlling the microphones in the microphone array to collect the sound signals of the preset sound source arranged at the standard speech initiation position in the test frequency band when the fan is not running, and performing spectrum analysis on the first test audio of each microphone. Since the first frequency response curves corresponding to different microphones can reflect the sound intensity of each microphone at different frequencies, the sound collection capability of the microphone is effectively presented, and the proximity of the microphone to the standard speech initiation position is effectively reflected. Correspondingly, the first microphone close to the standard speech initiation position can be effectively selected from the microphone array by the first frequency response curves of different microphones, so that the selected first microphone is more accurate, and the situation that the selected first microphone is incorrect due to the influence of system errors and other factors in the manufacturing process of the projection device is avoided.

[0111] Based on the technical solutions of the above-mentioned optional embodiments, the present application also provides some optional embodiments, in which the selection step of the first microphone of S830 is refined.

[0112] Referring to the selection step of the first microphone shown in Figure 9A The selection step of the first microphone includes:

[0113] S910, determining a first reference frequency response curve according to the first frequency response curves of the microphones.

[0114] For example, one representative first frequency response curve can be selected from the first frequency response curves of the microphones as the first reference frequency response curve according to the change of the first frequency response curves.

[0115] Optionally, the first frequency response curve with relatively severe fluctuation can be selected as the first reference frequency response curve; or optionally, the curve deviating from other first frequency response curves in the first frequency response curves can be selected as the first reference frequency response curve; or the first reference frequency response curve can also be determined according to the average of the first frequency response curves of the microphones.

[0116] It is worth noting that the average of the first frequency response curves of different microphones is taken to generate the first reference frequency response curve, instead of selecting the first reference frequency response curve from each first frequency response curve. Without analyzing the curve fluctuation and comparing the deviation of different first frequency response curves, the operation is more convenient and the computational complexity is small, which helps to improve the selection efficiency of the first microphone. In addition, since there is usually only one microphone close to the standard speech initiation position in the microphone array, the first reference frequency response curve determined by the average method is usually closer to the first frequency response curve of the first microphone, ensuring the accuracy of the selected first microphone.

[0117] S920, selecting a first microphone from each microphone according to the difference between the first frequency response curve of each microphone and the first reference frequency response curve.

[0118] For example, the microphone corresponding to the first frequency response curve with the smallest difference (e.g., the minimum) from the first reference frequency response curve can be selected as the first microphone.

[0119] In an optional embodiment, a frequency response weight determination function can be introduced to numerically quantify the difference between the first frequency response curve of each microphone and the first reference frequency response curve. The frequency response weight determination function is a monotonic function of the distance between the first frequency response curve and the first reference frequency response curve.

[0120] Optionally, the frequency response weight determination function can be a monotonically increasing function; accordingly, the microphone with the smallest (e.g., the minimum) frequency response weight is selected as the first microphone. Alternatively, the frequency response weight determination function can be a monotonically decreasing function, and accordingly, the microphone with the largest (e.g., the maximum) frequency response weight is selected.

[0121] In an optional implementation, for each microphone, the cumulative response bias of the microphone can be determined according to the distance between the first frequency response curve of the microphone and the first reference frequency response curve; the frequency response weight of the microphone can be determined according to the cumulative response bias of the microphone; in the case where the frequency response weight is inversely proportional to the corresponding cumulative response bias, the microphone with the largest frequency response weight is selected as the first microphone; or in the case where the frequency response weight is proportional to the corresponding cumulative response bias, the microphone with the smallest frequency response weight is selected as the first microphone.

[0122] Exemplarily, at least one frequency test point can be determined by uniformly sampling the test frequency band; wherein the sampling interval can be set or adjusted by the technician according to the need or experience, or repeatedly determined through a large number of tests; the offset distance of the first frequency response curve of the microphone and the first reference frequency response curve at each frequency test point is determined; and the cumulative response offset of the corresponding microphone is determined according to the average or cumulative value of the offset distance at different frequency test points, which is used to quantitatively value the difference between the first frequency response curve of the microphone and the first reference frequency response curve.

[0123] Exemplarily, the frequency response weight of the microphone can be determined according to the cumulative response offset of the microphone. Optionally, in the case that the frequency response weight is inversely proportional to the corresponding cumulative response offset, the microphone with the largest frequency response weight is selected as the first microphone; or optionally, in the case that the frequency response weight is proportional to the corresponding cumulative response offset, the microphone with the smallest frequency response weight is selected as the first microphone.

[0124] Specifically, the frequency response weight of each microphone can be determined by the following formula:

[0125] ;

[0126] wherein W j is the frequency response weight of the jth microphone; N is the total number of test frequency points in the test frequency band; FR ij is the sound intensity of the jth microphone at the ith frequency test point; ABS() is the absolute value function; and M is the total number of microphones in the microphone array.

[0127] Figure 9B Taking a microphone array including four microphones (mic1-mic4) as an example, the first frequency response curve corresponding to each microphone is shown. Wherein the abscissa is the frequency, unit: Hz; the ordinate is the sound intensity, unit: dB. Correspondingly, the average curve of the four first frequency response curves is determined by taking the average value, and the first reference frequency response curve (corresponding to average) is obtained.

[0128] Referring to Figure 9C The response offset curve (mic bias) of each microphone can be obtained by the absolute value of the difference between the first frequency response curve of each microphone and the first reference frequency response curve, which is used to represent the deviation of each first frequency response curve and the first reference frequency response curve at different frequency test points.

[0129] Exemplarily, the frequency response weight of each microphone in the following table can be obtained through the above frequency response weight determination formula, and the mic3 with the highest weight is selected as the first microphone, that is, the signal source in the wind noise optimization.

[0130] Microphone number Frequency response weight mic1 1.892822 mic2 0.667389 mic3 2.208202 mic4 0.775623

[0131] The above optional embodiment assists in selecting the first microphone by introducing the first reference frequency response curve and the difference between different first frequency response curves and the first reference frequency response curve, is convenient and fast in operation, and improves the selection efficiency of the first microphone.

[0132] On the basis of the technical solutions of the above optional embodiments, the application further provides some optional embodiments, in which the selection mechanism of the second microphone is refined.

[0133] Referring to Figure 10 The selection step of the second microphone includes:

[0134] S1010, control each microphone in the microphone array to collect the sound signal emitted by the fan under the condition that the fan is running, and obtain the second test audio of each microphone.

[0135] Under the condition that the fan is running, the sound signal emitted by the fan is collected by each microphone, so that the second test audio collected by each microphone carries rich fan noise information.

[0136] S1020, for each microphone, performing frequency spectrum analysis on the second test audio of the microphone to obtain the second frequency response curve of the microphone.

[0137] For each microphone, the time domain signal is converted into the frequency domain signal by performing frequency spectrum analysis on the second test audio of the microphone, so that the sound intensity under different frequencies can be effectively obtained, and the fluctuation of the sound intensity reflects the distribution of the effective information of the collected second test audio. Therefore, by converting the second test audio in the time domain into the second frequency response curve in the frequency domain, the hidden information in the sound signal can be mined.

[0138] S1030, selecting the second microphone from the microphones according to the second frequency response curves of the microphones.

[0139] Exemplarily, since the second test audios of different microphones are collected synchronously, the sound intensity difference of the second frequency response curves of different microphones can reflect the distance of different microphones from the fan under the same frequency band. Therefore, the second microphone relatively close to the fan position can be selected from the microphones by the difference between the second frequency response curves of the microphones.

[0140] In some embodiments, the second key frequency band with relatively rich sound information can be selected from the test frequency band according to the peak and valley distribution of the second frequency response curve of each microphone; and the microphone with the largest fluctuation amplitude (for example, the maximum) in the curve segment corresponding to the second key frequency band in the second frequency response curve of each microphone can be selected as the second microphone.

[0141] For example, for each microphone, the cumulative response intensity of the microphone can be determined according to the second frequency response curve of the microphone; the wind noise response weight of the microphone can be determined according to the cumulative response intensity of the microphone; in the case that the wind noise response weight is inversely proportional to the cumulative response intensity bias, the microphone with the minimum wind noise response weight can be selected as the second microphone; or in the case that the wind noise response weight is proportional to the cumulative response intensity bias, the microphone with the maximum wind noise response weight can be selected as the second microphone.

[0142] For example, for each microphone, the cumulative response intensity of the microphone can be determined according to the second frequency response curve of the microphone; the wind noise response weight of the microphone can be determined according to the cumulative response intensity of the microphone; in the case that the wind noise response weight is inversely proportional to the cumulative response intensity bias, the microphone with the minimum wind noise response weight can be selected as the second microphone; or in the case that the wind noise response weight is proportional to the cumulative response intensity bias, the microphone with the maximum wind noise response weight can be selected as the second microphone.

[0143] For example, at least one frequency test point can be determined by uniformly sampling the test frequency band; wherein the sampling interval can be set or adjusted by the technical personnel according to the need or experience, or repeatedly determined through a large number of tests; the average or cumulative value of the sound intensity corresponding to each frequency test point on the second frequency response curve of the microphone is determined to obtain the cumulative response intensity of the corresponding microphone, which is used for numerical quantification of the wind fan noise collection capability of the microphone.

[0144] For example, the wind noise response weight of the microphone can be determined according to the cumulative response intensity of the microphone. Optionally, in the case that the wind noise response weight is inversely proportional to the cumulative response intensity bias, the microphone with the minimum wind noise response weight can be selected as the second microphone; or optionally, in the case that the wind noise response weight is proportional to the cumulative response intensity bias, the microphone with the maximum wind noise response weight can be selected as the second microphone.

[0145] Specifically, the wind noise response weight of each microphone can be determined by using the following formula:

[0146] ;

[0147] Q jis the wind noise response weight of the jth microphone; N is the total number of test frequency points in the test frequency band; SPECTRUM ij is the sound intensity of the jth microphone at the i th frequency test point; ABS() is an absolute value function.

[0148] It should be noted that the selection of the second microphone can be performed when the projection device is manufactured, and the subsequent processing of the projection device can be directly based on the selection result. Of course, considering that the relative position relationship between the fan and the microphone may be changed due to factors such as device aging, device maintenance, or component change in the subsequent projection device, the selection of the second microphone can also be performed periodically according to a preset period during the use of the projection device.

[0149] The above optional embodiment obtains the second frequency response curve carrying more abundant information by controlling each microphone in the microphone array to collect the sound signal emitted by the fan in the case that the fan is running, and performing spectrum analysis on each second test audio. Since the second frequency response curve corresponding to each microphone can reflect the sound intensity of each microphone at different frequencies, the wind noise collection capability of the microphone is effectively presented, and the proximity of the microphone to the fan position is effectively reflected. Correspondingly, the second microphone close to the fan position can be effectively selected from the microphone array through the second frequency response curve of each microphone, so that the selected second microphone is more accurate, and the situation that the second microphone selection is incorrect due to the influence of system errors and other factors in the manufacturing process of the projection device is avoided.

[0150] On the basis of the technical solutions of the above embodiments, some optional embodiments are provided, in which the audio noise reduction process of the projection device is described in detail.

[0151] Referring to Figure 11 The audio noise reduction method shown in the figure comprises:

[0152] S1101, control each microphone in the microphone array to collect the sound signal emitted by the preset sound source arranged at the standard speech initiation position in the case that the fan is not running, to obtain the first test audio of each microphone;

[0153] S1102, for each microphone, performing spectrum analysis on the first test audio of the microphone to obtain the first frequency response curve of the microphone;

[0154] S1103, determining the first reference frequency response curve according to the average value of the first frequency response curves of each microphone.

[0155] S1104, for each microphone, determining a cumulative response bias of the microphone according to a distance between the first frequency response curve of the microphone and the first reference frequency response curve;

[0156] S1105, determining a frequency response weight of the microphone according to the cumulative response bias of the microphone;

[0157] S1106A, in the case that the frequency response weight is inversely proportional to the corresponding cumulative response bias, selecting the microphone with the largest frequency response weight as the first microphone; or,

[0158] S1106B, in the case that the frequency response weight is proportional to the corresponding cumulative response bias, selecting the microphone with the smallest frequency response weight as the first microphone.

[0159] S1106A and S1106B can be implemented alternatively, and the present embodiment does not make any limitation in this regard.

[0160] S1107, controlling each microphone in the microphone array to collect a sound signal emitted by the fan to obtain a second test audio of each microphone in the case that the fan is running;

[0161] S1108, for each microphone, performing spectrum analysis on the second test audio of the microphone to obtain a second frequency response curve of the microphone;

[0162] S1109, determining a cumulative response intensity of the microphone according to the second frequency response curve of the microphone;

[0163] S1110, determining a wind noise response weight of the microphone according to the cumulative response intensity of the microphone;

[0164] S1111A, in the case that the wind noise response weight is inversely proportional to the cumulative response intensity bias, selecting the microphone with the smallest wind noise response weight as the second microphone; or,

[0165] S1111B, in the case that the wind noise response weight is proportional to the cumulative response intensity bias, selecting the microphone with the largest wind noise response weight as the second microphone.

[0166] S1111A and S1111B can be implemented alternatively, and the present embodiment does not make any limitation in this regard.

[0167] It is worth noting that S1101-S1106A or S1101-S1106B can be executed before, after or cross S1107-S1111A or S1107-S1111B, or implemented in parallel, and the present embodiment does not make any limitation in this regard.

[0168] S1112, in the case of the voice function being turned on, the first microphone is controlled to collect first audio data, and the second microphone is controlled to synchronously collect second audio data;

[0169] S1113, the first audio data is subjected to noise reduction processing according to the second audio data, to obtain target audio data.

[0170] It should be understood that, although each step in the flowchart involved in each of the above embodiments is shown in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each of the above embodiments can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least part of other steps or steps or stages in other steps.

[0171] Based on the same inventive concept, the embodiments of the present application also provide an audio noise reduction device for implementing the above-mentioned audio noise reduction method. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, so the specific limitations in one or more audio noise reduction device embodiments provided below can refer to the limitations of the audio noise reduction method in the above, which will not be repeated here.

[0172] In one exemplary embodiment, as shown in Figure 12 An audio noise reduction device is provided, comprising: an acquisition control module 1210 and a noise reduction processing module 1220. Wherein,

[0173] The acquisition control module 1210 is configured to control the first microphone to collect first audio data, and the second microphone to synchronously collect second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; the second microphone is a microphone in the microphone array close to the fan;

[0174] The noise reduction processing module 1220 is configured to subject the first audio data to noise reduction processing according to the second audio data, to obtain target audio data.

[0175] In some embodiments, the collection control module 1210 is further configured to control each microphone in the microphone array to collect a sound signal of a preset sound source arranged at a standard voice initiation position in a case where the fan is not running, to obtain first test audio of each microphone; and the audio noise reduction device further comprises: a spectrum analysis module configured to perform spectrum analysis on the first test audio of each microphone, to obtain a first frequency response curve of each microphone; and a microphone selection module configured to select a first microphone from the microphone array according to the first frequency response curve of each microphone.

[0176] In some embodiments, the microphone selection module comprises: a first determination unit configured to determine a first reference frequency response curve according to the first frequency response curve of each microphone; and a first selection unit configured to select the first microphone from the microphone array according to a difference between the first frequency response curve of each microphone and the first reference frequency response curve.

[0177] In some embodiments, the first determination unit is specifically configured to determine the first reference frequency response curve according to an average value of the first frequency response curve of each microphone.

[0178] In some embodiments, the first selection unit is specifically configured to select, from the microphone array, a microphone corresponding to a first frequency response curve that has the smallest difference from the first reference frequency response curve, as the first microphone.

[0179] In some embodiments, the first selection unit is specifically configured to, for each microphone, determine a cumulative response bias of the microphone according to a distance between the first frequency response curve of the microphone and the first reference frequency response curve; determine a frequency response weight of the microphone according to the cumulative response bias of the microphone; select, in a case where the frequency response weight is inversely proportional to the corresponding cumulative response bias, a microphone with the largest frequency response weight as the first microphone; or select, in a case where the frequency response weight is proportional to the corresponding cumulative response bias, a microphone with the smallest frequency response weight as the first microphone.

[0180] In some embodiments, the collection control module 1210 is further configured to control each microphone in the microphone array to collect a sound signal emitted by the fan in a case where the fan is running, to obtain second test audio of each microphone; and the audio noise reduction device further comprises: a spectrum analysis module configured to perform spectrum analysis on the second test audio of each microphone, to obtain a second frequency response curve of each microphone; and a microphone selection module configured to select a second microphone from the microphone array according to the second frequency response curve of each microphone.

[0181] In some embodiments, the microphone selecting module comprises: a second determining unit configured to determine a cumulative response strength of the microphone according to a second frequency response curve of the microphone; a third determining unit configured to determine a wind noise response weight of the microphone according to the cumulative response strength of the microphone; and a second selecting unit configured to select, in a case that the wind noise response weight is inversely proportional to the cumulative response strength bias, a microphone with the minimum wind noise response weight as the second microphone, or select, in a case that the wind noise response weight is proportional to the cumulative response strength bias, a microphone with the maximum wind noise response weight as the second microphone.

[0182] In some embodiments, the collection control module 1210 is specifically configured to control the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data in a case that the voice function is turned on, or control the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data in a case that the voice function is turned on and the fan rotation speed reaches a set rotation speed threshold.

[0183] The above-mentioned various modules in the audio noise reduction device can be all or partially realized by software, hardware and combinations thereof. The above-mentioned various modules can be embedded in or independent of a processor in a computer device in a hardware form, or stored in a memory in the computer device in a software form, so as to be called and executed by a processor to perform the operations corresponding to the above-mentioned various modules.

[0184] In an exemplary embodiment, a computer device is provided, which can be a terminal, and an internal structure diagram of the computer device can be as shown in FIG. 1. Figure 13As shown in the figure. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through the system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capability. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with the external terminal in a wired or wireless manner. The wireless manner can be realized through WIFI, mobile cellular network, near field communication (Near Field Communication, NFC) or other technologies. The computer program is executed by the processor to realize an audio noise reduction method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad or mouse, etc.

[0185] Those skilled in the art can understand that, Figure 13 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0186] In an optional embodiment, Figure 13 The computer device shown in the figure can be the aforementioned projection device, for example, can be a laser television.

[0187] In an exemplary embodiment, a computer device is provided, including a memory and a processor, the memory stores a computer program, and the processor executes the computer program to realize the steps in the above method embodiments. In an embodiment, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by the processor to realize the steps in the above method embodiments.

[0188] In an embodiment, a computer program product is provided, including a computer program, which is executed by the processor to realize the steps in the above method embodiments.

[0189] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant regulations.

[0190] It can be understood by those skilled in the art that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing related hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium. When the computer program is executed, it can include the processes of the above-mentioned embodiments of each method. Any reference to memory, database or other medium used in each embodiment provided by the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in each embodiment provided by the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in each embodiment provided by the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., without being limited thereto.

[0191] Any technical features in the above embodiments can be combined, and for the sake of brevity, not all possible combinations are described above, however, any combination of these technical features is deemed to be within the scope of the present application.

[0192] The above embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation on the patent scope of the present application. It should be pointed out that, for ordinary skilled persons in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A projection device, characterized by The application relates to a projection device, comprising: a fan configured to cool the projection device; a microphone array comprising at least two microphones configured to collect audio data; a controller connected to the microphone array and configured to: control a first microphone to collect first audio data and a second microphone to collect second audio data synchronously, wherein the first microphone is a microphone of the microphone array closest to a standard voice initiation position, and the second microphone is a microphone of the microphone array closest to the fan; perform noise reduction processing on the first audio data according to the second audio data to obtain target audio data; wherein the controller is further configured to: control each microphone of the microphone array to collect a sound signal of a preset sound source arranged at a standard voice initiation position in a test frequency band when the fan is not running, to obtain first test audio of each microphone; perform frequency spectrum analysis on the first test audio of each microphone to obtain a first frequency response curve of each microphone; and select the first microphone from each microphone according to the first frequency response curve of each microphone. Alternatively, control each microphone of the microphone array to collect a sound signal emitted by the fan when the fan is running, to obtain second test audio of each microphone; perform frequency spectrum analysis on the second test audio of each microphone to obtain a second frequency response curve of each microphone; and select the second microphone from each microphone according to the second frequency response curve of each microphone.

2. The projection device according to claim 1, characterized in that, When the controller selects the first microphone from each microphone according to the first frequency response curve of each microphone, the controller is configured to: determine a first reference frequency response curve according to the first frequency response curve of each microphone; and select the first microphone from each microphone according to differences between the first frequency response curve of each microphone and the first reference frequency response curve.

3. The projection device according to claim 2, characterized in that, When the controller determines the first reference frequency response curve according to the first frequency response curve of each microphone, the controller is configured to: determine the first reference frequency response curve according to an average value of the first frequency response curve of each microphone.

4. The projection apparatus according to claim 2, wherein, When the controller selects the first microphone from each microphone according to differences between the first frequency response curve of each microphone and the first reference frequency response curve, the controller is configured to: select, from each microphone, a microphone corresponding to a first frequency response curve with the smallest difference from the first reference frequency response curve as the first microphone.

5. The projection apparatus according to claim 4, wherein, The selection of the microphone corresponding to the first frequency response curve with the smallest difference from the first reference frequency response curve as the first microphone comprises: for each microphone, determining a cumulative response bias of the microphone according to a distance between the first frequency response curve of the microphone and the first reference frequency response curve. determine a frequency response weight of the microphone according to the cumulative response bias of the microphone; select the microphone with the largest frequency response weight as the first microphone in the case that the frequency response weight is inversely proportional to the corresponding cumulative response bias; or select the microphone with the smallest frequency response weight as the first microphone in the case that the frequency response weight is proportional to the corresponding cumulative response bias.

6. The projection apparatus according to any of claims 1-5, characterized in that, The controller is configured to, when performing the selecting the second microphone from the microphones according to the second frequency response curves of the microphones: determine a cumulative response intensity of the microphone according to the second frequency response curve of the microphone; determine a wind noise response weight of the microphone according to the cumulative response intensity of the microphone; select the microphone with the smallest wind noise response weight as the second microphone in the case that the wind noise response weight is inversely proportional to the cumulative response intensity bias; or select the microphone with the largest wind noise response weight as the second microphone in the case that the wind noise response weight is proportional to the cumulative response intensity bias. The controller is configured to, when performing the controlling the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data:

7. The projection apparatus according to any one of claims 1-5, wherein, control the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data in the case that the voice function is turned on; or control the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data in the case that the voice function is turned on and the fan rotation speed reaches a set rotation speed threshold. The method for a projection device including a fan, the method comprising:

8. An audio noise reduction method, comprising: controlling a first microphone to collect first audio data and a second microphone to synchronously collect second audio data; wherein the first microphone is a microphone in a microphone array close to a standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan; performing noise reduction processing on the first audio data according to the second audio data to obtain target audio data; The method further comprises: controlling each microphone in the microphone array to collect a sound signal of a test frequency band emitted by a preset sound source arranged at a standard voice initiation position in the case that the fan is not running, to obtain first test audio of the microphone; performing spectral analysis on the first test audio of the microphone for each microphone to obtain a first frequency response curve of the microphone; and selecting the first microphone from the microphones according to the first frequency response curves of the microphones; or controlling each microphone in the microphone array to collect a sound signal emitted by the fan in the case that the fan is running, to obtain second test audio of the microphone; performing spectral analysis on the second test audio of the microphone for each microphone to obtain a second frequency response curve of the microphone; and selecting the second microphone from the microphones according to the second frequency response curves of the microphones. ​ ​ 9. The method of claim 8, wherein, The selecting the first microphone from the microphones according to the first frequency response curves of the microphones comprises: determining a first reference frequency response curve according to the first frequency response curves of the microphones; selecting the first microphone from the microphones according to differences between the first frequency response curves of the microphones and the first reference frequency response curve.

10. The method of claim 8, wherein, The selecting the second microphone from the microphones according to the second frequency response curves of the microphones comprises: determining a cumulative response intensity of the microphone according to the second frequency response curve of the microphone; determining a wind noise response weight of the microphone according to the cumulative response intensity of the microphone; in a case where the wind noise response weight and the cumulative response intensity bias are inversely proportional, selecting a microphone with the minimum wind noise response weight as the second microphone; or in a case where the wind noise response weight and the cumulative response intensity bias are directly proportional, selecting a microphone with the maximum wind noise response weight as the second microphone.

Images