Projection equipment and audio noise reduction method thereof

Abstract

The invention relates to projection equipment and an audio noise reduction method thereof, and relates to the field of audio processing. The projection equipment comprises a fan which is configured to cool the projection equipment; the microphone array comprises at least two microphones and is configured to collect audio data; the controller is connected with the microphone array and is configured to control the first microphone to collect first audio data and control the second microphone to synchronously collect second audio data; wherein the first microphone is a microphone close to a standard voice initiating position in the microphone array; the second microphone is a microphone arranged close to the fan in the microphone array; and according to the second audio data, performing noise reduction processing on the first audio data to obtain target audio data. According to the technical scheme, the definition of the target audio data is improved, the noise reduction efficiency is improved, and in addition, due to the fact that other hardware equipment does not need to be additionally introduced, the hardware cost input is reduced.

Description

Technical Field

[0001] The present application relates to the field of audio processing, and in particular to a projection device and an audio noise reduction method thereof. Background Art

[0002] During the use of projection equipment such as laser TV, the internal heat of the equipment is high due to reasons such as light source exposure. Therefore, fans are needed to cool down the equipment to reduce the impact of heat on the life of the projection equipment and ensure that the equipment can operate stably for a long time.

[0003] However, when the fan is running, the rotation of its blades will bring additional noise. In the case where a voice recognition module is built into the projection device, the fan noise will have a certain impact on the accuracy of the voice recognition function.

[0004] In traditional technology, when performing noise reduction processing on fan noise in audio, a high-precision microphone and a low-precision microphone are required to collect fan noise, and based on the collected data, the amplitude-frequency response correction curve and the speaker correction curve of the low-precision microphone are drawn, and the noise reduction cycle marking points are determined. Later, when the microphone is in use, noise reduction processing is performed at the noise reduction cycle marking point position according to the amplitude-frequency response correction curve and the speaker correction curve. The above method has a relatively complex calculation process and low calculation efficiency. Summary of the invention

[0005] The present application provides a projection device and an audio noise reduction method thereof to solve the technical problem of the influence of fan noise on the speech recognition function in the prior art, while taking into account the computational efficiency.

[0006] In a first aspect, some embodiments provide a projection device, including:

[0007] a fan, configured to cool the projection device;

[0008] a microphone array, comprising at least two microphones, configured to collect audio data;

[0009] A controller, connected to the microphone array, is configured to:

[0010] Controlling the first microphone to collect the first audio data, and the second microphone to synchronously collect the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan;

[0011] According to the second audio data, the first audio data is subjected to noise reduction processing to obtain target audio data.

[0012] In some embodiments, by setting a first microphone in the microphone array close to the standard voice initiation position and a second microphone set close to the fan, and according to the second audio data collected by the second microphone, the first audio data synchronously collected by the first microphone is subjected to noise reduction processing to obtain the target audio data. In the above technical solution, since the second microphone is set close to the fan, the fan noise characteristics carried in the second audio data are more obvious; since the first microphone is set close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, using the second audio data to perform noise reduction processing on the first audio data can avoid the situation where the noise reduction effect is poor due to the unclear fan noise characteristics, and ensure the clarity of the target audio data. In addition, the above technical solution can filter out the fan noise without drawing the amplitude-frequency response correction curve of the low-precision microphone and the speaker correction curve, reducing the amount of calculation in the noise filtering process and improving the noise reduction efficiency. At the same time, in the process of noise reduction processing, a pure software processing method is adopted, which only relies on the existing hardware equipment, and does not need to introduce other hardware equipment, thereby reducing the hardware cost.

[0013] In a second aspect, some embodiments further provide an audio noise reduction method, including:

[0014] Controlling the first microphone to collect the first audio data, and the second microphone to synchronously collect the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan;

[0015] According to the second audio data, the first audio data is subjected to noise reduction processing to obtain target audio data.

[0016] In some embodiments, by setting a first microphone in the microphone array close to the standard voice initiation position, and a second microphone close to the fan, and controlling the first microphone to collect the first audio data, and controlling the second microphone to synchronously collect the second audio data, and performing noise reduction processing on the first audio data according to the second audio data, the target audio data is obtained. In the above technical solution, since the second microphone is set close to the fan, the fan noise characteristics carried in the second audio data are more obvious; since the first microphone is set close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, using the second audio data to perform noise reduction processing on the first audio data can avoid the situation where the noise reduction effect is poor due to the unclear fan noise characteristics, and ensure the clarity of the target audio data. In addition, the above technical solution can filter out the fan noise without drawing the amplitude-frequency response correction curve of the low-precision microphone and the speaker correction curve, reducing the amount of calculation in the noise filtering process and improving the noise reduction efficiency. At the same time, in the process of noise reduction processing, a pure software processing method is adopted, which only relies on the existing hardware equipment, and does not need to introduce other hardware equipment, thereby reducing the hardware cost.

[0017] In a third aspect, some embodiments further provide an audio noise reduction device, including:

[0018] A collection control module, used to control the first microphone to collect the first audio data, and the second microphone to synchronously collect the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; the second microphone is a microphone in the microphone array close to the fan;

[0019] The noise reduction processing module is used to perform noise reduction processing on the first audio data according to the second audio data to obtain target audio data.

[0020] The audio noise reduction device provided in the above embodiment sets a first microphone near the standard voice initiation position in the microphone array, and a second microphone near the fan, and controls the first microphone to collect the first audio data through the acquisition control module, and controls the second microphone to synchronously collect the second audio data, and performs noise reduction processing on the first audio data according to the second audio data through the noise reduction processing module to obtain the target audio data. In the above technical scheme, since the second microphone is set close to the fan, the fan noise characteristics carried in the second audio data are more obvious; since the first microphone is set close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, using the second audio data to perform noise reduction processing on the first audio data can avoid the situation where the noise reduction effect is poor due to the unclear fan noise characteristics, and ensure the clarity of the target audio data. In addition, the above technical scheme can filter out the fan noise without drawing the amplitude-frequency response correction curve of the low-precision microphone and the speaker correction curve, reducing the amount of calculation in the noise filtering process and improving the noise reduction efficiency. At the same time, during the noise reduction process, pure software processing is adopted, relying only on existing hardware equipment, without the need to introduce additional hardware equipment, thus reducing hardware costs.

[0021] In a fourth aspect, some embodiments further provide a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0022] Controlling the first microphone to collect the first audio data, and the second microphone to synchronously collect the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan;

[0023] According to the second audio data, the first audio data is subjected to noise reduction processing to obtain target audio data.

[0024] The readable storage medium provided by the above embodiment, during the execution of the stored computer program, sets the first microphone in the microphone array close to the standard voice initiation position, and the second microphone set close to the fan, and controls the first microphone to collect the first audio data, and controls the second microphone to synchronously collect the second audio data, and performs noise reduction processing on the first audio data according to the second audio data, so as to obtain the target audio data. In the above technical scheme, since the second microphone is set close to the fan, the fan noise characteristics carried in the second audio data are more obvious; since the first microphone is set close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, using the second audio data to perform noise reduction processing on the first audio data can avoid the situation where the noise reduction effect is poor due to the unclear fan noise characteristics, and ensure the clarity of the target audio data. In addition, the above technical scheme can filter out the fan noise without drawing the amplitude-frequency response correction curve of the low-precision microphone and the speaker correction curve, reducing the amount of calculation in the noise filtering process and improving the noise reduction efficiency. At the same time, during the noise reduction process, pure software processing is adopted, relying only on existing hardware equipment, without the need to introduce additional hardware equipment, thus reducing hardware costs.

[0025] In a fifth aspect, some embodiments further provide a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0026] Controlling the first microphone to collect the first audio data, and the second microphone to synchronously collect the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan;

[0027] According to the second audio data, the first audio data is subjected to noise reduction processing to obtain target audio data.

[0028] The computer program provided in the above embodiment, during the execution of the computer program, sets the first microphone in the microphone array close to the standard voice initiation position, and the second microphone set close to the fan, controls the first microphone to collect the first audio data, and controls the second microphone to synchronously collect the second audio data, and performs noise reduction processing on the first audio data according to the second audio data, so as to obtain the target audio data. In the above technical scheme, since the second microphone is set close to the fan, the fan noise characteristics carried in the second audio data are more obvious; since the first microphone is set close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, using the second audio data to perform noise reduction processing on the first audio data can avoid the situation where the noise reduction effect is poor due to the unclear fan noise characteristics, and ensure the clarity of the target audio data. In addition, the above technical scheme can filter out the fan noise without drawing the amplitude-frequency response correction curve of the low-precision microphone and the speaker correction curve, reducing the amount of calculation in the noise filtering process and improving the noise reduction efficiency. At the same time, in the process of noise reduction processing, a pure software processing method is adopted, which only relies on the existing hardware equipment, and no additional hardware equipment is required, thereby reducing the hardware cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0030] Figure 1 A schematic diagram of a projection scene of a projection device provided in some embodiments of the present application;

[0031] Figure 2 A schematic diagram of the optical path of a projection device provided in some embodiments of the present application;

[0032] Figure 3 A schematic diagram of a circuit architecture of a projection device provided in some embodiments of the present application;

[0033] Figure 4 A schematic diagram of the optical path of a projection device provided in some embodiments of the present application;

[0034] Figure 5 A schematic diagram of a system framework for implementing display control for a projection device provided in some embodiments of the present application;

[0035] Figure 6A schematic diagram of the relative positions of a microphone array and a fan in a projection device provided in some embodiments of the present application;

[0036] Figure 7 A flowchart of an audio noise reduction method provided in some embodiments of the present application;

[0037] Figure 8 A schematic flow chart of a first microphone selection step provided in some embodiments of the present application;

[0038] Fig.9A A schematic diagram of a flow chart of steps for selecting a first microphone provided in some embodiments of the present application;

[0039] Fig. 9B A schematic diagram of a first frequency response curve provided in some embodiments of the present application;

[0040] Fig. 9C A schematic diagram of a response bias curve provided for some embodiments of the present application;

[0041] Fig.10 A schematic diagram of a flow chart of steps for selecting a second microphone provided in some embodiments of the present application;

[0042] Fig.11 A flowchart of an audio noise reduction method provided in some embodiments of the present application;

[0043] Fig.12 A structural block diagram of an audio noise reduction device provided in some embodiments of the present application;

[0044] Fig.13 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0045] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0046] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0047] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0048] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0049] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0050] Projection equipment is a device that can project media data onto a projection medium. Projection equipment can be connected to computers, broadcasting networks, the Internet, VCD (Video Compact Disc), DVD (Digital Versatile Disc Recordable), game consoles, DV and other devices through different interfaces to receive media data to be projected. Among them, media data includes but is not limited to images, videos, texts and other types, and projection media includes but is not limited to physical forms such as walls, curtains, and screens.

[0051] Figure 1 A schematic diagram of a projection scene of a projection device provided in some embodiments of the present application.

[0052] In some embodiments, the projection device may be a laser TV. Taking a laser TV as an example, see Figure 1 The laser TV may include a projection screen 1 and a projection host 2. The projection screen 1 is fixed on a first position (such as a TV background wall, etc.), and the projection host 2 is placed on a second position. By adjusting the relationship between the first position and the second position, the projection image of the projection host 2 is made to match the projection screen 1, that is, the second position is the best placement position for the projection host 2.

[0053] Figure 2 A schematic diagram of the optical path of a projection device provided in some embodiments of the present application.

[0054] The projection host 2 includes a projection component, which includes a laser light source 210, an optical machine 220 and a lens 230. The laser light source 210 provides illumination for the optical machine 220, the optical machine 220 modulates the light beam of the light source and outputs it to the lens 230, the lens 230 forms an image and projects it onto the projection screen 1, and the projection screen 1 presents the projection picture.

[0055] In some embodiments, the laser light source 210 includes a laser assembly and an optical lens assembly, and the light beam emitted by the laser assembly can pass through the optical lens assembly to provide lighting for the optical machine 220. For example, the optical lens assembly requires a higher level of environmental cleanliness and airtight sealing; while the chamber in which the laser assembly is installed can be sealed with a lower level of dustproof sealing to reduce the sealing cost.

[0056] In some embodiments, the optical engine 220 may include a blue optical engine, a green optical engine, and a red optical engine, and may also include a heat dissipation system, a circuit control system, etc. Among them, the blue optical engine, the green optical engine, and the red optical engine constitute a three-color optical engine, which is used to modulate the laser light containing pixel points to generate the user interface, and the overheating of the projection device can be avoided by reducing the working current of the red optical engine integrated in the three-color optical engine.

[0057] In some embodiments, the light-emitting component of the laser TV can also be realized by an LED light source.

[0058] Figure 3 A schematic diagram of the circuit architecture of a projection device provided in some embodiments of the present application.

[0059] In some embodiments, see Figure 3 The projection host 2 may include a display control circuit 240, a laser light source 210, at least one laser driving component 250, and at least one brightness sensor 260. The laser light source 210 may include at least one laser corresponding to the at least one laser driving component. The at least one refers to one or more, and the multiple refers to two or more.

[0060] In some embodiments, the laser light source 210 includes three lasers corresponding to the laser driving assembly 250, and the three lasers may be a blue laser 211, a red laser 212, and a green laser 213. The blue laser 211 is used to emit a blue laser, the red laser 212 is used to emit a red laser, and the green laser 213 is used to emit a green laser. The laser driving assembly 250 may be implemented as including a plurality of sub-laser driving assemblies, each corresponding to a laser of a different color.

[0061] In some embodiments, the display control circuit 240 is used to output light control signals corresponding to different primary colors to the laser driving component 250 to drive the corresponding laser to emit light. For example, the light control signal includes a blue light control signal, a red light control signal, and a green light control signal. Figure 3The display control circuit 240 is connected to the laser driving component 250, and is used to output at least one light control signal corresponding to the three primary colors of each frame of the multi-frame display image, and transmit the at least one light control signal to the corresponding laser driving component 250. For example, the display control circuit 240 can be a micro controller unit (MCU), also known as a single chip microcomputer.

[0062] In some embodiments, the laser TV can achieve adaptive adjustment. For example, by setting a brightness sensor 260 in the light output path of the laser light source 210, the brightness sensor 260 can detect the first brightness value of the laser light source 210 and send the first brightness value to the display control circuit 240. The display control circuit 240 can obtain the second brightness value corresponding to the driving current of each laser, and when the difference between the second brightness value of the laser and the first brightness value of the laser is greater than the difference threshold, it is determined that the laser has a COD (Catastrophic optical damage) failure, and the display control circuit 240 can adjust the current control signal of the laser driving component corresponding to the laser until the aforementioned difference is less than or equal to the difference threshold, thereby eliminating the COD failure of the laser, reducing the damage rate of the laser, and improving the image display effect of the projection device.

[0063] Figure 4 A schematic diagram of the optical path of a projection device provided in some embodiments of the present application.

[0064] In some embodiments, see Figure 4 The optical path structure includes a laser light source 210 and an optical component 214. The laser light source 210 may include an independently arranged blue laser 211, a red laser 212, and a green laser 213. The projection device may also be referred to as a three-color projection device. The blue laser 211, the red laser 212, and the green laser 213 are all module lightweight (Mirai Console Loader, MCL) packaged lasers with a small size, which is conducive to the compact arrangement of the optical path.

[0065] In some embodiments, the projection host 2 may include a controller, which includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, and a communication bus (Bus), etc. The controller is connected to the relevant hardware of the projection device, such as the display control circuit, the brightness sensor, the distance sensor, the image collector, etc., to control the projection, focusing, correction, calibration, switch screen state adjustment, etc. of the projection device.

[0066] In some embodiments, several types of interfaces may be provided on the body of the projection device (e.g., a laser TV), such as a power interface, a USB interface, an HDMI (High Definition Multimedia Interface) interface, a network cable interface, a VGA (Video Graphics Array) interface, a DVI (Digital Visual Interface), etc., to connect a signal source for transmitting media.

[0067] In some embodiments, after the projection device is started, it can directly enter the display interface of the signal source selected last time, or the signal source selection interface, where the signal source is, for example, a preset video-on-demand program, or can be one of the signal sources such as an HDMI interface, a USB interface, a live TV interface, etc. After the user selects the target signal source, the projection host 2 can obtain media data from the target signal source and project the media data onto the projection screen 1 for display.

[0068] In some embodiments, the projection host 2 may be configured with an image collector for cooperating with the projection host to achieve relevant adjustment and control of the projection process. For example, the projection device may be configured with a 3D camera, a monocular camera or a binocular camera.

[0069] In some embodiments, when the projection host 2 is calibrating the projection image, it can project a correction card onto the projection screen 1, and control the image collector to acquire a correction image including the correction card and the edge of the screen, so as to calculate correction parameters based on the correction image, and control the optical machine to automatically calibrate the projection image based on the correction parameters, so that the image projected by the projection host 2 is consistent with the projection screen, eliminating projection deviation.

[0070] Figure 5 A schematic diagram of a system framework for implementing display control for a projection device provided in some embodiments of the present application.

[0071] In some embodiments, see Figure 5 The system framework includes application service layer, process communication framework, operation layer, framework layer, correction service, camera service, flight time service, hardware and its driver, etc. The controller of the projection host 2 controls the overall system architecture and implements projection control of the projection device based on the underlying program logic, including but not limited to automatic screen entry, automatic obstacle avoidance, automatic focus, anti-eye shooting, screen switch control, automatic correction of the projection picture and fine-tuning correction, etc.

[0072] In some embodiments, taking laser TV as an example, the position of the projection screen 1 is fixed, and the position of the projection host 2 may change. For example, the projection host 2 is placed on a TV cabinet, and the user may move the projection host 2 when cleaning or wiping the TV cabinet, or the projection host 2 may shift due to sliding. The projection host 2 may be configured with a sensor for detecting changes in the position of the projection host, such as a gyroscope. During the movement of the projection host 2, the gyroscope can sense the displacement of the projection host 2 and actively collect position data, and then send the collected position data to the application service layer through the framework layer to support the application data required in the user interface interaction and application interaction process. The position data can also be used for data calls by the controller in the algorithm service implementation.

[0073] In some embodiments, when executing the correction service, the controller can call the position data detected by the gyroscope to determine whether the position of the projection host 2 has changed. If the projection host 2 is displaced, it can be detected whether the offset of the projection host 2 exceeds the correction range of the machine. If it exceeds the adjustable range of the machine, the user is prompted to move the projection host 2. If it does not exceed the adjustable range of the machine, automatic correction and / or fine-tuning correction can be triggered. Among them, the automatic correction process is to calculate the correction parameters by collecting the correction image containing the correction chart and the edge of the screen through the image collector. The fine-tuning correction process is to project a correction interface containing multiple fine-tuning points with adjustable positions, so that the user can manually calibrate to a satisfactory projection effect by adjusting the position of any one or more target fine-tuning points.

[0074] In some embodiments, the projection host 2 is also configured with a distance sensor for detecting distance. The distance sensor can be a time of flight (TOF) sensor. The time of flight sensor uses the flight time of a signal between a transmitting end and a reflecting end to measure the distance between nodes. After the time of flight sensor collects the distance data, it sends the distance data to the time of flight service; after the time of flight service obtains the distance data, it sends the collected distance data to the application service layer through the process communication framework. The distance data will be used for interactive use such as controller data calls, user interfaces, and program applications.

[0075] In some embodiments, the projection host 2 may also be configured with an image collector, which may be a monocular camera, a binocular camera, a depth camera or a 3D camera, etc.; the image collector sends the collected image data to the camera service, and then the camera service sends the image data to the process communication framework and / or the correction service; the process communication framework sends the image data to the application service layer, and the image data will be used for interactive use such as the controller's data call, user interface, and program application.

[0076] In some embodiments, data is interacted with the application service through a process communication framework, and then the projection correction parameters are fed back to the correction service through the process communication framework; the correction service sends the projection correction parameters to the operating layer of the projection device, and the operating system generates a correction instruction based on the projection correction parameters, and sends the correction signal to the optical machine control drive module, so that the optical machine drive module adjusts the optical machine working conditions according to the projection correction parameters to complete the automatic correction of the projection picture.

[0077] In some embodiments, when a correction instruction is detected, the projection device can correct the projection image. The association between the distance, horizontal angle and offset angle can be created in advance, and then the controller of the projection host 2 obtains the current distance from the optical machine to the projection screen 1, and determines the target angle between the optical machine and the projection screen 1 at the current moment in combination with the associated relationship, so as to realize the projection image correction. Among them, the target angle is specifically implemented as the angle between the central axis of the optical machine and the projection screen 1.

[0078] In some embodiments, the projection device can be refocused after automatic calibration is completed, and the controller detects whether the automatic focusing function is turned on; if the automatic focusing function is not turned on, the controller will end the automatic focusing service; if the automatic focusing function is turned on, the controller performs focusing calculations based on the distance detection value of the time of flight sensor.

[0079] In some embodiments, the controller queries a preset mapping table based on the distance detection value of the time-of-flight sensor, and the preset mapping table records the mapping relationship between distance and focal length, so as to obtain the focal length of the projection device corresponding to the distance detection value; then the middleware sends the acquired focal length to the optical machine of the projection device; after the optical machine performs laser emission according to the above focal length, at least one image collector captures the projection content image, and the controller performs clarity detection on the projection content image to determine whether the current lens focal length is appropriate. If the focal length is not appropriate, focusing processing is required. The projection device locates the focus position with the highest clarity by adjusting the lens position and shooting, and comparing the clarity changes of the projection content image before and after the adjustment.

[0080] If the judgment result meets the preset completion conditions, the control of the automatic focusing process ends; if the judgment result does not meet the preset completion conditions, the middleware will fine-tune the focal length parameters of the projection device optical machine, such as gradually fine-tuning the focal length according to the preset step length, and setting the adjusted focal length parameters to the optical machine again, through multiple photos, clarity evaluation and other steps, and finally through the clarity comparison of the projection picture, the optimal focal length is locked, thereby completing the automatic focusing.

[0081] In some embodiments, at least a lens, a distance sensor and an image collector are arranged on the first plane of the projection host 2, and the image collector may include one or more cameras. The first plane is a plane on the projection host 2 that is parallel to and opposite to the projection screen 1 during projection. It should be noted that the hardware and software configuration and system architecture of the projection device are not limited to the examples of the optional embodiments of the present application.

[0082] During the operation of the above-mentioned projection equipment, due to the influence of factors such as light source irradiation, fans are required to cool down the equipment. Figure 6 The schematic diagram of the relative position of the microphone array and the fan in the projection device shown is that since the fan will generate additional noise during operation, when the voice function is activated, each microphone in the microphone array will collect this part of the noise, causing the collected audio data to be unclear, affecting the normal use of the voice function.

[0083] In order to overcome the above problems, in some optional embodiments, see Figure 7 , provides an audio noise reduction method, which is applied to a controller in a projection device and may include the following steps:

[0084] S710, controlling the first microphone to collect first audio data, and the second microphone to synchronously collect second audio data.

[0085] Among them, the first microphone is the microphone close to the standard voice initiation position in the microphone array, that is, the signal source during wind noise optimization; the second microphone is the microphone set close to the fan in the microphone array, that is, the noise source during wind noise optimization.

[0086] The standard voice initiation position may be preset by a technician based on experience or a large number of experiments, for example, it may be a position point at a preset distance from the center of the projection device. Optionally, the preset distance may be 25 cm.

[0087] The first microphone and the second microphone may be pre-set. This embodiment does not impose any limitation on the selection mechanism of the first microphone and the second microphone. It is only necessary to ensure that the first microphone is close to the standard voice initiation position and the second microphone is close to the fan setting position.

[0088] It can be understood that, since the first microphone is close to the standard voice initiation position, the first microphone can be understood as a microphone that can collect clearer user voice commands (that is, effective voice information); accordingly, the effective voice information carried in the first audio data is richer. Since the second microphone is set close to the fan, the second microphone can be understood as a microphone that can collect clearer fan noise; accordingly, the fan noise carried in the second audio data is more comprehensive.

[0089] It is worth noting that controlling the first microphone and the second microphone to collect audio data synchronously can ensure that the collection environment of the collected audio data is the same, thereby avoiding the situation where effective voice information is mistakenly filtered out due to different collection environments during subsequent noise reduction processing.

[0090] In an optional implementation, the first microphone can be controlled to collect the first audio data and the second microphone can be controlled to collect the second audio data synchronously only when the voice function is turned on, thereby avoiding the waste of computing resources caused by the controller performing unnecessary data calculations when the voice function is not turned on.

[0091] Since the energy of fan noise is positively correlated with the speed of the fan, that is, the higher the wind speed, the louder the wind noise. Therefore, in another optional implementation, when the voice function is turned on and the fan speed reaches the set speed threshold, the first microphone can be controlled to collect the first audio data, and the second microphone can be controlled to collect the second audio data synchronously. Among them, the preset speed threshold can be set or adjusted by the technician according to needs or experience, or determined repeatedly through a large number of experiments. The advantage of doing this is that when the fan speed does not reach the set speed threshold, since the fan noise will not affect the voice function or has a small impact, there is no need to devote certain computing resources to subsequent wind noise filtering, thereby further saving unnecessary computing resources.

[0092] S720: Perform noise reduction processing on the first audio data according to the second audio data to obtain target audio data.

[0093] Exemplarily, noise characteristic data may be extracted from the second audio data and subtracted from the first audio data, thereby achieving the purpose of noise suppression and obtaining relatively clear target audio data.

[0094] In some embodiments, a feature extraction network may be called to extract features from the second audio data to obtain noise feature data. The feature extraction network may be implemented based on a traditional machine learning model or a deep learning model, and this embodiment does not impose any limitation on the network structure of the feature extraction network.

[0095] It is worth noting that the feature extraction network can be built into the projection device locally or set up in a cloud server to reduce the computing cost of the projection device. It is only necessary to ensure that the interface of the feature extraction network is called when feature extraction is needed.

[0096] The above optional embodiment sets a first microphone in the microphone array close to the standard voice initiation position, and a second microphone set close to the fan, and performs noise reduction processing on the first audio data synchronously collected by the first microphone according to the second audio data collected by the second microphone, so as to obtain the target audio data. In the above technical scheme, since the second microphone is set close to the fan, the fan noise characteristics carried in the second audio data are more obvious; since the first microphone is set close to the standard voice initiation position, the voice data carried in the first audio data is theoretically more obvious. Therefore, the use of the second audio data to perform noise reduction processing on the first audio data can avoid the situation where the noise reduction effect is poor due to the unclear fan noise characteristics, and ensure the clarity of the target audio data. In addition, the above technical scheme can filter out the fan noise without drawing the amplitude-frequency response correction curve of the low-precision microphone and the speaker correction curve, reducing the amount of calculation in the noise filtering process and improving the noise reduction efficiency. At the same time, in the process of noise reduction processing, a pure software processing method is adopted, which only relies on the existing hardware equipment, and does not need to introduce other hardware equipment, thereby reducing the hardware cost.

[0097] Based on the technical solutions of the above embodiments, the present application also provides some optional embodiments. In these optional embodiments, the selection mechanism of the first microphone is refined.

[0098] See also Figure 8 The first microphone selection step shown includes:

[0099] S810, controlling each microphone in the microphone array to collect a sound signal of a test frequency band emitted by a preset sound source set at a standard voice initiation position when the fan is not running, and obtaining a first test audio of each microphone.

[0100] The preset sound source may be a test sound cone dedicated to the test, which is used to emit a sound signal of a test frequency band. The test frequency band may be set by a technician according to needs or experience, or determined through a large number of experiments, for example, it may be 100 Hz to 8000 Hz.

[0101] It is worth noting that when the fan is not running, the preset sound source is set to the standard voice initiation position, so that the fan can be used without interference from the fan.

[0102] The user is simulated to initiate a voice signal. At this time, the first test audio collected by each microphone in the microphone array can be equivalent to audio data carrying valid voice information.

[0103] S820: For each microphone, perform spectrum analysis on a first test audio of the microphone to obtain a first frequency response curve of the microphone.

[0104] For each microphone, by performing spectral analysis on the first test audio of the microphone and converting the time domain signal into a frequency domain signal, the sound intensity under different frequencies can be effectively known, and the fluctuation of the sound intensity reflects the distribution of effective information of the collected first test audio. Therefore, by converting the first test audio in the time domain into the first frequency response curve in the frequency domain, the hidden information in the sound signal can be excavated.

[0105] It is worth noting that in the first test audio acquisition stage, in order to facilitate calculation, an additional microphone can be set at the center of the microphone array, and the sound signal emitted by the preset sound source can be corrected by the microphone, so that the first frequency response curve obtained by the spectrum analysis is changed from an arch shape to a straight shape, making the sound intensity presented by the first frequency response curve more intuitive.

[0106] S830: Select a first microphone from the microphones according to the first frequency response curves of the microphones.

[0107] For example, since the first test audios of different microphones are collected synchronously, the difference in sound intensity of the first frequency response curves of different microphones can reflect the distance of different microphones from the preset sound source in the same frequency band. Therefore, the first microphone that is relatively close to the preset sound source, that is, close to the standard voice initiation position, can be selected from the microphones based on the difference between the first frequency response curves of the microphones.

[0108] In some embodiments, a first key frequency band carrying relatively rich sound information can be selected from the test frequency band based on the distribution of peaks and troughs of the first frequency response curves of each microphone; and a microphone corresponding to a curve segment with a larger fluctuation amplitude (e.g., the largest) among the curve segments corresponding to the first key frequency band of each first frequency response curve can be selected as the first microphone.

[0109] It should be noted that the selection of the first microphone can be performed when the projection device leaves the factory, and the subsequent processing can be directly performed according to the selection result when the projection device is used. Of course, considering that the relative position relationship between each microphone and the standard voice initiation position may be changed due to factors such as device aging, equipment maintenance or component changes, the first microphone can be selected regularly according to a preset period during the use stage of the projection device.

[0110] In the above optional embodiment, when the fan is not running, each microphone in the microphone array is controlled to collect the sound signal of the test frequency band emitted by the preset sound source set at the standard voice initiation position, so as to obtain the first test audio of each microphone, and perform spectrum analysis on each first test audio, so as to obtain a first frequency response curve with richer information. Since the first frequency response curves corresponding to different microphones can reflect the sound intensity of each microphone at different frequencies, the sound collection ability of the microphone is effectively presented, and then the distance of the microphone from the standard voice initiation position is effectively reflected. Accordingly, through the first frequency response curves of different microphones, the first microphone close to the standard voice initiation position can be effectively selected from the microphone array, so that the selected first microphone is more accurate, and the influence of factors such as system errors in the manufacturing process of the projection equipment is avoided, resulting in the occurrence of incorrect selection of the first microphone due to the artificial designation of the first microphone.

[0111] Based on the technical solutions of the above-mentioned optional embodiments, the present application also provides some optional embodiments. In these optional embodiments, the step of selecting the first microphone in S830 is refined.

[0112] See also Fig.9A The steps of selecting the first microphone shown include:

[0113] S910: Determine a first reference frequency response curve according to the first frequency response curve of each microphone.

[0114] Exemplarily, according to the change of the first frequency response curves of each microphone, one representative first frequency response curve may be selected as the first reference frequency response curve.

[0115] Optionally, a first frequency response curve with relatively drastic curve fluctuation can be used as a first reference frequency response curve; or optionally, a curve among the first frequency response curves that deviates from other first frequency response curves can be used as a first reference frequency response curve; or, the first reference frequency response curve can also be determined based on the average value of the first frequency response curves of each microphone.

[0116] It is worth noting that taking the average value of the first frequency response curves of different microphones to generate the first reference frequency response curve instead of selecting the first reference frequency response curve from each first frequency response curve does not require analysis of curve fluctuations or comparison and analysis of deviations of different first frequency response curves. The operation is more convenient and requires less computation, which helps to improve the efficiency of selecting the first microphone. In addition, since there is usually only one microphone in the microphone array that is close to the standard voice initiation position, the first reference frequency response curve determined by taking the average value is usually closer to the first frequency response curve of the first microphone, ensuring the accuracy of the first microphone selected later.

[0117] S920: Select a first microphone from the microphones according to a difference between the first frequency response curve of each microphone and the first reference frequency response curve.

[0118] Exemplarily, a microphone corresponding to a first frequency response curve having a smaller difference (eg, the smallest) from the first reference frequency response curve may be selected from among the microphones as the first microphone.

[0119] In an optional embodiment, a frequency response weight determination function may be introduced to numerically quantify the difference between the first frequency response curves of different microphones and the first reference frequency response curves, wherein the frequency response weight determination function is a monotonic function of the distance between the first frequency response curve and the first reference frequency response curve.

[0120] Optionally, the frequency response weight determination function may be a monotonically increasing function; accordingly, a microphone with a smaller frequency response weight (e.g., the smallest) is selected as the first microphone. Alternatively, the frequency response weight determination function may be a monotonically decreasing function, and accordingly, a microphone with a larger frequency response weight (e.g., the largest) is selected.

[0121] In an optional implementation, for each microphone, the cumulative response bias of the microphone can be determined based on the distance between the first frequency response curve of the microphone and the first reference frequency response curve; the frequency response weight of the microphone can be determined based on the cumulative response bias of the microphone; when the frequency response weight is inversely proportional to the corresponding cumulative response bias, the microphone with the largest frequency response weight is selected as the first microphone; or, when the frequency response weight is directly proportional to the corresponding cumulative response bias, the microphone with the smallest frequency response weight is selected as the first microphone.

[0122] Exemplarily, at least one frequency test point can be determined by uniformly sampling the test frequency band; wherein the sampling interval can be set or adjusted by a technician according to needs or experience, or determined repeatedly through a large number of experiments; the offset distance between the first frequency response curve of the microphone and the first reference frequency response curve at each frequency test point is determined; based on the average value or cumulative value of the offset distances at different frequency test points, the cumulative response offset of the corresponding microphone is determined, which is used to numerically quantify the difference between the first frequency response curve of the microphone and the first reference frequency response curve.

[0123] Exemplarily, the frequency response weight of the microphone can be determined according to the cumulative response bias of the microphone. Optionally, when the frequency response weight is inversely proportional to the corresponding cumulative response bias, the microphone with the largest frequency response weight is selected as the first microphone; or optionally, when the frequency response weight is proportional to the corresponding cumulative response bias, the microphone with the smallest frequency response weight is selected as the first microphone.

[0124] Specifically, the frequency response weight of each microphone may be determined by the following formula:

[0125] ;

[0126] Among them, W j is the frequency response weight of the jth microphone; N is the total number of test frequency points in the test frequency band; FR ij is the sound intensity of the jth microphone at the i-th frequency test point; ABS( ) is the absolute value function; M is the total number of microphones in the microphone array.

[0127] Fig. 9B Taking the microphone array including 4 microphones (mic1~mic4) as an example, the first frequency response curve corresponding to each microphone is shown. The horizontal axis is the frequency in Hz; the vertical axis is the sound intensity in dB. Accordingly, by taking the average value, the average curve of the four first frequency response curves is determined to obtain the first reference frequency response curve (corresponding to average).

[0128] See also Fig. 9C , the response bias curve (mic bias) of each microphone can be obtained by the absolute value of the difference between the first frequency response curve of each microphone and the first reference frequency response curve, which is used to characterize the deviation of each first frequency response curve from the first reference frequency response curve at different frequency test points.

[0129] Exemplarily, the frequency response weights of the microphones in the following table can be obtained by using the above frequency response weight determination formula, and mic3 with the highest weight is selected as the first microphone, that is, the signal source during wind noise optimization.

[0130] Microphone Number Frequency response weight mic1 1.892822 mic2 0.667389 mic3 2.208202 mic4 0.775623

[0131] The optional embodiment introduces the first reference frequency response curve to assist in selecting the first microphone according to the difference between different first frequency response curves and the first reference frequency response curve. The operation is convenient and quick, and the selection efficiency of the first microphone is improved.

[0132] Based on the technical solutions of the above-mentioned optional embodiments, the present application also provides some optional embodiments. In these optional embodiments, the selection mechanism of the second microphone is refined.

[0133] See also Fig.10 The steps of selecting the second microphone shown include:

[0134] S1010, controlling each microphone in the microphone array to collect a sound signal emitted by the fan when the fan is running, and obtaining a second test audio of each microphone.

[0135] When the fan is running, each microphone is controlled to collect the sound signal emitted by the fan, so that each collected second test audio carries rich fan noise information.

[0136] S1020: For each microphone, perform spectrum analysis on a second test audio of the microphone to obtain a second frequency response curve of the microphone.

[0137] For each microphone, by performing spectral analysis on the second test audio of the microphone and converting the time domain signal into a frequency domain signal, the sound intensity under different frequencies can be effectively known, and the fluctuation of the sound intensity reflects the distribution of effective information of the collected second test audio. Therefore, by converting the second test audio in the time domain into the second frequency response curve in the frequency domain, the hidden information in the sound signal can be excavated.

[0138] S1030: Select a second microphone from the microphones according to the second frequency response curve of each microphone.

[0139] For example, since the second test audios of different microphones are collected synchronously, the difference in sound intensity of the second frequency response curves of different microphones can reflect the distance of different microphones from the fan in the same frequency band. Therefore, the second microphone relatively close to the fan can be selected from the microphones based on the difference between the second frequency response curves of the microphones.

[0140] In some embodiments, a second key frequency band carrying relatively rich sound information can be selected from the test frequency band based on the distribution of peaks and troughs of the second frequency response curve of each microphone; and a microphone corresponding to a curve segment with a larger fluctuation amplitude (e.g., the largest) among the curve segments corresponding to the second key frequency band of each second frequency response curve can be selected as the second microphone.

[0141] Exemplarily, for each microphone, the cumulative response strength of the microphone can be determined according to the second frequency response curve of the microphone; the wind noise response weight of the microphone can be determined according to the cumulative response strength of the microphone; when the wind noise response weight is inversely proportional to the cumulative response strength bias, the microphone with the smallest wind noise response weight is selected as the second microphone; or, when the wind noise response weight is directly proportional to the cumulative response strength bias, the microphone with the largest wind noise response weight is selected as the second microphone.

[0142] Optionally, for each microphone, the cumulative response strength of the microphone can be determined according to the second frequency response curve of the microphone; the wind noise response weight of the microphone can be determined according to the cumulative response strength of the microphone; when the wind noise response weight is inversely proportional to the cumulative response strength bias, the microphone with the smallest wind noise response weight is selected as the second microphone; or, when the wind noise response weight is directly proportional to the cumulative response strength bias, the microphone with the largest wind noise response weight is selected as the second microphone.

[0143] Exemplarily, at least one frequency test point can be determined by uniformly sampling the test frequency band; wherein the sampling interval can be set or adjusted by a technician according to needs or experience, or determined repeatedly through a large number of experiments; the average value or cumulative value of the sound intensity corresponding to each frequency test point on the second frequency response curve of the microphone is determined, and the cumulative response intensity of the corresponding microphone is obtained, which is used to numerically quantify the microphone's ability to collect fan noise.

[0144] Exemplarily, the wind noise response weight of the microphone can be determined according to the cumulative response strength of the microphone. Optionally, when the wind noise response weight is inversely proportional to the cumulative response strength bias, the microphone with the smallest wind noise response weight is selected as the second microphone; or optionally, when the wind noise response weight is proportional to the cumulative response strength bias, the microphone with the largest wind noise response weight is selected as the second microphone.

[0145] Specifically, the wind noise response weight of each microphone may be determined by the following formula:

[0146] ;

[0147] Among them, Q jis the wind noise response weight of the jth microphone; N is the total number of test frequency points in the test frequency band; SPECTRUM ij is the sound intensity of the jth microphone at the i-th frequency test point; ABS( ) is the absolute value function.

[0148] It should be noted that the selection of the second microphone can be performed when the projection device leaves the factory, and the subsequent processing can be directly performed according to the selection result when the projection device is used. Of course, considering that the relative position relationship between the fan and the microphone may be changed due to factors such as device aging, equipment maintenance or component changes, the second microphone can be selected regularly according to a preset cycle during the use stage of the projection device.

[0149] The above optional embodiment controls each microphone in the microphone array to collect the sound signal emitted by the fan when the fan is running, obtains the second test audio of each microphone, and performs spectrum analysis on each second test audio, thereby obtaining a second frequency response curve that carries more information. Since the second frequency response curves corresponding to different microphones can reflect the sound intensity of each microphone at different frequencies, the wind noise collection capability of the microphone is effectively presented, and further effectively reflects the distance of the microphone from the fan position. Accordingly, through the second frequency response curves of different microphones, the second microphone close to the fan position can be effectively selected from the microphone array, making the selected second microphone more accurate, avoiding the influence of factors such as system errors in the manufacturing process of the projection equipment, resulting in the artificial designation of the second microphone and the occurrence of incorrect selection of the second microphone.

[0150] Based on the technical solutions of the above embodiments, some optional embodiments are also provided. In these optional embodiments, the audio noise reduction process of the projection device is described in detail.

[0151] See also Fig.11 The audio noise reduction method shown comprises:

[0152] S1101, controlling each microphone in the microphone array to collect a sound signal of a test frequency band emitted by a preset sound source set at a standard voice initiation position when the fan is not running, and obtaining a first test audio of each microphone;

[0153] S1102, for each microphone, performing spectrum analysis on a first test audio of the microphone to obtain a first frequency response curve of the microphone;

[0154] S1103: Determine a first reference frequency response curve according to an average value of the first frequency response curves of the microphones.

[0155] S1104, for each microphone, determining a cumulative response bias of the microphone according to a distance between a first frequency response curve of the microphone and a first reference frequency response curve;

[0156] S1105, determining a frequency response weight of the microphone according to the accumulated response bias of the microphone;

[0157] S1106A, when the frequency response weight is inversely proportional to the corresponding cumulative response bias, selecting a microphone with the largest frequency response weight as the first microphone; or,

[0158] S1106B: When the frequency response weight is proportional to the corresponding cumulative response bias, select the microphone with the smallest frequency response weight as the first microphone.

[0159] Among them, S1106A and S1106B can be implemented either one, and this embodiment does not impose any limitation on this.

[0160] S1107, controlling each microphone in the microphone array to collect a sound signal emitted by the fan when the fan is running, and obtaining a second test audio of each microphone;

[0161] S1108, for each microphone, performing spectrum analysis on a second test audio of the microphone to obtain a second frequency response curve of the microphone;

[0162] S1109, determining a cumulative response strength of the microphone according to a second frequency response curve of the microphone;

[0163] S1110, determining a wind noise response weight of the microphone according to the cumulative response strength of the microphone;

[0164] S1111A, when the wind noise response weight is inversely proportional to the cumulative response strength bias, select the microphone with the smallest wind noise response weight as the second microphone; or,

[0165] S1111B: When the wind noise response weight is proportional to the cumulative response strength bias, select a microphone with the largest wind noise response weight as the second microphone.

[0166] Among them, S1111A and S1111B can be implemented either one, and this embodiment does not impose any limitation on this.

[0167] It is worth noting that S1101 to S1106A or S1101 to S1106B may be executed before or after S1107 to S1111A or S1107 to S1111B, or both of them may be cross-executed or implemented in parallel, and this embodiment does not impose any limitation on this.

[0168] S1112, when the voice function is turned on, controlling the first microphone to collect first audio data, and the second microphone to synchronously collect second audio data;

[0169] S1113: Perform noise reduction processing on the first audio data according to the second audio data to obtain target audio data.

[0170] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0171] Based on the same inventive concept, the embodiment of the present application also provides an audio noise reduction device for implementing the audio noise reduction method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more audio noise reduction device embodiments provided below can refer to the limitations of the audio noise reduction method above, and will not be repeated here.

[0172] In an exemplary embodiment, Fig.12 As shown, an audio noise reduction device is provided, including: a collection control module 1210 and a noise reduction processing module 1220. Among them,

[0173] The acquisition control module 1210 is used to control the first microphone to acquire the first audio data, and the second microphone to synchronously acquire the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan.

[0174] The noise reduction processing module 1220 is used to perform noise reduction processing on the first audio data according to the second audio data to obtain target audio data.

[0175] In some embodiments, the acquisition control module 1210 is also used to control each microphone in the microphone array to acquire a sound signal of a test frequency band emitted by a preset sound source set at a standard voice initiation position when the fan is not running, so as to obtain a first test audio of each microphone; accordingly, the audio noise reduction device also includes: a spectrum analysis module, which is used to perform spectrum analysis on the first test audio of each microphone to obtain a first frequency response curve of the microphone; and a microphone selection module, which is used to select a first microphone from each microphone according to the first frequency response curve of each microphone.

[0176] In some embodiments, the microphone selection module includes: a first determination unit, used to determine a first reference frequency response curve based on a first frequency response curve of each microphone; a first selection unit, used to select a first microphone from each microphone based on a difference between the first frequency response curve of each microphone and the first reference frequency response curve.

[0177] In some embodiments, the first determining unit is specifically configured to determine the first reference frequency response curve according to an average value of the first frequency response curves of the microphones.

[0178] In some embodiments, the first selection unit is specifically configured to select, from among the microphones, a microphone corresponding to a first frequency response curve having a minimum difference from a first reference frequency response curve as the first microphone.

[0179] In some embodiments, the first selection unit is specifically used to determine, for each microphone, a cumulative response bias of the microphone based on the distance between the first frequency response curve of the microphone and the first reference frequency response curve; determine the frequency response weight of the microphone based on the cumulative response bias of the microphone; when the frequency response weight is inversely proportional to the corresponding cumulative response bias, select the microphone with the largest frequency response weight as the first microphone; or, when the frequency response weight is directly proportional to the corresponding cumulative response bias, select the microphone with the smallest frequency response weight as the first microphone.

[0180] In some embodiments, the acquisition control module 1210 is also used to control each microphone in the microphone array to collect the sound signal emitted by the fan when the fan is running to obtain a second test audio of each microphone; accordingly, the audio noise reduction device also includes: a spectrum analysis module, which is used to perform spectrum analysis on the second test audio of each microphone to obtain a second frequency response curve of the microphone; and a microphone selection module, which is used to select a second microphone from each microphone according to the second frequency response curve of each microphone.

[0181] In some embodiments, the microphone selection module includes: a second determination unit, used to determine the cumulative response strength of the microphone according to a second frequency response curve of the microphone; a third determination unit, used to determine the wind noise response weight of the microphone according to the cumulative response strength of the microphone; a second selection unit, used to select the microphone with the smallest wind noise response weight as the second microphone when the wind noise response weight is inversely proportional to the cumulative response strength bias; or, when the wind noise response weight is directly proportional to the cumulative response strength bias, select the microphone with the largest wind noise response weight as the second microphone.

[0182] In some embodiments, the acquisition control module 1210 is specifically used to control the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data when the voice function is turned on; or when the voice function is turned on and the fan speed reaches a set speed threshold, control the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data.

[0183] Each module in the above-mentioned audio noise reduction device can be implemented in whole or in part by software, hardware or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0184] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Fig.13As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, an audio noise reduction method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0185] Those skilled in the art will understand that Fig.13 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0186] In an alternative embodiment, Fig.13 The computer device shown may be the aforementioned projection device, for example, a laser TV.

[0187] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program. In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program implements the steps in the above-mentioned method embodiments when executed by the processor.

[0188] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0189] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0190] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0191] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0192] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A projection device, characterized in that: include: a fan, configured to cool the projection device; a microphone array, comprising at least two microphones, configured to collect audio data; A controller, connected to the microphone array, is configured to: Controlling the first microphone to collect the first audio data, and the second microphone to synchronously collect the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan; According to the second audio data, the first audio data is subjected to noise reduction processing to obtain target audio data.

2. The projection device according to claim 1, characterized in that: The controller is further configured to: Controlling each microphone in the microphone array to collect a sound signal of a test frequency band emitted by a preset sound source set at a standard voice initiation position when the fan is not running, and obtaining a first test audio of each microphone; For each microphone, performing spectrum analysis on a first test audio of the microphone to obtain a first frequency response curve of the microphone; The first microphone is selected from the microphones according to a first frequency response curve of each microphone.

3. The projection device according to claim 2, characterized in that: When the controller performs the step of selecting the first microphone from the microphones according to the first frequency response curves of the microphones, the controller is configured as follows: Determining a first reference frequency response curve according to the first frequency response curve of each microphone; The first microphone is selected from the microphones according to a difference between the first frequency response curve of each microphone and the first reference frequency response curve.

4. The projection device according to claim 3, characterized in that: When the controller determines the first reference frequency response curve according to the first frequency response curve of each microphone, the controller is configured to: The first reference frequency response curve is determined according to an average value of the first frequency response curves of the microphones.

5. The projection device according to claim 3, characterized in that: When the controller performs the step of selecting the first microphone from the microphones according to the difference between the first frequency response curve of each microphone and the first reference frequency response curve, the controller is configured as follows: A microphone corresponding to a first frequency response curve having a minimum difference from the first reference frequency response curve is selected from among the microphones as the first microphone.

6. The projection device according to claim 5, characterized in that: The step of selecting, from among the microphones, a microphone corresponding to a first frequency response curve having the smallest difference from the first reference frequency response curve as the first microphone comprises: For each microphone, determining a cumulative response offset of the microphone according to a distance between a first frequency response curve of the microphone and the first reference frequency response curve; determining a frequency response weight of the microphone according to a cumulative response bias of the microphone; In the case where the frequency response weight is inversely proportional to the corresponding cumulative response bias, selecting the microphone with the largest frequency response weight as the first microphone; or, In a case where the frequency response weight is proportional to the corresponding cumulative response bias, the microphone with the smallest frequency response weight is selected as the first microphone.

7. The projection device according to any one of claims 1 to 6, characterized in that: The controller is further configured to: Controlling each microphone in the microphone array to collect a sound signal emitted by the fan when the fan is running, and obtaining a second test audio of each microphone; For each microphone, performing spectrum analysis on a second test audio of the microphone to obtain a second frequency response curve of the microphone; The second microphone is selected from the microphones according to the second frequency response curve of each microphone.

8. The projection device according to claim 7, characterized in that: When the controller performs the step of selecting the second microphone from the microphones according to the second frequency response curve of each microphone, the controller is configured as follows: determining a cumulative response strength of the microphone according to a second frequency response curve of the microphone; Determining a wind noise response weight of the microphone according to the cumulative response strength of the microphone; When the wind noise response weight is inversely proportional to the cumulative response strength bias, selecting the microphone with the smallest wind noise response weight as the second microphone; or, In a case where the wind noise response weight is proportional to the cumulative response strength bias, the microphone with the largest wind noise response weight is selected as the second microphone.

9. The projection device according to any one of claims 1 to 6, characterized in that: When the controller controls the first microphone to collect the first audio data and the second microphone to synchronously collect the second audio data, the controller is configured as follows: When the voice function is turned on, controlling the first microphone to collect first audio data, and the second microphone to synchronously collect second audio data; or When the voice function is turned on and the fan speed reaches a set speed threshold, the first microphone is controlled to collect first audio data, and the second microphone is controlled to collect second audio data synchronously.

10. An audio noise reduction method, characterized in that: include: Controlling the first microphone to collect the first audio data, and the second microphone to synchronously collect the second audio data; wherein the first microphone is a microphone in the microphone array close to the standard voice initiation position; and the second microphone is a microphone in the microphone array close to the fan; According to the second audio data, the first audio data is subjected to noise reduction processing to obtain target audio data.

Images