Noise reduction method and device for electronic device and electronic device

Abstract

Embodiments of the present application disclose a noise reduction method and device for an electronic device and the electronic device, the electronic device comprising a motor, the noise reduction method comprising: generating audio data according to a recording instruction; and reducing noise in noise segment audio data in the audio data, the starting time of the noise segment audio data in the audio data being determined according to the time when the motor is started. In the embodiments of the present application, the noise in the noise segment audio data in the audio data is reduced, so that the recording effect is not affected by the noise generated by the camera during the zooming process, thereby improving the user experience. At the same time, since the starting time of the audio data is determined according to the time when the motor is started, it is not necessary to detect, identify and estimate the noise, so that accurate noise reduction can be achieved, thereby minimizing the interference with other non-noise signals.

Description

Technical Field

[0001] This application relates to the field of noise reduction technology, and in particular to a noise reduction method, apparatus and electronic device for electronic devices. Background Technology

[0002] With the development of smart terminal technology, extreme camera competitiveness and long device battery life have become important development trends. Enhanced camera capabilities often lead to a significant increase in camera size. For example, to meet the demands of high-quality photography at different focal lengths, the number of cameras increases, resulting in a larger camera footprint and reduced battery space, which clearly contradicts the need for long battery life. Therefore, zoomable camera solutions are the most effective way to resolve this contradiction between camera competitiveness and device battery life.

[0003] Optical zoom cameras are not limited to telescopic structures, but regardless of the structure, zooming requires moving structural components. This movement is typically driven by a motor, such as a stepper motor or voice coil motor. Motors generate significant noise during operation, and this noise is recorded into the video when the user performs optical zoom in video recording mode, affecting the video quality.

[0004] Therefore, how to avoid noise affecting the user's video recording experience is an urgent problem to be solved. Summary of the Invention

[0005] This application provides a noise reduction method, apparatus, and electronic device for electronic devices. By reducing noise in the recorded audio data, the recording effect is not affected by camera zoom noise, thereby improving the user experience.

[0006] The first aspect of this application provides a noise reduction method applicable to electronic devices with motors. The noise reduction method includes: generating audio data according to a recording instruction; and reducing noise in a noise segment of the audio data, wherein the start time of the noise segment is determined based on the start time of the motor.

[0007] Optionally, the start time of the noise segment audio data in the audio data can also be determined based on the time when the camera's optical zoom command is issued.

[0008] Optionally, the electronic device includes a zoom camera module, which includes a motor.

[0009] Based on the first aspect of this application, by reducing noise in the audio data, the recording effect can be made unaffected by camera zoom noise, thereby improving the user experience. Furthermore, since the start time of the noisy audio data segment is determined based on the motor's start time, there is no need to detect, identify, or estimate the noise, enabling precise noise reduction and minimizing interference with other non-noise signals.

[0010] In some possible implementations, the noise reduction method further includes saving the audio data to a memory. Therefore, noise reduction of noisy segments of the audio data specifically includes reading the audio data from the memory and performing noise reduction on the noisy segments of the audio data.

[0011] In this embodiment, the recorded audio data is stored in a memory, and when noise reduction is required, the complete audio data is read from the memory, thereby enabling noise reduction of part or all of the audio data in a complete audio data segment, thus achieving precise noise reduction and minimizing interference with other non-noise signals.

[0012] In some possible implementations, noise reduction is performed on noisy segments of audio data, including noise reduction on noisy segments of audio data in the buffer.

[0013] In this embodiment, by denoising the audio data in the buffer, noise generated in real time can be reduced during the recording process, thereby improving the noise reduction efficiency.

[0014] In some possible implementations, the noise reduction method further includes determining the end time of the noise segment audio data. Noise reduction of the noise segment audio data is stopped at this end time, which is determined based on the time when the motor ends its drive.

[0015] Optionally, the end time can be the moment when the camera's optical zoom command ends, or the moment when the zoomable camera is completely retracted.

[0016] In this embodiment, by determining the end time of the audio data in the noise segment, the start and end times of the audio data in the noise segment can be determined. Therefore, after recording is completed, the audio data can be extracted from the memory for noise reduction, thereby achieving accurate noise reduction and minimizing interference with other non-noise signals.

[0017] In some possible implementations, noise reduction of noisy segments of audio data is performed, including: noise reduction of noisy segments of audio data according to a noise reduction algorithm.

[0018] For example, noise reduction algorithms include one or more of time-domain filter algorithms, spectral subtraction, or time-domain signal subtraction.

[0019] In this embodiment, noise reduction algorithms are used to reduce the noise in the audio data. Therefore, there is no need to detect, identify, or estimate the noise, which can achieve accurate noise reduction and minimize interference with other non-noise signals.

[0020] A second aspect of this application provides a noise reduction device, the noise reduction device comprising:

[0021] The acquisition module is used to acquire recording instructions;

[0022] The processing module is used to generate audio data according to the recording instructions;

[0023] The processing module is also used to reduce noise in the audio data, and the start time of the noise segment audio data in the audio data is determined according to the start time of the motor.

[0024] In some possible implementations, the processing module is also used to save the audio data to a memory. Specifically, the processing module is used to read the audio data from the memory and denoise the noisy segments of the audio data.

[0025] In some possible implementations, the processing module is also used to denoise the noisy segments of the audio data, including: the processing module is specifically used to denoise the noisy segments of the audio data in the buffer.

[0026] In some possible implementations, the processing module is also used to determine the end time of the audio data in the noise segment;

[0027] The processing module is also used to stop noise reduction of the audio data at the end time, which is determined based on the time when the motor ends its drive.

[0028] In some possible implementations, the processing module is also used to reduce noise in the audio data, including:

[0029] The processing module is specifically used to reduce noise in the audio data based on the noise reduction algorithm.

[0030] A third aspect of this application provides an electronic device, the electronic device comprising:

[0031] Electric motor;

[0032] The input module is used to acquire recording instructions;

[0033] The controller is used to generate audio data according to recording instructions;

[0034] The controller is also used to reduce noise in the audio data, and the start time of the noise segment in the audio data is determined according to the start time of the motor.

[0035] In some possible implementations, the controller is also used to save the audio data to memory. Specifically, the controller is used to read the audio data from memory and to denoise noisy segments of the audio data.

[0036] In some possible implementations, the controller is also used to denoise the noisy segments of the audio data, including: the controller is specifically used to denoise the noisy segments of the audio data in the buffer.

[0037] In some possible implementations, the controller is also used to determine the end time of the audio data in the noise segment;

[0038] The controller is also used to stop noise reduction of the audio data at the end time, which is determined based on when the motor ends its drive.

[0039] In some possible implementations, the controller is also used to denoise noisy segments of the audio data, including:

[0040] The controller is specifically used to reduce noise in the audio data based on the noise reduction algorithm.

[0041] A fourth aspect of this application provides an electronic device comprising: one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, cause the electronic device to perform the methods described in the first aspect and any possible implementation thereof.

[0042] The fifth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a computer, causes the computer to implement the methods described in the first aspect and any possible implementation thereof.

[0043] The sixth aspect of this application provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the methods described in the first aspect and any possible implementation thereof.

[0044] The seventh aspect of this application provides a chip including a processor for reading instructions stored in a memory, wherein when the processor executes the instructions, the chip implements the method of the first aspect and any possible implementation thereof.

[0045] It should be noted that the beneficial effects of aspects four through seven mentioned above can be referred to the beneficial effects of aspect one mentioned above, and will not be elaborated here. Attached Figure Description

[0046] Figure 1 This is a schematic diagram of an electronic device with a zoom camera provided in an embodiment of this application;

[0047] Figure 2 This is a schematic diagram of another electronic device with a zoom camera provided in an embodiment of this application;

[0048] Figure 3 This is a schematic diagram of the system architecture of the electronic device provided in the embodiments of this application;

[0049] Figure 4 This is a schematic flowchart illustrating a noise reduction method for electronic devices provided in an embodiment of this application;

[0050] Figure 5 This is a schematic flowchart of another noise reduction method for electronic devices provided in an embodiment of this application;

[0051] Figure 6 This is a schematic diagram of the structure of a noise reduction device provided in an embodiment of this application;

[0052] Figure 7 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0053] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0054] The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to also include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one, two, or more than two. The term “and / or” is used to describe the relationship between related objects, indicating that three relationships may exist; for example, A and / or B can indicate: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character “ / ” generally indicates that the preceding and following related objects are in an “or” relationship.

[0055] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0056] With the development of smart terminal technology, high screen-to-body ratio, superior camera performance, and slim design have become important trends. Some smartphones and tablets have adopted retractable front-facing cameras to meet the increasing demands for higher screen-to-body ratios. However, improved camera capabilities often lead to a significant increase in camera height, resulting in the rear camera protrusion-to-body thickness ratio constantly pushing the limits. This clearly contradicts the design philosophy of slim and lightweight smart devices. The retractable rear camera solution is the most effective way to resolve the contradiction between superior camera performance and a slim design.

[0057] With the rapid development of zoom cameras, more and more smart terminals are adopting retractable cameras. Zoom cameras generally use stepper motors to drive the lens extension and retraction. Stepper motors generate a lot of noise when they operate. Friction, shaking, and eccentricity are all causes of stepper motor noise. Among these, the periodic vibration between magnetic poles caused by electromagnetic driving force produces acoustic response components at the driving frequency and its harmonics, often manifesting as sharp noise in the 1kHz-10kHz range. The human ear is very sensitive to noise in this frequency range, and high-frequency howling noise can cause users to feel irritable and uncomfortable. Therefore, reducing the discomfort caused by stepper motor noise has become a major problem that needs to be solved for zoom cameras in smart terminals.

[0058] One possible noise reduction solution is to obtain different noise responses by modifying the motor drive frequency. By rearranging and switching the drive frequency, the noise can be re-edited, transforming the original high-frequency, harsh mechanical noise into a low-frequency, rhythmic stretching sound effect.

[0059] However, this solution can only improve the perceived noise level and cannot solve the noise suppression problem in video recording scenarios using a zoomable camera.

[0060] Based on this, embodiments of this application provide a noise reduction method, apparatus, and electronic device that, while preserving the original mechanical sound of the camera, can ensure that the video recording effect is not affected by the camera zoom noise.

[0061] Figure 1 and Figure 2 This is a schematic diagram of an electronic device 100 with a zoom camera provided in an embodiment of this application.

[0062] The electronic device 100 is equipped with a zoom camera 200, such as Figure 1 As shown, the zoom camera 200 can be a retractable front-facing lens on the electronic device 100, extending out of the electronic device 100 when taking a picture and retracting back when the picture is finished. Figure 2 As shown, the zoom camera 200 can also be a retractable rear lens on the electronic device 100, extending out of the electronic device 100 when taking a picture and retracting back when the picture is finished. In some embodiments, the zoom camera 200 may include either a retractable front lens or a retractable rear lens.

[0063] It should be understood that the electronic device can be a portable computer, mobile phone, tablet computer, or other handheld smart terminal, or it can be a smart TV / smart screen, smart PTZ camera, or vehicle-mounted mobile device. In the following specific embodiments, the electronic device 100 is mainly described as a mobile phone.

[0064] Figure 3 A schematic diagram of the system architecture of electronic device 100 is shown.

[0065] like Figure 3 As shown, the electronic device 100 includes, but is not limited to, the following modules: controller 101, read-only memory (ROM) 102, random access memory (RAM) 103, integrated circuit bus 104, input / output (I / O) interface 105, memory 106, communication module 107, microphone 108, input module 109, driver 110, motor 111, and noise reduction algorithm parameters 112. The communication module 107 is capable of wired or wireless communication, such as Wi-Fi communication, Bluetooth communication, 2G / 3G / 4G / 5G communication, etc. The input module 109 may include, for example, a touchscreen, keyboard, motion input, etc.

[0066] Among them, controller 101 is the control unit in the system architecture, which can be a central processing unit (CPU) or a microcontroller unit (MCU); ROM 102 is used to store the programs and parameters that the system executes regularly; RAM 103 stores various programs and data required for system operation; integrated circuit bus 104 is a channel for data interaction between different modules; memory 106 is used to store the program for controlling motor 111 and data required for system operation, such as noise reduction algorithm parameters 112; communication module 107 performs communication processing such as upgrading noise reduction algorithm parameters 112 via the network; input module 109 is used to input commands for extending or retracting the lens and input video recording commands; driver 110 can drive motor 111 to move the zoom camera 200; noise reduction algorithm parameters 112 can be upgraded and updated through communication module 107 and stored in memory 106.

[0067] In some embodiments, the controller 101 can perform control actions such as upgrading the noise reduction algorithm parameters 112 and sending control signals to the driver 110 according to a program stored in the ROM 102 or loaded from the memory 106 into the RAM 103. The controller 101, ROM 102, and RAM 103 are connected via an integrated circuit bus 104, and the I / O interface 105 is also connected to the integrated circuit bus 104. The memory 106 is used to store the motor 111 control program and the noise reduction algorithm parameters 112, the communication module 107 is used to provide online upgrade capability for the zoom camera 200 control program and the noise reduction algorithm parameters 112, and the driver 110 receives the I / O control signals sent by the controller 101 and drives the motor 111 to move according to the program settings. The memory 106, the communication module 107, and the driver 110 are all connected to the integrated circuit bus 104 via the I / O interface 105.

[0068] In some embodiments, the electronic device may further include a processor, an external memory interface, internal memory, a universal serial bus (USB) interface, a charging management module, a power management module, a battery, an antenna, a mobile communication module, a wireless communication module, an audio module, a speaker, a receiver, a headphone jack, a sensor module, buttons, a motor, an indicator, a display screen, and a subscriber identification module (SIM) card interface, etc. The sensor module may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc.

[0069] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0070] Figure 4 This is a schematic flowchart illustrating a noise reduction method for electronic devices provided in this application. The noise reduction method can be applied to electronic devices with motors, and it can run the noise reduction algorithm in real time during video recording. Specifically, the noise reduction method may include the following steps:

[0071] 401. Generate audio data according to the recording instructions.

[0072] The controller 100 drives the microphone 108 to start recording audio data according to the recording instruction. This recording instruction can be understood as either a video recording instruction or an audio recording instruction, used to acquire audio data from the video data.

[0073] Optionally, the recording command is a start recording command. The controller 100 can also stop acquiring audio data according to a stop recording command.

[0074] When a user issues a camera optical zoom command through input module 109, controller 100 enables driver 110 to drive motor 111 to move, and controller 100 records the start time of motor 111. For example, the start time is 19:23:42, which is 19:23:42 on a certain day. Here, the first moment can also be understood as the moment when driver 110 receives the camera optical zoom command.

[0075] It should be understood that users can also obtain camera optical zoom commands through other means, such as voice input, etc., which are not limited here.

[0076] For example, controller 100 may start executing step 402 from the moment motor 111 starts.

[0077] Optionally, the controller 100 may also record the moment when the motor 111 ends its motion and stop executing step 402 based on the moment when the motion ends.

[0078] Optionally, the controller 100 may also begin executing step 402 after the moment when the motor 111 finishes its motion.

[0079] 402. Noise reduction is performed on the noisy segments of the audio data.

[0080] For example, when a user issues a video recording command through input module 109, controller 100 enables microphone 108 to start audio recording and obtain audio data. The portion of the audio data containing noise is called noise segment audio data, and the start time of the noise segment audio data is determined based on the start time of motor 111. For example, noise segment audio data is audio data that begins from the moment motor 111 starts. That is, controller 100 can perform real-time noise reduction on the recording audio data starting from the moment motor 111 starts after recording begins. Alternatively, the start time of the noise segment audio data may be before the moment motor 111 starts; the specific timing is not limited here.

[0081] The controller 100 can start recording audio data from the first moment, dividing it into multiple segments and importing them sequentially into a buffer, then performing noise reduction on the audio data in the buffer. For example, every 10ms of audio data collected by the microphone 108, the controller 100 imports that 10ms of audio data into the buffer. The controller 100 then performs noise reduction on this 10ms of audio data. After noise reduction, the controller 100 saves the noise-reduced 10ms of audio data to the memory 106. The controller 100 then imports the next 10ms of audio data collected by the microphone 108 into the buffer. This process continues until the motor 111 stops moving. The audio data in the buffer is the noise segment audio data. By performing noise reduction on the noise segment audio data in the buffer, real-time noise reduction of the audio data is achieved, thereby improving the efficiency of noise reduction.

[0082] The 10ms audio data mentioned above is only an example. In actual applications, the controller 100 can import the recorded audio data of a preset duration into the buffer during the recording process. The size of the preset duration is related to the size of the buffer. This application embodiment does not limit the size of the preset duration.

[0083] It should be noted that the controller 100 reduces noise generated by the zoom camera module, which includes a motor 111 and a zoom camera 200. The zoom camera module may also include other mechanical structures, which may also generate noise.

[0084] Specifically, the controller 100 can call the noise reduction algorithm parameters 112 from the memory 106, and then use the noise reduction algorithm to reduce the noise of the zoom camera module in the audio data.

[0085] For example, the noise reduction algorithm can be one or more of the following: time-domain filter algorithm, spectral subtraction, or time-domain signal subtraction. The noise reduction algorithm is described in detail below.

[0086] 1. Time-domain filter algorithm.

[0087] Time-domain filter algorithms are techniques for processing signals in the time domain. By designing specific filter structures, they perform operations on time-domain samples of the input signal to achieve signal filtering, enhancement, or feature extraction. The core idea is to utilize the correlation of signals in the time domain, using operations such as convolution, weighted averaging, and recursive calculations to suppress noise or extract specific frequency components.

[0088] Time-domain filters are typically implemented through convolution, which involves multiplying the filter coefficients (impulse response) point by point with the time-domain samples of the input signal and summing the results to obtain the output signal.

[0089]

[0090] Where h(k) are the filter coefficients, x(nk) are the input signal, and y(n) are the output signal.

[0091] Time-domain filter algorithms are suitable for noise reduction of noise signals with narrow bandwidths of the main frequency and its harmonics. However, this algorithm requires offline design for different types of electronic devices.

[0092] Specifically, the first step is to model the noise propagation path. Multiple zoom noise samples from several identical electronic devices are recorded using a microphone. A noise propagation model is established based on theoretical modeling and experimental data fitting. The noise is then divided into multiple approximately stationary signal segments in the time domain. A band-stop filter is calculated for each signal segment, with the stopband bandwidth set slightly wider than the noise's dominant frequency and its harmonics. This ensures that the noise component in that signal segment can be filtered out and its interference with non-noise signals is minimized. Electronic devices of the same type are defined as those whose noise propagation path distance between the zoom camera module and the microphone is equal or the difference is less than a preset threshold.

[0093] The filters calculated from each signal segment are combined into a cascaded filter, and the filter parameters (i.e., noise reduction algorithm parameters 112) are stored in memory 106. The controller 100 uses the cascaded filter as a noise reduction algorithm to filter the noisy segments of the audio data.

[0094] It should be noted that the specific type of band-stop filter in this application embodiment is not limited. It can be a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Butterworth filter, a Chebyshev filter, etc. It can be a fixed filter or an adaptive filter. The specific type is not limited here.

[0095] In this embodiment, noise reduction is achieved by using a time-domain filter, which can directly process time-domain signals without frequency-domain conversion, making it easy to implement.

[0096] 2. Spectral subtraction.

[0097] Spectral subtraction is an audio signal noise reduction technique based on frequency domain analysis. Its core idea is to recover a clean audio signal by subtracting the noise spectrum from the spectrum of the noisy frequency signal.

[0098] Assume that the noisy frequency signal y(m) consists of a clean audio signal x(m) and additive noise d(m), that is:

[0099] y(m)=x(m)+d(m)

[0100] Perform a short-time Fourier transform on y(m) to obtain its spectrum Y(ω).

[0101] Assuming the noise spectrum D(ω) is known or can be estimated, the pure audio spectrum X(ω) can be calculated using the following formula:

[0102] X(ω)=Y(ω)-D(ω)

[0103] Since the spectral amplitude cannot be negative, the result is set to zero when |Y(ω)| < |D(ω)|. An inverse Fourier transform is then performed on the processed spectrum X(ω) to obtain the time-domain noise-reduced frequency signal.

[0104] Spectral subtraction is more suitable for relatively stable noise. For example, controller 100 records noise enhanced by a noise effect editing algorithm using microphone 108, divides the noise into multiple approximately stationary signal segments in the time domain, performs a Fast Fourier Transform on each segment, and stores the spectrum of each segment in memory 106. When implementing a noise reduction algorithm on the audio acquired by microphone 108, the noisy audio data is first divided into multiple approximately stationary signal segments in the time domain, a Fast Fourier Transform is performed on each segment, and then the noise spectrum within the corresponding time interval is subtracted. It should be noted that when subtracting the noise spectrum, an adjustable coefficient value (i.e., noise reduction algorithm parameter 112) is usually multiplied. After subtraction, the spectrum is usually saturated to a lower limit to prevent excessive spectrum reduction leading to distortion. The parameter value can be a fixed value selected after pre-tuning or obtained through adaptive calculation. After spectral subtraction, an inverse Fourier transform is performed on the modified spectrum to obtain the time-domain signal, and then the signal segments are spliced ​​together to form a continuous sound signal.

[0105] In this embodiment of the application, noise reduction is achieved by using spectral subtraction, which can suppress the noise spectrum, significantly improve the signal-to-noise ratio of the audio signal, and make the audio clearer.

[0106] 3. Subtract time-domain signals.

[0107] Time-domain signal subtraction is an operation that performs point-by-point subtraction on two signals in the time domain. Its core idea is to extract the differences between signals or suppress noise by directly manipulating the amplitude values ​​of the signals.

[0108] For example, given two time-domain signals x(u) and y(u), the subtracted signal z(u) is defined as:

[0109] z(u) = x(u) - y(u)

[0110] If y(u) is a noisy signal and is highly correlated with the noise components in x(u), then subtraction can eliminate the noise. Here, u represents a discrete time point. The subtraction operation is performed independently at each time point u, directly calculating the difference between the corresponding sample values.

[0111] Optionally, a weighting factor α can be introduced to control the intensity of the subtraction. For example, the subtracted signal z(u) is defined as:

[0112] z(u) = x(u) - α·y(u)

[0113] Time-domain signal subtraction requires multiple microphones 108 working together on the electronic device. During recording, the audio signal recorded by the microphone 108 farther from the zoom camera module is used as the first signal, and the audio signal recorded by the microphone 108 closer to the zoom camera module is used as the second signal. The first signal is subtracted from the second signal multiplied by a coefficient value, minimizing the zoom noise in the first signal, thus achieving noise removal. It should be noted that the coefficient value is the noise reduction algorithm parameter 112, which can be a fixed value selected after pre-tuning or obtained through adaptive calculation. After completing the time-domain signal subtraction, a gain coefficient is usually multiplied to prevent the loudness of non-noise signals from being excessively reduced.

[0114] In this embodiment, noise reduction is achieved by subtracting time-domain signals, which can extract signal differences or suppress noise through point-by-point subtraction. This method has the advantages of simple calculation and strong real-time performance.

[0115] In one possible implementation, the noise reduction algorithm parameter 112 can be represented by an index value. As an example, if the index value is 0, the noise reduction algorithm parameter 112 is a parameter of the time-domain filter, indicating that the noise reduction algorithm is a time-domain filter algorithm; if the index value is 1, the noise reduction algorithm parameter 112 is a coefficient value of the noise spectrum, indicating that the noise reduction algorithm is spectral subtraction; if the index value is 2, the noise reduction algorithm parameter 112 is the coefficient value multiplied after subtracting the first signal from the second signal, indicating that the noise reduction algorithm is time-domain signal subtraction.

[0116] As another example, the index value can also be bit information. For instance, when the bit information is "00", the noise reduction algorithm parameter 112 is a parameter of the time-domain filter, indicating that the noise reduction algorithm is a time-domain filter algorithm; when the bit information is "01", the noise reduction algorithm parameter 112 is the coefficient value of the noise spectrum, indicating that the noise reduction algorithm is spectral subtraction; when the bit information is "10", the noise reduction algorithm parameter 112 is the coefficient value multiplied after subtracting the first signal from the second signal, indicating that the noise reduction algorithm is time-domain signal subtraction.

[0117] It should be noted that the above noise reduction algorithm is only an example. In practical applications, other noise reduction algorithms can also be used to reduce the noise of the zoom camera module in the audio data of the noisy segment. The specific method is not limited here.

[0118] The above explains how the noise reduction algorithm runs in real time during video recording. Figure 5 This is a schematic flowchart illustrating another noise reduction method provided in this application embodiment. This noise reduction method can be applied to electronic devices with a zoom camera. After recording is complete, the noise reduction method reads audio data from the memory and performs noise reduction according to a noise reduction algorithm. Specifically, the noise reduction method may include the following steps:

[0119] 501. Determine the start time of the audio data.

[0120] When a user issues a video recording command through input module 109, controller 100 enables microphone 108 to start audio recording, and controller records the start time of the audio data at that moment.

[0121] It should be understood that users can also obtain video recording instructions through other means, such as voice input, etc., which are not limited here.

[0122] 502. Determine the start time of the audio data in the noise segment.

[0123] When the user issues a camera optical zoom command through the input module 109, the controller 100 enables the motor driver 110 to drive the motor 111 to move. The controller 100 records the moment when the motor 111 starts moving as the start time of the noise segment audio data.

[0124] It should be understood that users can also obtain camera optical zoom commands through other means, such as voice input, etc., which are not limited here.

[0125] 503. Determine the end time of the audio data in the noise segment.

[0126] When motor 111 stops moving, controller 100 records the moment when motor 111 stops moving as the end time of the noise segment audio data. Alternatively, controller 100 can record the moment when the camera's optical zoom command ends as the end time of the noise segment audio data, or controller 100 can record the moment when the zoomable camera is completely retracted as the end time of the noise segment audio data.

[0127] 504. Noise reduction is performed on the variable zoom camera module in the audio data.

[0128] The controller 100 can save the recorded audio data in the memory 106. When noise reduction processing is required, the controller 100 reads the audio data from the memory 106 and determines the noise segment audio data based on the start time and end time of the motor 111. The method for determining the noise segment audio data can be referred to the description below.

[0129] It should be noted that the audio data can be understood as the audio data before it is merged with the corresponding image into video data, or it can be understood as the audio data obtained after the video data is decomposed. The specific meaning is not limited here.

[0130] Subtracting the start time of the audio data from the start time of the noise segment yields the time interval between the start times of the noise segment and the start times of the audio data, which is the first duration. Subtracting the start time of the audio data from the end time of the noise segment yields the time interval between the end time of the noise segment and the start time of the audio data, which is the second duration.

[0131] After recording, if the time point T1 is the first duration elapsed from the start time of the audio data, and the time point T2 is the second duration elapsed from the start time of the audio data, then the noise segment audio data is the audio data between T1 and T2. In other words, the noise segment audio data is determined based on T1 and T2. The controller 100 accesses the audio data in the memory 106, and based on T1 and T2, obtains the noise segment audio data containing noise, and then performs noise reduction on this noise segment audio data.

[0132] It should be noted that, in the embodiments of this application, denoising the audio data of the noise segment can be understood as denoising the noise in the audio data of the noise segment.

[0133] Optionally, the controller 100 can perform noise reduction according to a noise reduction algorithm. For a description of the noise reduction algorithm, please refer to the above embodiments. Specific details will not be repeated here.

[0134] Figure 6 This is a structural schematic diagram of a noise reduction device provided in an embodiment of this application.

[0135] like Figure 6 As shown, the noise reduction device 600 may include a motor 601, an input module 602, and a processing module 603. The input module 602 is used to acquire recording instructions. The processing module 603 is used to generate audio data according to the recording instructions. The processing module 603 is also used to reduce noise in the noise segment of the audio data, the start time of which is determined based on the start time of the motor 601.

[0136] In one possible implementation, the motor 601 is located within the zoom camera module.

[0137] In another possible implementation, processing module 603 is also used to save the audio data to a memory. Processing module 602 is specifically used to read the audio data from the memory and perform noise reduction on the noisy segments of the audio data.

[0138] In another possible implementation, the processing module 603 is also used to reduce noise in the audio data, including: the processing module 603 is specifically used to reduce noise in the audio data in the buffer.

[0139] In another possible implementation, the processing module 603 is also used to determine the moment when the audio data of the noise segment ends;

[0140] The processing module 603 is also used to stop noise reduction of the audio data of the noise segment at the end time, which is determined according to the time when the motor 601 ends driving.

[0141] In another possible implementation, the processing module 602 is specifically used to denoise the noisy segments of the audio data according to the denoising algorithm.

[0142] In another possible implementation, the noise reduction algorithm includes one or more of the following: time-domain filter algorithm, spectral subtraction, or time-domain signal subtraction.

[0143] Figure 7 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0144] like Figure 7As shown, the electronic device 700 may include a controller 701, a memory 702, an input module 703, a motor driver 705 (such as a stepper motor driver), a motor 706 (such as a stepper motor), a microphone 707, and a zoomable camera 200, among other hardware structures. The controller 701 may be the controller 101 described above, such as a CPU or MCU; the memory 702 may be the memory 106 described above, storing noise reduction algorithm parameters 112; for example, the memory 702 may be ROM, RAM, or flash memory (FLASH); the input module 703 may be the input module 109 described above, such as a touchscreen, keyboard, or motion input; the motor driver 705 may include a motor driver chip (such as a stepper motor driver chip), which can send PWM signals to drive the motor 706 to move according to the controller signal; the movement of the motor 706 can cause the zoomable camera 200 to extend or retract. It should be understood that the motor 706 in this application may be a stepper motor, but other types of motors may be used in other embodiments, and this is not limited.

[0145] Figure 7 The controller 701 is electrically connected to the input module 703, the memory 702, the microphone 707, and the motor driver 705. The motor driver 705 is electrically connected to the motor 706. The motor driver 705 controls the motor 706 to run according to the instructions of the controller 701. The motor 706 is used to drive the zoom camera 200.

[0146] Optionally, the electronic device 700 may further include a communication module 704, which can be the aforementioned communication module 107, capable of wireless communication, specifically including Wi-Fi communication, Bluetooth communication, 2G / 7G / 4G / 5G communication, etc. The memory 702 may be electrically connected to the communication module 704.

[0147] In one possible implementation, the input module 601 is used to acquire recording instructions.

[0148] The controller 701 is used to generate audio data according to the recording instructions.

[0149] The controller 701 is also used to reduce noise in the audio data of the noise segment, the start time of which is determined by the start time of the motor 706.

[0150] In one possible implementation, the motor 706 is located within the zoom camera module.

[0151] In another possible implementation, controller 701 is also used to save audio data to memory 702. Specifically, controller 701 is used to read audio data from memory 702 and to reduce noise in the noisy segments of the audio data.

[0152] In another possible implementation, the controller 701 is also used to denoise the noisy segments of the audio data, including: the controller 701 is specifically used to denoise the noisy segments of the audio data in the buffer.

[0153] In another possible implementation, controller 701 is also used to determine the moment when the audio data of the noise segment ends;

[0154] The controller 701 is also used to stop noise reduction of the audio data of the noise segment at the end time, which is determined based on the time when the motor 706 ends driving.

[0155] In another possible implementation, the controller 701 is specifically used to obtain the noise reduction algorithm parameters 112 from the memory 702, thereby implementing the noise reduction algorithm to reduce the noise segment of the audio data.

[0156] This application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the noise reduction method in the above embodiments.

[0157] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the noise reduction method described in the above embodiments.

[0158] Furthermore, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory. The memory stores computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the chip to perform the noise reduction methods in the above-described method embodiments.

[0159] In this embodiment, the electronic device, computer-readable storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0160] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0161] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0162] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0163] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0164] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0165] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0166] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A noise reduction method for an electronic device, the electronic device including a motor, characterized in that, include: Generate audio data according to the recording instructions; The noise segment of the audio data is denoised, and the start time of the noise segment in the audio data is determined based on the start time of the motor.

2. The noise reduction method according to claim 1, characterized in that, The motor is located in the zoom camera module.

3. The method according to claim 1 or 2, characterized in that, The method further includes: Save the audio data to a memory; The noise reduction of the audio data in the audio data includes: The audio data is read from the memory and noise is reduced on the audio data.

4. The method according to claim 1 or 2, characterized in that, The noise reduction of the audio data in the audio data includes: Noise reduction is performed on the noisy segments of the audio data in the buffer.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: Determine the end time of the audio data in the noise segment; Noise reduction of the audio data is stopped at the end time, which is determined based on the time when the motor ends its drive.

6. The method according to any one of claims 1 to 5, characterized in that, The noise reduction of the audio data in the audio data includes: The noise segment of the audio data is denoised according to the noise reduction algorithm.

7. The method according to claim 6, characterized in that, The noise reduction algorithm includes one or more of the following: time-domain filter algorithm, spectral subtraction, or time-domain signal subtraction.

8. A noise reduction device for use in electronic devices with motors, characterized in that, include: The acquisition module is used to acquire recording instructions; The processing module is used to generate the audio data according to the recording instruction; The processing module is also used to reduce noise in the audio data of the noise segment, wherein the start time of the noise segment audio data in the audio data is determined according to the start time of the motor.

9. The noise reduction device according to claim 8, characterized in that, The motor is located in the zoom camera module.

10. The noise reduction device according to claim 8 or 9, characterized in that, The processing module is also used to save the audio data to a memory; The processing module is further configured to perform noise reduction on the noisy segments of the audio data, including: The processing module is specifically used to read the audio data from the memory and to reduce noise in the audio data.

11. The noise reduction device according to claim 8 or 9, characterized in that, The processing module is further configured to reduce noise in the audio data, including: The processing module is specifically used to reduce noise in the audio data of the noisy segment in the audio data in the buffer.

12. The noise reduction device according to any one of claims 8 to 11, characterized in that, The processing module is also used to determine the end time of the noise segment audio data; The processing module is also configured to stop noise reduction of the audio data at the end time, the end time being determined based on the time when the motor ends driving.

13. The noise reduction device according to any one of claims 8 to 12, characterized in that, The processing module is further configured to reduce noise in the audio data, including: The processing module is specifically used to reduce noise in the audio data of the noisy segment according to the noise reduction algorithm.

14. An electronic device, characterized in that, include: Electric motor; The input module is used to acquire recording instructions; A controller is configured to generate audio data according to the recording instructions; The controller is also used to reduce noise in the audio data, wherein the start time of the noise segment audio data in the audio data is determined according to the start time of the motor.

15. The electronic device according to claim 14, characterized in that, It includes a zoom camera module, and the motor is located in the zoom camera module.

16. The electronic device according to claim 14 or 15, characterized in that, The controller is also used to save the audio data to a memory; The controller is further configured to reduce noise in the audio data, including: The controller is specifically used to read the audio data from the memory and to reduce noise in the audio data.

17. The electronic device according to claim 14 or 15, characterized in that, The controller is further configured to reduce noise in the audio data, including: The controller is specifically used to reduce noise in the audio data of the noisy segment in the audio data in the buffer.

18. The electronic device according to any one of claims 14 to 17, characterized in that, The controller is also configured to determine the end time of the noise segment audio data; The controller is also configured to stop noise reduction of the audio data at an end time, the end time being determined based on the time when the motor ends driving.

19. The electronic device according to any one of claims 14 to 18, characterized in that, The controller is further configured to reduce noise in the audio data, including: The controller is specifically used to reduce noise in the audio data of the noise segment according to the noise reduction algorithm.

20. A computer-readable storage medium, characterized in that, It stores a computer program thereon, which, when executed by a computer, causes the computer to perform the method as described in any one of claims 1 to 7.

21. A computer program product containing instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1 to 7.

22. A chip, characterized in that, The device includes a processor and a memory, wherein the processor is configured to read instructions stored in the memory, and when the processor executes the instructions, causes the chip to implement the method of any one of claims 1 to 7.

Images