IMAGING DEVICE, CONTROL METHOD, AND PROGRAM

Abstract

To suppress excessive noise reduction.SOLUTION: An imaging device according to the present invention comprises: a microphone for external sounds for collecting external sounds of the imaging device; a noise reference microphone for acquiring the drive noise of the drive unit of the imaging device or an external device connected to the imaging device; noise calculation means for calculating a sound signal regarding the drive noise from signals acquired by the noise reference microphone; determination means for determining whether or not to update a sound signal regarding the external sound on the basis of signals acquired by the noise reference microphone; update means for updating the sound signal regarding the external sound on the basis of the result of determination by the determination means; and noise reduction means for reducing the noise calculated by the noise calculation means from the signal acquired by the microphone for external sounds, on the basis of the sound signal regarding the external sound having been updated by the update means.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an imaging device capable of reducing noise. [Background technology]

[0002] Conventionally, a process for reducing lens drive noise using a noise reference microphone installed inside the camera body in addition to a main microphone for recording external sound has been known. Patent Document 1 discloses a method for reducing lens drive noise by successively estimating the impulse response of the transfer system of the main microphone from the noise reference microphone so as to minimize the result of subtracting the impulse response. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 6-253387 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in addition to lens drive noise, the noise reference microphone is contaminated with noise generated by factors other than lens drive, such as self-noise, such as electrical noise in the microphone, and external sound leakage. Additionally, the external sound picked up by the main microphone may contain sounds in the same frequency band as the lens drive noise. In this case, if subtraction processing using the noise reference microphone is performed on the external sound picked up by the main microphone without taking into account the volume of the external sound, the signal from the main microphone may be excessively reduced.

[0005] Therefore, an object of the present invention is to prevent excessive noise reduction. [Means for solving the problem]

[0006] The present invention provides an imaging device comprising: an external sound microphone for acquiring external sound of the imaging device; a noise reference microphone for acquiring drive noise of a drive unit of the imaging device or an external device connected to the imaging device; noise calculation means for calculating an audio signal of the drive noise from a signal acquired by the noise reference microphone; update means for storing the audio signal related to the external sound acquired by the external sound microphone and updating the stored audio signal related to the external sound when it is determined to update the audio signal related to the external sound based on the signal acquired by the noise reference microphone; and reduction means for performing processing to reduce the drive noise from the audio signal acquired by the external sound microphone based on the audio signal related to the external sound stored in the update means and the audio signal of the drive noise calculated by the noise calculation means. The updating means stores an average value of the audio signal acquired by the external audio microphone as the audio signal related to the external audio, and when it determines to update the audio signal related to the external audio, updates the stored audio signal related to the external audio with the average value of the stored audio signal related to the external audio and the audio signal input from the external audio microphone. [Effects of the Invention]

[0007] According to the present invention, excessive noise reduction can be suppressed. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram of an imaging device according to a first embodiment. [Figure 2] FIG. 2 is a block diagram of an audio processing unit and a sound collection unit according to the first embodiment. [Figure 3] 4 is a flowchart of an audio processing unit according to the first embodiment. [Figure 4] FIG. 6 is a diagram showing changes in the influence of acquired external environmental sound spectra in the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the present invention, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the present invention. Note that the same components will be denoted by the same reference numerals in the following description.

[0010] [First embodiment] FIG. 1 is a block diagram showing an example of the configuration of an image capturing device 100, which is an example of an audio processing device according to the present invention.

[0011] The image capturing device 100 comprises a lens unit 101, a lens control unit 102, an image capturing unit 103, an image processing unit 104, a control unit 105, an operation unit 106, a display / playback unit 107, a recording unit 108, an audio processing unit 200, and an audio pickup unit 300.

[0012] The lens unit 101 performs operations such as autofocus and zooming based on signals from the lens control unit 102. The lens unit 101 may be detachable from the image capturing device 100. In this embodiment, the lens unit 101 is connected to the image capturing device 100. The image capturing unit 103 captures an optical image of a subject using an image capturing element such as a CMOS sensor, and outputs a digitized image signal to the image processing unit 104. The image processing unit 104 adjusts the image quality of the image signal input from the image capturing unit 103 and outputs the result. The control unit 105 includes a processor or the like, and sends control signals to each block of the image capturing device 100. The operation unit 106 inputs user instructions to start and stop capturing, or capture settings, using a touch panel, dial, or the like. The display / playback unit 107 displays captured images and videos or plays audio signals associated with the videos. The recording unit 108 records captured images and videos.

[0013] The audio processing unit 200 and the audio collection unit 300 will be described in detail with reference to FIG.

[0014] <Description of Audio Processing Unit 200> The audio processing unit 200 comprises an A / D conversion unit 201, a waveform extraction unit 202, a time-frequency conversion unit 203, a noise detection unit 204, a noise ratio calculation unit 205, a noise calculation unit 206, an external environmental sound update unit 207, a noise reduction unit 208, an audio correction unit 209, and a frequency-time conversion unit 210.

[0015] A / D conversion unit 201 samples analog signals from multiple microphones input from sound collection unit 300 at the same timing and converts them into digital signals. Although shown as a single block in FIG. 2, it has the same number of A / D converters as the number of input channels from sound collection unit 300. The converted digital microphone signals are output to waveform extraction unit 202.

[0016] The waveform cutout unit 202 cuts out the digital audio signal input from the A / D conversion unit 201 to a predetermined length for each channel, performs windowing processing, and outputs the result to the time-frequency conversion unit 203. The series of processes performed by the waveform cutout unit 202 is, for example, half-overlap processing used in general audio processing. In this embodiment, the waveform cutout unit 202 cuts out 1024 samples while shifting the time every 512 samples, performs windowing processing using a sine window or Hann window, and outputs an audio signal. Thereafter, while shooting is being performed, signal processing is performed in units of the above number of samples (hereinafter referred to as frames).

[0017] The time-frequency conversion unit 203 converts the audio signal input from the waveform extraction unit 202 from a time-domain audio signal into an audio spectrum in the frequency domain by processing such as Fourier transform. The audio spectrum generated from the audio signal input from the external audio microphone 301 is output to the external environmental sound update unit 207 and the noise reduction unit 208. Hereinafter, the audio to be picked up by the external audio microphone 301 is referred to as external audio or environmental sound. On the other hand, the noise reference sound spectrum, which is the audio spectrum generated from the audio signal input from the noise reference microphone 302, is output to the noise detection unit 204, the noise ratio calculation unit 205, and the noise calculation unit 206.

[0018] The noise detection unit 204 performs noise detection based on the noise reference sound spectrum input from the time-frequency conversion unit 203. Then, the noise detection unit 204 determines whether noise is detected for each frame of the input noise reference sound spectrum. In this embodiment, the noise detection unit 204 detects long-term noise that continues for a certain period of time and is generated by the operation of a driving unit such as the lens unit 101, which is a noise source, and short-term noise that is generated by the start or end of the operation of the driving unit, for example.

[0019] The noise detection unit 204 also detects a background noise spectrum based on the noise reference sound spectrum. In this embodiment, the background noise is constantly present noise such as electronic noise from a microphone or white noise. Here, the background noise spectrum in this embodiment is calculated by, for example, averaging, for a certain period of time, the noise reference sound spectra of frames in which long-term noise and short-term noise are not detected.

[0020] The noise detection unit 204 may also perform other noise detection processes. For example, the noise detection unit 204 generates a frame by averaging noise reference sound spectra for a certain period (predetermined period) input before the frame in which noise is detected, and calculates the average value of the difference in speech spectrum between this frame and the frame in which noise is detected. The noise detection unit 204 then detects noise based on whether the calculated average value exceeds a predetermined threshold. The noise detection unit 204 may also detect the type of noise by setting multiple predetermined thresholds for each type of noise. The noise detection unit 204 may also use only speech spectra in a predetermined frequency band when detecting noise. The results detected by the noise detection unit 204 are output to the noise ratio calculation unit 205 and the noise calculation unit 206.

[0021] The noise ratio calculation unit 205 calculates the noise ratio using the noise reference sound spectrum of a frame in which noise is detected by the noise detection unit 204 and the background noise spectrum. In this embodiment, the noise ratio is calculated as the average value of the absolute value for each frequency band of the noise reference sound spectrum of a frame in which noise is detected by the noise detection unit 204 divided by the background noise spectrum corresponding to each frequency band. Note that the calculation of the noise ratio may be limited to using only the noise reference sound spectrum and the background noise spectrum of a predetermined frequency band. The calculated noise ratio is output to the external environmental sound update unit 207.

[0022] The noise calculation unit 206 calculates the noise component spectrum contained in the signal from the noise reference microphone 302 by subtracting the background noise spectrum from the noise reference sound spectrum input from the noise detection unit 204. The noise component is an audio signal of noise contained in the audio signal. The noise calculation unit 206 performs correction to bring the noise component of the audio signal input from the noise reference microphone closer to the noise component contained in the audio signal input from the external audio microphone 301. Here, the noise calculation unit 206 is provided with a correction coefficient table for this correction, and obtains the corrected noise spectrum by multiplying the noise component spectrum of the audio signal input from the noise reference microphone by a correction coefficient corresponding to the noise component spectrum of the audio signal input from the noise reference microphone. The noise calculation unit 206 outputs the corrected noise spectrum to the noise reduction unit 208.

[0023] On the other hand, the external environmental sound update unit 207 has a storage unit (not shown) that stores the external environmental sound spectrum, and updates the stored external environmental sound spectrum as appropriate. The external environmental sound spectrum is obtained by converting an audio signal picked up by an external audio microphone into an audio spectrum. Since the external environmental sound spectrum becomes an audio signal that is recorded as a moving image, it is desirable that it does not contain noise such as lens driving noise. In this embodiment, in order to reduce the influence of lens driving noise on the external environmental sound spectrum, if the noise ratio calculated by the noise ratio calculation unit 205 in each processed frame is less than a predetermined threshold, the external environmental sound spectrum is updated as shown in Equation 1. [Formula 1] S′ Senv (ω,t)=(S Senv(ω,t)*α+|S mic (ω,t)|) / (α+1)

[0024] where S mic (ω, t) is the audio spectrum of the audio signal input from the external audio microphone 301 (external audio spectrum), S Senv (ω,t) is the external environmental sound spectrum. ω is the frequency, t is the processing frame, and α is a given coefficient. S′ Senv (ω, t) is the new external environmental sound spectrum after updating. In this way, the new external environmental sound spectrum after updating is a weighted average of the external environmental sound spectrum. Note that at t=0, that is, at the start of the noise reduction process, the initial value S of the external environmental sound spectrum is Senv (ω,0) is |S mic (ω, 0)|. Alternatively, the initial value S Senv For (ω, 0), a pre-calculated average value of background noise such as background noise of the external audio microphone 301 may be used.

[0025] In Equation 1, the influence of the external audio spectrum of the previous frame on the current processing frame t on the next frame is 1 / (α+1). For example, when α=1, as shown in Figure 4, the influence of a certain frame is halved with each frame. In this way, the influence of the previous frame on a certain frame is stronger. This improves the ability of the recorded audio to follow changes in the external audio.

[0026] If the noise ratio calculated by the noise ratio calculation unit 205 is equal to or greater than a predetermined threshold, this means that the audio signal input from the external audio microphone 301 contains a large amount of noise components, and therefore the external environmental sound update unit 207 does not update the external environmental sound spectrum.

[0027] The noise reduction unit 208 reduces noise from the external speech spectrum input from the time-frequency conversion unit 203 by using the corrected noise component spectrum input from the noise calculation unit 206, thereby generating a noise-reduced speech spectrum. The noise reduction unit 208 uses, for example, a Wiener filter as noise reduction means.

[0028] The audio correction unit 209 compares the audio spectrum input from the noise reduction unit 208 with the external environmental sound spectrum updated by the external environmental sound update unit 207 for each frequency band. In bands where the audio spectrum input from the noise reduction unit 208 is smaller than the external environmental sound spectrum, there is a high possibility that frequency signals that should originally be included in the environmental sound have been excessively reduced. Therefore, in this embodiment, the audio correction unit 209 corrects the audio spectrum in the frequency band of the audio spectrum input from the noise reduction unit 208 using the following Equation 2. [Formula 2] S′ S (ω,t)=(|S S (ω,t)|+|S′ env (ω,t)|) / 2*phas(S S (ω,t)

[0029] where S S (ω,t) is the speech spectrum input from the noise reduction unit 208, S' S (ω, t) is the audio spectrum after corrected noise reduction. phas(N) is a function for extracting the phase component of N (i.e., a function that sets the amplitude of each frequency component to 1). This process corrects (suppresses) excessive noise reduction, thereby suppressing deterioration in sound quality. Note that no correction is performed on bands where the audio spectrum input from the noise reduction unit 208 is equal to or larger than the external environmental sound spectrum.

[0030] The audio correction unit 209 outputs the audio spectrum to the frequency-time transform unit 210 regardless of whether or not correction processing has been performed.

[0031] The frequency-time transform unit 210 transforms the audio spectrum input from the audio correction unit 209 into a waveform signal in the time domain by processing such as inverse Fourier transform. In this embodiment, the frequency-time transform unit 210 outputs the audio spectrum while adding frames using half overlap.

[0032] The output signal is recorded in the recording unit 108 together with the image signal from the image processing unit 104 .

[0033] <Explanation of the sound pickup unit 300> The sound collection unit 300 comprises an external sound microphone 301 and a noise reference microphone 302 .

[0034] The external audio microphone 301 consists of two microphones and is installed to mainly capture the audio of the subject. In this embodiment, the two microphones capture audio corresponding to the audio signals of the Rch and Lch of the stereo audio.

[0035] The noise reference microphone 302 is installed so as to mainly capture driving noise inside the camera housing. For example, the noise reference microphone 302 is installed without an opening to the outside and shielded by an exterior so that external sound is not input. The noise reference microphone is also installed near the external sound microphone 301 to detect noise that is closer to the noise input to the external sound microphone 301. Alternatively, the noise reference microphone may be installed near the noise source to capture noise more accurately.

[0036] As a result of the functions of the various components described above, lens drive noise is reduced in accordance with the volume of the external audio input to the external audio microphone, and excessive noise reduction can be prevented, thereby suppressing deterioration in sound quality after noise reduction.

[0037] 3 is a flowchart of the audio processing of this embodiment. The processing of this flowchart is executed when the start of video recording is triggered. The following processing is realized by a control unit such as a processor included in the image capturing device 100 controlling each unit of the image capturing device 100, such as the audio processing unit 200 and the sound collection unit 300. The control unit also realizes the processing of this flowchart by expanding software recorded in the image capturing device 100 into memory and executing it.

[0038] In step S101, the waveform cutting unit 202 cuts out a waveform from the digital signal that is the output of the A / D conversion unit 201. The cut-out signal is output to the time-frequency conversion unit 203.

[0039] In step S102, a fast Fourier transform (FFT) process is performed on the digital signal input to the time-frequency conversion unit 203. The signal obtained by FFT processing the signal from the external audio microphone 301 is output to the external environmental sound update unit 207 and the noise reduction unit 208, and the signal obtained by FFT processing the signal from the noise reference microphone 302 is output to the noise detection unit 204, the noise ratio calculation unit 205, and the noise calculation unit 206.

[0040] In step S103, noise detection processing is performed by the noise detection unit 204. Here, a background noise spectrum is obtained from frames in which noise is not detected, and is output to the noise ratio calculation unit 205 and noise calculation unit 206 together with the noise detection result.

[0041] In step S104, the noise ratio calculation unit 205 performs a noise ratio calculation process. Here, the noise ratio is calculated using the noise reference sound spectrum and the background noise spectrum of the frame in which noise is detected by the noise detection unit 204. Then, in step S105, it is determined whether the noise ratio is less than a predetermined threshold. If the noise ratio is less than the predetermined threshold, the process of step S106 is performed, and the external environmental sound update unit 207 updates the external environmental sound spectrum according to Equation 1. Note that, in this embodiment, the process of step S106 is performed when the noise ratio is less than the predetermined threshold, but the process of step S106 may also be performed when the noise ratio is equal to or less than the predetermined threshold.

[0042] In step S107, a corrected noise spectrum is calculated by multiplying the noise component spectrum included in the noise reference microphone signal by a correction coefficient corresponding to the noise component spectrum of the noise reference microphone signal. Here, the noise component spectrum before correction is calculated in the noise calculation unit 206 by subtracting the background noise spectrum from the speech spectrum of the noise reference signal for the frame in which noise was detected by the noise detection unit 204. The calculated corrected noise spectrum is output to the noise reduction unit 208.

[0043] In step S108, the noise reduction unit 208 performs processing to reduce noise components contained in the audio signal input from the external audio microphone 301. Here, noise is reduced from the external audio spectrum calculated in step S102 using the corrected noise component spectrum calculated in step S107, and a noise-reduced audio spectrum is generated. In step S108, a Wiener filter, for example, is used as the noise reduction means. Note that, for example, waveform subtraction in the frequency domain may be performed as the noise reduction means in step S108.

[0044] In step S109, the noise-reduced audio spectrum is compared for each frequency band with the external environmental sound spectrum updated by the external environmental sound update unit 207. In frequency bands where the noise-reduced audio spectrum is smaller, the noise-reduced audio spectrum is corrected in step S110. In this embodiment, Equation 2 is used for this correction. Note that the noise-reduced audio spectrum is output to the frequency-time transform unit 210 regardless of whether it has been corrected in step S110.

[0045] In step S111, an inverse fast Fourier transform (IFFT) process is performed on the audio spectrum input to the frequency-time transform unit 210. The converted signals are sequentially output to the recording unit 108 and recorded together with the image (moving image).

[0046] Then, the processes of steps S101 to S111 are repeated until it is determined in step S112 that the shooting has ended. The shooting is determined to have ended when, for example, the user performs an operation to end the recording of the moving image.

[0047] By performing the processing control described above, lens drive noise is reduced in accordance with the volume of the external audio input to the external audio microphone, and excessive noise reduction can be prevented, thereby suppressing deterioration in sound quality after noise reduction.

[0048] The external environmental sound updating unit 207 may perform updating based on the gain of the audio signal acquired by the noise reference microphone, rather than the noise ratio. This is because if the audio signal acquired by the noise reference microphone is sufficiently large, it can be determined that there is a high possibility that the audio signal contains drive noise.

[0049] In this embodiment, correction is performed by the audio correction unit 209 after the noise reduction process by the noise reduction unit 208 (steps S109 and S110), but other methods may be used for the process. For example, by performing noise reduction process in advance in the noise reduction unit 208 in step S108 using the external environmental sound spectrum as the lower limit value for noise reduction, the audio correction unit 209 and the processes of steps S109 and S110 may be omitted.

[0050] Furthermore, when the degree of noise reduction in the noise reduction unit 208 is low, the correction processing in the audio correction unit 209 may perform further noise reduction processing.

[0051] In this embodiment, the recording medium of the recording unit 108 is, for example, a semiconductor memory such as an SD card or a CFExpress card.

[0052] The image capturing device 100 may further include a data compression unit to compress the data of images and moving images to be recorded.

[0053] In this embodiment, the drive noise is lens drive noise, but noise generated by other drive units on the image capturing device body side may also be reduced in the same manner.

[0054] In this embodiment, each of the units constituting the audio processing unit 200, except for the A / D conversion unit 201, may be processed by a program using a CPU. Furthermore, each of the units constituting the audio processing unit 200, except for the A / D conversion unit 201, may be processed by hardware such as a DSP, a dedicated LSI, or other electronic circuit.

[0055] In this embodiment, the noise detection unit 204 performs noise detection based on a signal from the noise reference microphone 302. However, it may also be possible to obtain control information for the drive unit, which is the source of the noise, and perform noise detection based on that information. For example, it may also be possible to obtain a control signal for driving the lens from the lens control unit 102 and perform noise detection based on that information. The drive information may include, for example, the drive speed, drive direction, and position of the drive unit. The drive information may also be, for example, instruction information from the lens control unit to instruct the lens unit to start or end lens drive. Alternatively, the drive information may be internal information used by the lens control unit to determine whether to drive the lens, such as detection of an out-of-focus state or an in-focus state. A signal from the external audio microphone 301 may also be used.

[0056] The noise calculation unit 206 may perform different noise estimation processes depending on the type of noise detected by the noise detection unit 204 .

[0057] In this embodiment, the noise calculation unit 206 is provided with a correction coefficient table in advance, but it may be configured to calculate the correction coefficient table sequentially. For example, it may be configured to calculate and update an appropriate correction coefficient table based on the signal from the external audio microphone 301 and the signal from the noise reference microphone 302.

[0058] In this embodiment, the external environmental sound update unit 207 compares the noise ratio calculated by the noise ratio calculation unit 205 with a threshold value, but this threshold value may be set to an appropriate value in advance based on the results of a hearing test or the like, or may be calculated sequentially. For example, an appropriate threshold value may be calculated and updated based on the signal from the external audio microphone 301 and the signal from the noise reference microphone 302.

[0059] Although the noise reduction unit 208 uses a Wiener filter in this embodiment, other techniques may be used. For example, the noise reduction unit 208 may use spectral subtraction or may perform waveform subtraction in the time domain. Furthermore, the noise reduction unit 208 may further reduce the volume level of signals in specific frequency bins whose volume levels are below a predetermined threshold. The noise reduction unit 208 may also perform different noise reduction processes depending on the type of noise detected by the noise detection unit 204, or may select a correction coefficient table according to the noise type. Furthermore, these processes and correction coefficient tables may be switched depending on the type of lens.

[0060] In this embodiment, the external audio microphone 301 is two microphones (stereo microphones), but similar processing is possible even if the number of channels is different, such as monaural, surround, or Ambisonics.

[0061] In this embodiment, the audio processing unit 200 performs only noise reduction processing for simplicity, but it may also perform other processing. For example, it may be configured to perform spectrum correction processing such as equalization to make the audio easier to hear, or processing to emphasize the stereo effect of the reproduced audio. It may also be configured to perform encoding using various audio codecs such as MP3 and AAC.

[0062] In this embodiment, the noise reference microphone 302 is configured to consist of one microphone, but more microphones may be provided. Furthermore, some of the noise reference microphones 302 may be configured to be attached to the lens side. Furthermore, some or all of the noise reference microphones 302 may be vibration sensors that detect vibrations of an object, rather than microphones that capture vibrations in the air.

[0063] Furthermore, although the noise reference microphone 302 is set up near the external audio microphone 301 or near the noise source, the setting location does not matter as long as noise can be acquired that can be used to estimate the noise components input to the external audio microphone 301.

Claims

1. An imaging device, an external sound microphone for acquiring external sound from the imaging device; a noise reference microphone for acquiring driving noise from a driving unit of the imaging device or an external device connected to the imaging device; a noise calculation means for calculating an audio signal of the driving noise from a signal acquired by the noise reference microphone; an updating means for storing an audio signal relating to the external audio acquired by the external audio microphone, and updating the stored audio signal relating to the external audio when it is determined to update the audio signal relating to the external audio based on the signal acquired by the noise reference microphone; a reduction means for performing a process of reducing the drive noise from the audio signal acquired by the external audio microphone, based on the audio signal related to the external audio stored in the update means and the audio signal of the drive noise calculated by the noise calculation means; and The updating means stores an average value of the audio signal acquired by the external audio microphone as the audio signal related to the external audio, and when it determines to update the audio signal related to the external audio, updates the stored audio signal related to the external audio with the average value of the stored audio signal related to the external audio and the audio signal input from the external audio microphone.

2. The imaging device described in claim 1, characterized in that the reduction means includes a noise reduction unit that reduces the drive noise from the audio signal acquired by the external audio microphone based on the audio signal of the drive noise calculated by the noise calculation means, and a correction unit that corrects the audio signal output from the noise reduction unit based on the stored audio signal related to the external audio.

3. The imaging device according to claim 2, characterized in that the correction unit performs correction so as to increase the volume of frequency bands of the audio signal output from the noise reduction unit that are quieter than the stored audio signal related to the external audio.

4. The imaging device described in claim 3, characterized in that the correction unit does not correct frequency bands of the audio signal output from the noise reduction unit that have a volume equal to or higher than the stored audio signal related to the external audio.

5. a noise detection means for detecting the driving noise and background noise from the signal acquired by the noise reference microphone; a noise ratio calculation means for calculating a ratio between the value of the driving noise detected by the noise detection means and the value of the background noise; and The photographing device according to any one of claims 1 to 4, characterized in that the update means updates the stored audio signal related to the external audio when the ratio calculated by the noise ratio calculation means is less than a threshold value.

6. 6. The imaging apparatus according to claim 5, wherein the noise ratio calculation means calculates a ratio between a predetermined frequency band of the driving noise and the predetermined frequency band of the background noise.

7. The photographing device according to any one of claims 1 to 4, characterized in that the update means determines whether to update the stored audio signal related to the external audio based on a gain of the signal acquired by the noise reference microphone.

8. a conversion means for converting the signal from the external audio microphone from a time domain signal to a frequency domain signal to output an external environmental sound spectrum, and for converting the signal from the noise reference microphone from a time domain signal to a frequency domain signal to output a noise reference sound spectrum, the noise calculation means calculates a noise component spectrum of the driving noise from the noise reference sound spectrum from the conversion means; 8. The imaging device according to claim 1, wherein the reduction means reduces the drive noise from the external environmental sound spectrum from the conversion means based on the noise component spectrum, and outputs an audio spectrum in which the drive noise has been reduced.

9. an external audio microphone for picking up external audio from the imaging device; a noise reference microphone that acquires driving noise from a driving unit of the image capturing device or from an external device connected to the image capturing device, a noise calculation step of calculating an audio signal of the driving noise from the signal acquired by the noise reference microphone; an updating step of storing an audio signal related to the external audio acquired by the external audio microphone, and updating the stored audio signal related to the external audio when it is determined to update the audio signal related to the external audio based on the signal acquired by the noise reference microphone; a reduction step of reducing the drive noise from the audio signal acquired by the external audio microphone based on the audio signal related to the external audio stored in the update step and the audio signal of the drive noise calculated in the noise calculation step; and The update step is a control method characterized in that the average value of the audio signal acquired by the external audio microphone is stored as the audio signal related to the external audio, and when it is determined that the audio signal related to the external audio should be updated, the stored audio signal related to the external audio is updated with the average value of the stored audio signal related to the external audio and the audio signal input from the external audio microphone.

10. an external audio microphone for picking up external audio from the imaging device; a noise reference microphone that acquires driving noise from a driving unit of the imaging device or from an external device connected to the imaging device, the computer of the imaging device executing a control method, the control method comprising: a noise calculation step of calculating an audio signal of the driving noise from the signal acquired by the noise reference microphone; an updating step of storing an audio signal related to the external audio acquired by the external audio microphone, and updating the stored audio signal related to the external audio when it is determined to update the audio signal related to the external audio based on the signal acquired by the noise reference microphone; a reduction step of reducing the drive noise from the audio signal acquired by the external audio microphone based on the audio signal related to the external audio stored in the update step and the audio signal of the drive noise calculated in the noise calculation step; and The update step is a program characterized in that it stores an average value of the audio signal acquired by the external audio microphone as an audio signal related to the external audio, and when it is determined that the audio signal related to the external audio should be updated, it updates the stored audio signal related to the external audio with the average value of the stored audio signal related to the external audio and the audio signal input from the external audio microphone.

Images