Imaging apparatus

Abstract

To easily obtain voice data indicating a sound collection result in a predetermined data format.SOLUTION: The imaging device includes an imaging unit, a sound input unit configured to input first input sound, a first signal processing unit configured to perform first amplification conversion on the first input sound to generate a first sound signal, a second signal processing unit configured to perform second amplification conversion on the first input sound to generate a second sound signal, a sound processing unit configured to combine the first and second sound signals to generate first sound data indicating a sound collection result of the first input sound in a predetermined data format, and a reception unit configured to receive third and fourth sound signals from the sound collection device. The third sound signal indicates a result of third amplification conversion performed on the second input sound in the sound pickup device. The fourth sound signal indicates a result of fourth amplification conversion performed on the second input sound in the sound pickup device. The sound processing unit combines the third and fourth sound signals to generate second sound data indicating a sound collection result of the second input sound in a predetermined data format.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an imaging device that performs a recording operation in a predetermined data format such as float format. [Background technology]

[0002] Patent Document 1 discloses a data processing device that processes floating-point data in a manner suitable for processing audio signals. This data processing device is provided with a mantissa register and an exponent register that store the mantissa and exponent of the floating-point data, respectively. The data processing device processes audio signals, which are fixed-point data for two channels (left and right), to create floating-point data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 63-282800 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides an imaging device that can easily obtain audio data indicating the sound collection results in a predetermined data format. [Means for solving the problem]

[0005] The imaging device according to the present disclosure includes an imaging unit that captures an image of a subject and generates image data, an audio input unit that inputs a first input audio, a first signal processing unit that performs a first amplification conversion on the first input audio to generate a first audio signal, a second signal processing unit that performs a second amplification conversion on the first input audio that is different from the first amplification conversion to generate a second audio signal, an audio processing unit that combines the first and second audio signals to generate first audio data in a predetermined data format that indicates the collection result of the first input audio, and a receiving unit that is communicatively connected to an external audio collecting device and receives third and fourth audio signals from the audio collecting device. The third audio signal indicates the result of the third amplification conversion performed on the second input audio in the audio collecting device. The fourth audio signal indicates the result of the fourth amplification conversion performed on the second input audio in the audio collecting device, different from the third amplification conversion. The audio processing unit combines the third and fourth audio signals received from the receiving unit to generate second audio data in a predetermined data format that indicates the collection result of the second input audio. [Effects of the Invention]

[0006] According to the imaging device of the present disclosure, it is possible to easily obtain audio data indicating the sound collection results in a predetermined data format. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an imaging system according to a first embodiment of the present disclosure. [Figure 2] FIG. 1 is a diagram showing the configuration of a digital camera in an imaging system. [Figure 3] FIG. 1 is a diagram illustrating a circuit configuration for float recording in a digital camera according to a first embodiment; [Figure 4] FIG. 1 is a diagram showing the configuration of a sound collection device in an imaging system. [Figure 5] 10 is a flowchart illustrating a setting operation of a digital camera in the imaging system of the first embodiment. [Figure 6] Waveform diagram for explaining the float recording operation in the imaging system [Figure 7] Diagram to explain the data structure of float format [Figure 8] FIG. 10 is a diagram for explaining an imaging system according to a second embodiment. [Figure 9] FIG. 10 is a diagram showing a display example of a digital camera according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, detailed descriptions of well-known matters and redundant descriptions of substantially identical configurations may be omitted. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0009] (Embodiment 1) 1. Configuration An imaging system according to a first embodiment of the present disclosure will be described with reference to FIG.

[0010] 1-1. System Overview 1, an imaging system 10 according to this embodiment includes a digital camera 100 and a sound collection device 200. In this system 10, the digital camera 100 and the sound collection device 200 are connected to each other by wireless communication such as Bluetooth or by wired communication such as USB.

[0011] This system 10 realizes float recording using a sound collection device 200 when, for example, shooting video with a digital camera 100. Float recording is a recording function that can ensure the resolution of each sound, from relatively loud to quiet sounds, using a predetermined data format such as the float format.

[0012] To achieve this type of float recording, the imaging system 10 of this embodiment utilizes the calculation function of the digital camera 100 and employs a simple configuration for the sound collection device 200. With this system 10, for example, a user of the digital camera 100 can easily obtain high-dynamic range and high-precision sound recording results when shooting video by simply preparing the sound collection device 200 with a simple configuration.

[0013] Furthermore, the present system 10 also enables floating sound recording using sound collection means such as the microphone 180 built into the digital camera 100. The present system 10 provides the user with such a variety of sound collection means, making it easier to utilize sound collection in the digital camera 100. The configurations of the digital camera 100 and sound collection device 200 in the present system 10 will be described below.

[0014] 1-2.Digital camera configuration The configuration of the digital camera 100 in this embodiment will be described with reference to FIGS.

[0015] 2 is a diagram showing the configuration of a digital camera 100 according to this embodiment. The digital camera 100 of this embodiment includes an image sensor 115, an image processing engine 120, a display monitor 130, and a control unit 135. The digital camera 100 also includes a buffer memory 125, a card slot 140, a flash memory 145, an operation unit 150, a communication module 160, an audio processing engine 170, a microphone 180, and a signal processing unit 190. The digital camera 100 also includes, for example, an optical system 110 and a lens driving unit 112.

[0016] The optical system 110 includes a focus lens, a zoom lens, an optical image stabilization lens (OIS), an aperture, a shutter, etc. The focus lens is a lens for changing the focus state of the subject image formed on the image sensor 115. The zoom lens is a lens for changing the magnification of the subject image formed by the optical system. Each of the focus lens, etc. is composed of one or more lenses.

[0017] Lens driving unit 112 drives the focus lens and the like in optical system 110. Lens driving unit 112 includes a motor, and moves the focus lens along the optical axis of optical system 110 under the control of control unit 135. The configuration for driving the focus lens in lens driving unit 112 can be realized by a DC motor, a stepping motor, a servo motor, an ultrasonic motor, or the like.

[0018] The image sensor 115 captures an image of a subject formed via the optical system 110 and generates imaging data. The imaging data constitutes image data representing an image captured by the image sensor 115. The image sensor 115 generates new frame image data at a predetermined frame rate (e.g., 30 frames / second). The timing of generating imaging data and the electronic shutter operation in the image sensor 115 are controlled by the control unit 135. The image sensor 115 can be any of a variety of image sensors, such as a CMOS image sensor, a CCD image sensor, or an NMOS image sensor.

[0019] The image sensor 115 performs operations such as capturing moving images, still images, and through-image capturing. Through-images are primarily moving images, and are displayed on the display monitor 130 so that the user can determine, for example, a composition for capturing a still image. The through-images, moving images, and still images are each an example of captured images in this embodiment. The image sensor 115 is an example of an imaging unit in this embodiment.

[0020] The image processing engine 120 performs various processes on the imaging data output from the image sensor 115 to generate image data, and performs various processes on the image data to generate an image to be displayed on the display monitor 130. The various processes include, but are not limited to, white balance correction, gamma correction, YC conversion processing, electronic zoom processing, compression processing, and expansion processing. The image processing engine 120 may be configured with a hardwired electronic circuit, or may be configured with a microcomputer, processor, or the like using a program.

[0021] The display monitor 130 is an example of a display unit that displays various information. For example, the display monitor 130 displays an image (through image) represented by image data captured by the image sensor 115 and processed by the image processing engine 120. The display monitor 130 also displays a menu screen or the like that allows the user to make various settings for the digital camera 100. The display monitor 130 can be configured, for example, by a liquid crystal display device or an organic EL device.

[0022] Operation unit 150 is a general term for hard keys such as operation buttons and operation levers provided on the exterior of digital camera 100, and accepts operations by the user. Operation unit 150 includes, for example, a release button, a mode dial, a touch panel, cursor buttons, and a joystick. When operation unit 150 accepts an operation by the user, it transmits an operation signal corresponding to the user operation to control unit 135.

[0023] The control unit 135 controls the overall operation of the digital camera 100. The control unit 135 includes a CPU and the like, and the CPU executes a program (software) to realize predetermined functions. For example, the control unit 135 functions as a decoder that decodes a signal received from the communication module 160, or as a video generation unit 136 that controls a video and audio encoder to generate a video file.

[0024] The decoder does not have to be realized by a function of the control unit 135, but may be incorporated into the communication module 160, for example. Furthermore, the video generation unit 136 is not limited to a function of the control unit 135, and may be realized in cooperation with the various engines 120 and 170, or may be implemented as a circuit. Instead of a CPU, the control unit 135 may include a processor configured with a dedicated electronic circuit designed to realize a predetermined function. That is, the control unit 135 can be realized by various processors such as a CPU, MPU, GPU, DSU, FPGA, and ASIC. The control unit 135 may be configured with one or more processors. Furthermore, the control unit 135 may be configured on a single semiconductor chip together with the image processing engine 120, etc.

[0025] The buffer memory 125 is a recording medium that functions as a work memory for the image processing engine 120 and the control unit 135. The buffer memory 125 is realized by a DRAM (Dynamic Random Access Memory) or the like. The flash memory 145 is a non-volatile recording medium. Although not shown, the control unit 135 may have various types of internal memory, for example, a built-in ROM. The ROM stores various programs executed by the control unit 135. The control unit 135 may also have a built-in RAM that functions as a work area for the CPU.

[0026] The card slot 140 is a means for inserting a removable memory card 142. The card slot 140 can electrically and mechanically connect the memory card 142. The memory card 142 is an external memory equipped with a recording element such as a flash memory inside. The memory card 142 can store data such as image data generated by the image processing engine 120.

[0027] The communication module 160 is a module (circuit) that connects to an external device such as the sound collection device 200 in accordance with a predetermined communication standard such as Bluetooth Low Energy (BLE). For example, the communication module 160 performs wireless communication of audio signals in accordance with the LE Audio standard. Communication by the communication module 160 is not limited to wireless communication and may be wired communication. Furthermore, the communication standard of the communication module 160 is not particularly limited and may be, for example, USB, HDMI (registered trademark), IEEE802.11, Wi-Fi, etc. The communication module 160 is an example of a receiving unit of the digital camera 100 in this embodiment, and may also be an example of a transmitting unit or a communicating unit of the digital camera 100.

[0028] The audio processing engine 170 performs various types of audio processing on an audio signal acquired from, for example, the outside or inside of the digital camera 100, and generates audio data as a processing result. The audio processing engine 170 is an example of the audio processing unit in this embodiment. The audio processing engine 170 may be configured integrally with either or both of the image processing engine 120 and the control unit 135.

[0029] The microphone 180 is an example of an audio input unit that includes one or more microphone elements built into the digital camera 100. The microphone 180 inputs one or more channels of input audio to the digital camera 100. For example, the microphone 180 outputs an analog signal (which is an electrical signal) that indicates the picked-up audio to the signal processing unit 190. The digital camera 100 may also use an external microphone 180.

[0030] The digital camera 100 may be provided with a connector such as a terminal for connecting to an external microphone as an audio input section instead of or in addition to the built-in microphone 180. The digital camera 100 may be provided with an accessory shoe such as a hot shoe or cold shoe, or a connection plug, as such a connector.

[0031] Signal processing unit 190 is a signal processing circuit that performs signal processing such as analog-to-digital (A / D) conversion on an analog signal from microphone 180. Signal processing unit 190 outputs an audio signal resulting from the signal processing to audio processing engine 170. Signal processing unit 190 includes a circuit configuration for float recording in digital camera 100.

[0032] 1-2-1. Float recording circuit configuration The configuration of the signal processing unit 190 and other components for float recording in the digital camera 100 of this embodiment will be described with reference to FIG.

[0033] The signal processing unit 190 of the digital camera 100 includes a circuit configuration for float recording, for example, a high (H) level signal processing unit 191 and a low (L) level signal processing unit 192 for each channel of input audio, as illustrated in FIG. 3.

[0034] 3, each of the signal processing units 191 and 192 is configured with a signal processing circuit including amplifiers 193 and 195 and A / D converters 194 and 196. Separate gains Ga and Gb are set in each of the signal processing units 191 and 192 so as to share the entire dynamic range of the digital camera 100.

[0035] In the amplifier 193 of the H-level signal processing unit 191, a gain Ga is set so as to reduce the influence of circuit noise, for example, from the viewpoint of accurately collecting input sound of a relatively low volume. For example, the gain Ga is larger than the gain Gb of the L-level signal processing unit 192. In this way, the H-level signal processing unit 191 has a dynamic range on the low volume side in the sound collection device 200.

[0036] In order to accurately collect input sound with a relatively large volume, for example, a gain Gb is set in the amplifier 195 of the L-level signal processing unit 192 so as to suppress saturation distortion of the signal waveform. Thus, in the sound collection device 200, the L-level signal processing unit 192 has a dynamic range on the high volume side.

[0037] The dynamic range of the H-level signal processing unit 191 and the dynamic range of the L-level signal processing unit 192 may be continuous or may partially overlap. The A / D converters of the signal processing units 191 and 192 have common circuit characteristics, such as resolution. One or more of the signal processing units 191 and 192 may be integrated on an IC chip.

[0038] 3, the audio processing engine 170 of this embodiment includes a float recording processing unit 175, which includes a data conversion unit 172, an amplification unit 174, and a combination unit 176. The float recording processing unit 175 is a functional configuration that performs calculation processing to realize float recording (details will be described later).

[0039] Furthermore, the digital camera 100 of this embodiment further includes a multiplexer 171 in, for example, the audio processing engine 170. The multiplexer 171 selectively switches between input of audio signals A2 and A3 from the signal processing units 191 and 192 of the digital camera 100 and input of audio signals A12 and A13 from the sound collection device 200. The multiplexer 171 may be implemented as a circuit, or may be realized as a functional component of the audio processing engine 170 or the control unit 135.

[0040] 1-3. Configuration of the sound pickup device The configuration of the sound collection device 200 in this embodiment will be described with reference to Fig. 4. Fig. 4 shows the configuration of the sound collection device 200 in this system.

[0041] 4, the sound collection device 200 of this embodiment includes an audio input unit 210, a plurality of signal processing units 220 and 230, a control unit 240, a storage unit 250, and a communication unit 260. The sound collection device 200 is a device that collects sound for floating recording using, for example, an external microphone.

[0042] The audio input unit 210 includes an input terminal for connecting, for example, one or more external microphones. The audio input unit 210 inputs an analog signal representing audio picked up by, for example, one monaural microphone to the sound collection device 200, thereby acquiring one channel of input audio.

[0043] The audio input unit 210 is connected to an H-level signal processing unit 220 and an L-level signal processing unit 230 that are arranged in parallel with respect to one channel of input audio. The audio input unit 210 may acquire input audio of multiple channels, for example, a stereo input. The sound collection device 200 may be configured integrally with a microphone. In this case, the audio input unit 210 may be the microphone of the sound collection device 200.

[0044] Each of the signal processing units 220, 230 includes an amplifier 222, 232 and an A / D converter 224, 234, similar to, for example, each of the signal processing units 191, 192 (FIG. 3) of the digital camera 100. Separate gains Gc, Gd are set for the multiple signal processing units 220, 230 so as to share the entire dynamic range of the sound collection device 200.

[0045] The H level signal processing unit 220 has a relatively large gain Gc in the amplifier 222, similar to the H level signal processing unit 191 of the digital camera 100, and has a dynamic range on the low volume side in the sound collection device 200.

[0046] The L-level signal processing unit 230 has a relatively small gain Gd in the amplifier 232, similar to the L-level signal processing unit 192 of the digital camera 100, and has a dynamic range on the loud volume side in the sound collection device 200.

[0047] The dynamic range of the H-level signal processing unit 220 and the dynamic range of the L-level signal processing unit 230 may be continuous or may partially overlap. The A / D converters of the signal processing units 220 and 230 have common circuit characteristics, such as resolution. One or more of the signal processing units 220 and 230 may be integrated on an IC chip.

[0048] The control unit 240 controls, for example, the overall operation of the sound collection device 200. The control unit 240 includes, for example, a CPU or MPU that cooperates with software to realize predetermined functions. For example, the control unit 240 functions as an encoder that encodes a signal to be transmitted from the communication unit 260.

[0049] The encoder does not have to be realized by a function of the control unit 240, and may be incorporated into the communication unit 260, for example. The control unit 240 may be a dedicated electronic circuit designed to realize a predetermined function, or a hardware circuit such as a reconfigurable electronic circuit. The control unit 240 may be configured with various semiconductor integrated circuits such as a CPU, an MPU, a microcomputer, a DSP, an FPGA, and an ASIC.

[0050] The storage unit 250 includes a ROM and a RAM that store programs and data necessary to realize the functions of the sound collection device 200. The storage unit 250 stores information indicating the gains of each of the plurality of signal processing units 220, 230, for example.

[0051] The communication unit 260 is a module (circuit) that connects to an external device in accordance with a predetermined communication standard such as BLE. For example, the communication unit 260 performs wireless communication of an audio signal in accordance with the LE Audio standard. The communication by the communication unit 260 is not limited to wireless communication and may be wired communication. Furthermore, the communication standard of the communication unit 260 is not particularly limited and may be, for example, USB, IEEE802.11, Wi-Fi, etc. The communication unit 260 is an example of a transmission unit of the sound collection device 200 in this embodiment, and may also be an example of a reception unit of the sound collection device 200.

[0052] 2.Operation The operations of the imaging system 10 and digital camera 100 configured as above will now be described.

[0053] Digital camera 100 of system 10 acquires input audio, such as environmental sounds in the shooting environment, from built-in microphone 180, for example, when shooting video without using sound collection device 200. H / L level signal processors 191, 192 (FIG. 3) of digital camera 100 perform two types of amplification conversion on input audio signal A1. Float recording processor 175 of digital camera 100 inputs audio signals A2, A3 that indicate the results of these two types of amplification conversion, and executes float recording processing, which is a calculation process for performing float recording (details will be described later).

[0054] As described above, digital camera 100 of this embodiment generates floating-recorded audio data A10 using an internal sound collection means including signal processing units 191, 192, etc. In addition to this sound collection means, system 10 (FIG. 1) also includes a sound collection means that enables floating recording when shooting video using sound collection device 200 external to digital camera 100.

[0055] In this system 10, the sound collection device 200 (FIG. 4) acquires an input audio signal A11 from the audio input unit 210, performs two types of amplification conversion using H / L level signal processing units 220 and 230, and transmits the amplification conversion results from the communication unit 260 to the digital camera 100. Instead of audio signals A2 and A3 obtained using the above-described internal configuration, for example, the digital camera 100 inputs audio signals A12 and A13 resulting from the amplification conversion in the sound collection device 200 to the float recording processing unit 175, and performs float recording processing appropriate for the sound collection device 200.

[0056] As described above, the system 10 can make it easier for users to use float recording by employing multiple sound collection means in the digital camera 100. The operation of the digital camera 100 in the system 10 will now be described in detail.

[0057] 2-1.Float recording settings The operation of switching the settings of the sound collection means as described above in the digital camera 100 of this embodiment will be described with reference to FIG.

[0058] Fig. 5 is a flowchart illustrating the setting operation of the digital camera 100 in the system 10. The processing shown in the flowchart of Fig. 5 is executed by the control unit 135 of the digital camera 100 at a predetermined interval, for example.

[0059] First, the control unit 135 of the digital camera 100 detects a communication connection of an external device to the digital camera 100 and determines whether or not the external device is communicatively connected to the digital camera 100 (S1). The determination in step S1 is made by detecting the connection state of various communication modules 160 in the digital camera 100 or connection parts such as an accessory shoe or connection plug.

[0060] If the control unit 135 determines that no external device is connected to the digital camera 100 (NO in S1), it sets the digital camera 100 so that floating recording can be started using internal components such as the microphone 180 and the signal processing unit 190 (S6).

[0061] For example, in step S6, the control unit 135 sets the multiplexer 171 so that the audio signals A2 and A3 obtained from the signal processing units 191 and 192 of the digital camera 100 are input to the floating recording processing unit 175 (FIG. 3). The control unit 135 also sets the gains Ga and Gb of the signal processing units 191 and 192 in the amplifier unit 174 of the floating recording processing unit 175.

[0062] On the other hand, if it is determined that an external device is connected to the digital camera 100 (YES in S1), the control unit 135 recognizes the connected external device and the form of communication connection (S2). For example, in step S2, the control unit 135 recognizes the type of the external device (for example, audio device, lighting device, information terminal, or external storage device) and the type of communication connection through information communication with the connected device.

[0063] For example, the control unit 135 determines whether the connected device is an audio device based on the recognition result of the connected device (S3). The audio device may include, for example, the sound collection device 200 for float recording in the system 10 or other sound collection devices, and may also be an external microphone. The determination in step S3 may be "NO" if, for example, in the case of USB communication, the digital camera 100 is not the host in the communication connection, and in this case the process may proceed to step S6.

[0064] If the connected device is not an audio device (NO in S3), the control unit 135 sets the digital camera 100 for floating sound recording using the internal configuration (S6), similar to the case of "NO" in step S1.

[0065] On the other hand, if the connected device is an audio device (YES in S3), the control unit 135 acquires audio device information about the connected device through information communication with the device via, for example, the communication module 160 or various connection units (S4). The audio device information includes, for example, whether the device can perform float recording, gain information, latency information, sampling rate, etc. In the case of USB communication, the audio device information may also include an audio class.

[0066] In step S4, the control unit 135 of the digital camera 100 receives audio device information from the connected device, for example, via the communication module 160 or a connection unit. The audio device information may be stored in advance in the digital camera 100 in the flash memory 145 or the like in association with the identification information of the audio device. In this case, the control unit 135 may receive the identification information from the connected audio device and perform the processing of step S4 by referring to the information stored in the flash memory 145.

[0067] The control unit 135 determines whether the connected audio device is capable of performing floating recording based on the acquired audio device information (S5). For example, if the connected audio device is the sound collection device 200 (FIG. 4) for floating recording in the system 10, the determination in step S5 is "YES."

[0068] If the connected audio device is capable of floating recording (YES in S5), the control unit 135 sets the digital camera 100 so that floating recording using the audio device can be started (S7).

[0069] For example, in step S7, the control unit 135 sets the multiplexer 171 so that two types of audio signals A12, A13 obtained by the signal processing units 220, 230 of the sound collection device 200 are input to the floating recording processing unit 175 (FIG. 3). The control unit 135 also sets the gains Gc, Gd of the signal processing units 220, 230 in the amplifier unit 174 of the floating recording processing unit 175.

[0070] On the other hand, if the connected audio device is not capable of performing float recording (NO in S5), the control unit 135 sets the digital camera 100 so that it can start a recording operation other than float recording using the audio device (S8).

[0071] For example, in step S8, the control unit 135 sets the audio processing engine 170 to input one type of audio signal from a connected audio device instead of the two types of audio signals A12 and A13 from the sound collection device 200. Furthermore, the control unit 135 sets the audio processing engine 170 to generate audio data in a fixed format or the like without performing float recording processing on the audio signal.

[0072] The control unit 135 performs the setting of any one of steps S6, S7, and S8, and then ends the processing shown in FIG.

[0073] According to the above process, the digital camera 100 of this embodiment can switch between the internally configured float recording setting (S6) and the externally configured float recording setting (S7), and selectively perform either float recording.

[0074] Furthermore, the digital camera 100 of this embodiment is capable of performing recording operations other than float recording (S8). For example, if a sound collection device that does not support float recording is connected (NO in S5), the digital camera 100 of this embodiment may generate audio data that is not in float format based on the sound collection results of such a sound collection device. Furthermore, for example, if an external microphone with analog output is connected to the digital camera 100, the control unit 135 may perform settings in step S6 so that the input audio signal from such a microphone is input to each of the signal processing units 191 and 192 and float recording is performed using the internal configuration.

[0075] Also, in the above description, an example has been described in which settings such as floating sound recording (S6 to S8) are made in accordance with the connection status of external devices to digital camera 100. Digital camera 100 of this embodiment is not limited to the above example, and may also make floating sound recording settings (S6 to S8) in accordance with, for example, a user operation on operation unit 150. For example, in a setting menu of digital camera 100, control unit 135 may accept a user operation to select one of the sound recording settings in steps S6 to S8.

[0076] 2-2.Float recording operation The details of the float recording operation in the system 10 will be explained with reference to FIGS.

[0077] 6(A) to 6(F) are waveform diagrams for explaining the float recording operation in the present system 10. Fig. 7 is a diagram for explaining the data structure of the float format.

[0078] 6(A) to 6(F) show an example of operation when float recording is set by the internal configuration of digital camera 100 (S6 in FIG. 5). In this case, for example, input audio signal A1 indicating input audio picked up by microphone 180 of digital camera 100 is input to H-level signal processing section 191 and L-level signal processing section 192, as shown in FIG. 3. An example of input audio signal A1 is shown in FIG. 6(A). In the waveform diagram of FIG. 6(A), the horizontal axis represents time and the vertical axis represents volume (same below).

[0079] In the H-level signal processing unit 191, the amplifier 193 amplifies the input audio signal A1 at a gain Ga that is set to a relatively large value. The A / D converter 194 performs A / D conversion of the amplification result of the input audio signal A1 in the amplifier 193 from an analog signal to a digital signal, thereby generating an H-level audio signal A2. Such processing of the input audio signal A1 in the H-level signal processing unit 191 is an example of a first amplification conversion in this embodiment.

[0080] Fig. 6(B) illustrates an example of an H-level audio signal A2 obtained from the input audio signal A1 in the example of Fig. 6(A). In the example of Fig. 6(B), waveform distortion occurs in the H-level audio signal A2 near the maximum value Ma that can be output by each of the signal processing units 191 and 192. On the other hand, the H-level audio signal A2 has a high signal-to-noise ratio because the gain Ga is large.

[0081] In the L-level signal processing unit 192, the amplifier 195 amplifies the input audio signal A1 at a gain Gb that is set to a relatively small value. The A / D converter 196 A / D converts the amplification result of the input audio signal A1 in the amplifier 195 from an analog signal to a digital signal, thereby generating an L-level audio signal A3. Such processing of the input audio signal A1 in the L-level signal processing unit 192 is an example of the second amplification conversion in this embodiment.

[0082] 6C illustrates an example of an L-level audio signal A3 obtained from the input audio signal A1 in the example of FIG. 6A. The L-level audio signal A3 is less likely to cause signal waveform distortion than the H-level audio signal A2. However, since the gain Gb is small, the signal-to-noise ratio is low.

[0083] The audio signals A2 and A3 generated by the signal processors 191 and 192 are fixed-format digital signals that represent audio as digital values ​​within a predetermined dynamic range (±Ma) and resolution. In the system 10, the remaining calculations for float recording of the two types of audio signals A2 and A3 generated as described above are performed in the digital camera 100.

[0084] For example, in the digital camera 100, the multiplexer 171 outputs the audio signals A2 and A3 from the H / L level signal processors 191 and 192 in the digital camera 100 to the float recording processor 175 in accordance with the setting of the controller 135 in step S6 of FIG.

[0085] In the digital camera 100 of this embodiment, the float recording processing unit 175 of the audio processing engine 170 performs float calculation processing by performing corresponding calculations as a data conversion unit 172, an amplification unit 174, and a combination unit 176, for example, as shown in FIG. 3.

[0086] In the audio processing engine 170 of the digital camera 100, first, the data conversion unit 172 converts each of the audio signals A2 and A3 from the sound collection device 200 from fixed format to float format audio data. The data structure of the float format will be described with reference to FIG.

[0087] The float format is a data format in which data values ​​are expressed in floating-point format. The data structure of the float format includes a sign field 50, an exponent field 51, and a mantissa field 52, as shown in FIG.

[0088] The sign field 50 is a portion that indicates a positive or negative sign in a bit string that indicates a float format data structure, for example. The sign field 50 may be omitted from the float format data structure as appropriate.

[0089] The exponent field 51 indicates the exponent of the data value in the exponential notation of the float-format bit string. The exponential notation is, for example, a binary number with a base of 2. The exponent field 51 manages the volume level corresponding to the position of the decimal point in such notation.

[0090] The mantissa part 52 is a part that indicates the significant digits of the data value in a bit string in float format. For example, the more bits allocated to the mantissa part 52, the higher the resolution of the audio data.

[0091] In the float format, a predetermined number of bits defining the bit string is allocated in advance among the sign field 50, mantissa field 52, and exponent field 51. For example, in a 32-bit float recording, the sign field 50 has 1 bit, the exponent field 51 has 8 bits, and the mantissa field 52 has 23 bits. With such float format audio data, the resolution corresponding to the number of bits in the mantissa field 52 can be ensured over a volume level corresponding to the number of bits in the exponent field 51.

[0092] The audio processing engine 170, which serves as the data conversion unit 172, sequentially calculates the values ​​of the exponent field 51 and the mantissa field 52 so as to normalize the data values ​​indicated by the H-level audio signal A2 at each time point in a floating-point format, thereby generating float-format audio data. Similarly, the audio processing engine 170 also performs a floating-point normalization calculation on the L-level audio signal A3 to generate float-format audio data. The audio data thus generated indicates a louder volume as the value of the exponent field 51 increases. Normalization is performed, for example, by sequentially increasing the value of the exponent field 51 until the most significant digit of the mantissa field 52 is no longer zero.

[0093] Returning to FIG. 3, in the sound processing engine 170, the amplifier 174 performs an amplification operation to cancel out the difference between the gains Ga and Gb based on gain information indicating the gains Ga and Gb of the amplifiers 193 and 195 in the sound collection device 200, for example.

[0094] For example, in the audio processing engine 170, the amplifier 174 calculates H-level audio data A20 by amplifying the conversion result of the H-level audio signal A2 in float format by the lower gain Gb in floating-point arithmetic. Similarly, the amplifier 174 calculates L-level audio data A30 by amplifying the conversion result of the L-level audio signal A3 by the higher gain Ga.

[0095] Fig. 6(D) illustrates H-level audio data A20 calculated from the H-level audio signal A2 in Fig. 6(B). Fig. 6(E) illustrates L-level audio data A30 calculated from the L-level audio signal A3 in Fig. 6(C). According to the calculation by the amplifier 174, it is possible to make the volume of the H-level audio data A20 and the L-level audio data A30 the same, for example, as shown in Figs. 6(D) and 6(E).

[0096] Next, the combining unit 176 in the audio processing engine 170 generates float-recorded audio data A10 by performing an arithmetic process that combines, for example, H-level audio data A20 and L-level audio data A30 while switching between them. Fig. 6(F) shows an example of float-recorded audio data A10 generated from the audio data A20 and A30 of Figs. 6(D) and (E).

[0097] For example, the combining unit 176 compares the magnitude (absolute value) of the L-level audio data A30 with a predetermined threshold value Mt, and when the L-level audio data A30 is equal to or greater than the threshold value Mt, adopts the L-level audio data A30 as the audio data A10 for float recording. On the other hand, when the L-level audio data A30 is less than the threshold value Mt, the combining unit 176 adopts the H-level audio data A20 as the audio data A10 for float recording. The threshold value Mt is set, for example, to a value equal to or less than the value Mb corresponding to the maximum value Ma of the output of each of the signal processing units 191 and 192 for each of the audio data A20 and A30.

[0098] On the other hand, in this system 10, when floating recording is set by an external configuration of the digital camera 100 (S7 in FIG. 5), for example, the multiplexer 171 outputs the audio signals A12 and A13 from the sound collection device 200 to the floating recording processing unit 175. These audio signals A12 and A13 are obtained by, for example, the control unit 135 of the digital camera 100 appropriately decoding the data signal received from the sound collection device 200, and are input to the multiplexer 171 after decoding.

[0099] In the sound collection device 200 of the present system 10, as shown in FIG. 4, an input sound signal A11 indicating an input sound acquired by a sound input unit 210 is input to an H-level signal processing unit 220 and an L-level signal processing unit 230, respectively.

[0100] In the H-level signal processing unit 220, the amplifier 222 amplifies the input audio signal A11 at a gain Gc that is set to a relatively large value. The A / D converter 224 performs A / D conversion on the result of amplification of the input audio signal A11 by the amplifier 222, and generates an H-level audio signal A12. Such processing by the H-level signal processing unit 220 is an example of a third amplification conversion in this embodiment.

[0101] In the L-level signal processing unit 230, the amplifier 232 amplifies the input audio signal A11 at a gain Gd that is set to a relatively small value. The A / D converter 234 performs A / D conversion on the amplification result of the input audio signal A11 in the amplifier 232 to generate an L-level audio signal A13. Such processing by the L-level signal processing unit 230 is an example of a fourth amplification conversion in this embodiment.

[0102] In the present system 10, the float recording processor 175 of the digital camera 100 performs the float recording process on the two types of audio signals A12 and A13 generated by the sound collection device 200 as described above, in the same manner as for the audio signals A2 and A3. At this time, the amplifier 173 is set by the control unit 135 in step S7 of Fig. 5, for example, so that the gains Gc and Gd corresponding to the gain information of the sound collection device 200 are canceled out. Through this float recording operation, the digital camera 100 of this embodiment generates float-recorded audio data A10 for the input audio of the sound collection device 200.

[0103] During each of the above-described float recording operations, the image sensor 115 in the digital camera 100 captures each frame of the video, and the image processing engine 120 sequentially generates image data for each frame of the video. In the digital camera 100 of this embodiment, the control unit 135, which functions as the video generator 136, generates a video file by encoding the float recording audio data obtained as described above and the image data for each frame in sequence. The generated video file is then recorded, for example, from the card slot 140 onto the memory card 142.

[0104] According to the operation of the present system 10, for example, when a user shoots a video, the digital camera 100 can perform float recording, making it easier to avoid recording problems such as distortion or insufficient volume during video shooting. Furthermore, this eliminates the need for the complicated adjustment of the recording level settings required with conventional digital cameras when shooting such videos, allowing the user to easily obtain highly accurate sound pickup results while concentrating on, for example, the composition of the video.

[0105] Furthermore, with this system 10, the user can obtain float recording audio data in a video file obtained as a result of, for example, video shooting with the digital camera 100. This saves the user the trouble of editing after shooting, such as replacing audio data picked up by a separate device with the audio data in the video file, compared to, for example, preparing separate equipment to perform float recording, making float recording easier for the user to use.

[0106] Furthermore, with the above-described float recording operation, in the present system 10, float recorded audio data A10 that accurately represents each input audio can be obtained by the digital camera 100 alone, or by the sound collection device 200 working in cooperation with the digital camera 100. Furthermore, for example, it is not necessary to provide an arithmetic circuit capable of performing floating-point arithmetic, particularly in the sound collection device 200, and the device configuration of the sound collection device 200 can be simplified.

[0107] According to the processing of the combining unit 176, by using the L-level audio data A30 for threshold determination, it is easy to avoid the influence of signal distortion in the H-level audio data A20. Also, for example, as shown in Figures 6(E) and (F), in the range of volume so loud that signal distortion may occur in the H-level audio data A20, the L-level audio data A30 is adopted, and the influence of signal distortion in the float-recorded audio data A10 can be suppressed. Furthermore, for example, as shown in Figures 6(D) and (F), by adopting the H-level audio data A20 as the sound pickup result except for the above-mentioned range of loud volume, it is easy to improve the signal-to-noise ratio.

[0108] The combining unit 176 may perform various arithmetic operations to combine the H-level audio data A20 and the L-level audio data A30, and may, for example, provide hysteresis to the threshold determination described above. Furthermore, when frequent switching between the H-level audio data A20 and the L-level audio data A30 occurs due to threshold determination, the combining unit 176 may, for example, temporarily fix the audio data to the L-level audio data A30. This type of arithmetic operation can reduce the audible discomfort felt by the float-recorded audio data A10.

[0109] In this embodiment, the combining unit 176 may perform a calculation process such as floating-point calculation to combine the H-level audio data A20 and the L-level audio data A30 at a predetermined combination ratio, instead of performing a calculation process to combine the audio data A20 and A30 while switching between them. Even with this calculation process, the digital camera 100 of this embodiment can obtain the floating-recorded audio data A10.

[0110] Furthermore, in the amplifier 174, the amplification process may be performed by correcting the amplification factor by, for example, comparing the gains Ga and Gb indicated by the gain information with the difference between the two audio signals A2 and A3, thereby providing a robust system that does not affect coupling even if a difference in amplification factor occurs due to manufacturing variations in the amplifier.

[0111] 3. Summary As described above, in this embodiment, the digital camera 100, which is an example of an imaging device, includes the image sensor 115, which is an example of an imaging unit; the microphone 180, which is an example of an audio input unit; the H-level signal processing unit 191, which is an example of a first signal processing unit; the L-level signal processing unit 192, which is an example of a second signal processing unit; the audio processing engine 170, which is an example of an audio processing unit; and the communication module 160, which is an example of a receiving unit. The image sensor 115 captures an image of a subject and generates image data. The microphone 180 receives a first input audio signal as an input audio signal A1. The H-level signal processing unit 191 performs a first amplification conversion on the first input audio to generate a first audio signal A2. The L-level signal processing unit 192 performs a second amplification conversion on the first input audio, which is different from the first amplification conversion, to generate a second audio signal A3. The audio processing engine 170 combines the first and second audio signals A1 and A2 to generate first audio data A10 in a float format, which is an example of a predetermined data format, indicating the result of collection of the first input audio. The communication module 160 is communicatively connected to an external audio collection device 200 and receives third and fourth audio signals A12 and A13 from the audio collection device 200. The third audio signal A12 indicates the result of a third amplification conversion performed on the second input audio in the audio collection device 200. The fourth audio signal A13 indicates the result of a fourth amplification conversion, different from the third amplification conversion, performed on the second input audio in the audio collection device 200. The audio processing engine 170 combines the third and fourth audio signals A12 and A13 received from the communication module 160 to generate second audio data A10 in a float format, for example, indicating the result of collection of the second input audio.

[0112] According to the digital camera 100 described above, float recording can be performed using the internal configuration of the digital camera 100 and float recording using the sound collection device 200, making it easy to obtain audio data A10 that indicates the sound collection results in a predetermined data format such as float format.

[0113] In this embodiment, digital camera 100 further includes video generation unit 136, which generates a video file by associating image data with first or second audio data A10. Audio processing engine 170 selectively generates one of the first and second audio data A10 (see FIG. 3). This allows video shooting by switching between float recording sound collection means inside and outside digital camera 100, making it easier to use float recording when shooting video.

[0114] In this embodiment, the digital camera 100 further includes a control unit 135 that detects a communication connection between the sound collection device 200 and the communication module 160 and controls the audio processing engine 170. If the sound collection device 200 connected to the communication module 160 is capable of floating recording and can transmit the third and fourth audio signals A12, A13 (YES in S5), the control unit 135 controls the audio processing engine 170 to generate second audio data A10 based on the third and fourth audio signals A12, A13 (S7). This allows floating recording to be performed with the digital camera 100 using a sound collection device 200 that supports floating recording, making it easier for users of the digital camera 100 to use floating recording.

[0115] In the digital camera 100 of this embodiment, when the sound collection device 200 is not connected to the communication module 160 (NO in S1 or S3), the control unit 135 controls the audio processing engine 170 to generate first audio data A10 based on the first and second audio signals A2, A3 (S6). As a result, when the sound collection device 200 for float recording is not used, float recording can be performed using the internal configuration of the digital camera 100, making it easier for users of the digital camera 100 to use float recording.

[0116] In the digital camera 100 of this embodiment, if a sound collection device such as an audio device connected to the communication module 160 is not capable of transmitting the third and fourth audio signals A12, A13 (NO in S5), the control unit 135 controls the audio processing engine 170 to generate third audio data indicating the collection result of the second input audio in a format other than the float format, based on the fifth audio signal received from the sound collection device by the communication module 160 (S8). This allows recording in a format other than the float format when a sound collection device incapable of float recording is used, making it easier for the user to use the digital camera 100.

[0117] In the digital camera 100 of this embodiment, the H-level signal processing unit 191 includes a first amplifier 193 that amplifies the first input audio at a first gain Ga and a first A / D converter 194 that performs A / D conversion on the amplification result of the first amplifier 193 to generate a first audio signal A2. The L-level signal processing unit 192 includes a second amplifier 195 that amplifies the first input audio at a second gain Gb that is smaller than the first gain Ga and a second A / D converter 196 that performs A / D conversion on the amplification result of the second amplifier 195 to generate a second audio signal A3. By incorporating the circuit configurations of the signal processing units 191 and 192 into the digital camera 100, float recording can be performed using the internal configuration of the digital camera 100. For example, in the audio data A10 resulting from the recording, the volume of the portion corresponding to the first audio signal A2 is equal to or greater than the volume of the portion corresponding to the second audio signal A3.

[0118] In the sound collection device 200 of this embodiment, the third amplification conversion amplifies the second input sound in the third amplifier 222, to which a third gain Gc is set, and generates a third sound signal A12 by performing A / D conversion. The fourth amplification conversion amplifies the second input sound in the fourth amplifier 232, to which a fourth gain Gd smaller than the third gain Gc is set, and generates a fourth sound signal A13 by performing A / D conversion. For example, in the second sound data A10, the volume of the portion corresponding to the third sound signal A12 is equal to or greater than the volume of the portion corresponding to the fourth sound signal A13. In this way, as a sound collection result of the present system 10, sound data A10 of input sound that has been accurately collected over a wide dynamic range using each of the sound signals A12 and A13 can be obtained.

[0119] In the digital camera 100 of this embodiment, the sound processing engine 170 acquires gain information set in the third and fourth amplifiers 222, 232 in the sound collection device 200, and uses the gain information to generate second sound data A10 from the third and fourth sound signals A12, A13. The system 10 can use this gain information to accurately generate the sound data A10 of the sound collection result. For example, the sound processing engine 170 uses the gain information to generate the sound data A10 of the sound collection result so as to reduce the difference between the gains Ga, Gb of the sound signals A2, A3. The sound processing engine 170 may acquire the gain information through information communication with the sound collection device 200 via the communication module 160.

[0120] In this embodiment, the predetermined data format is a float format having a mantissa part 52 and an exponent part 51. The audio processing engine 170 generates audio data A10 of the sound collection result such that the exponent part 51 increases as the volume of the input audio increases. In this way, the digital camera 100 of this embodiment can generate audio data A10 of the sound collection result with high accuracy using the float format.

[0121] (Embodiment 2) A second embodiment of the present disclosure will be described below with reference to Fig. 8. In the first embodiment, the imaging system 10 was described, which switches between floating recording using an internal configuration and floating recording using an external sound collection device 200. In the second embodiment, the imaging system 10 will be described, which performs such floating recording on multiple systems simultaneously in parallel.

[0122] Hereinafter, the imaging system 10 and digital camera 100 according to this embodiment will be described, with descriptions of the same configurations and operations as those of the imaging system 10 and digital camera 100 according to the first embodiment omitted as appropriate.

[0123] Fig. 8 is a diagram illustrating an imaging system 10 according to embodiment 2. The imaging system 10 of this embodiment has a configuration similar to that of the imaging system 10 of embodiment 1, but includes multiple float sound recording processors 175a and 175b in a digital camera 100, as shown in Fig. 8. Each of the float sound recording processors 175a and 175b has a configuration similar to that of the float sound recording processor 175 of embodiment 1 (Fig. 3), for example.

[0124] In the present system 10, the digital camera 100 inputs, for example, audio signals A2 and A3 from its internal configuration to a first floating recording processor 175a, and inputs audio signals A12 and A13 from the sound collection device 200 to a second floating recording processor 175b.

[0125] For example, the first float recording processor 175a is set with gain information for each of the signal processors 191 and 192 of the digital camera 100, similar to step S6 of the float recording setting operation (FIG. 5) in embodiment 1. In accordance with these settings, the first float recording processor 175a performs float recording processing on the input audio signals A2 and A3, and generates audio data A10a resulting from float recording by an internal sound collection means.

[0126] Similarly to step S7 of the float recording setting operation (FIG. 5) in embodiment 1, gain information for each of the signal processors 220 and 230 of the sound collection device 200 is set in the second float recording processor 175b. In accordance with these settings, the second float recording processor 175b performs float recording processing on the input audio signals A12 and A13 to generate audio data A10b resulting from float recording by an external sound collection means such as the sound collection device 200.

[0127] Furthermore, the digital camera 100 of this embodiment synchronizes the audio data A10a and A10b resulting from the two systems of float recording to generate a video file that includes both audio data as separate channels. For example, the control unit 135 of the digital camera 100 acquires latency information Lt of the connected sound collection device 200. This process is performed in the same manner as, for example, step S4 of the setting operation (FIG. 5) of the first embodiment.

[0128] Furthermore, the control unit 135 sets latency information Lt in the audio processing engine 170, for example, and delays the audio data 10a from the first floating recording processor 175 by the delay period of the latency information Lt to synchronize it with the audio data 10b from the second floating recording processor 175. For example, the moving image generation unit 136 encodes the audio of the two lines of audio data 10a and 10b thus synchronized using a predetermined method (for example, LPCM).

[0129] In the digital camera 100 of this embodiment, the video generation unit 136 encodes the image data sequentially generated by the image sensor 115 during video capture using a predetermined method (e.g., H.264 / H.265). Similar to the audio data A10a of the first floating recording processor 175, the video generation unit 136 delays the video data by the delay period indicated by the latency information Lt, synchronizes the video data with the audio data A10a and A10b, and multiplexes the data to associate them with each other, thereby generating a video file.

[0130] According to the above operation of the present system 10, it is possible to generate a video file including audio data from multiple systems by simultaneously performing float recording on multiple systems of sound collection means both inside and outside the digital camera 100. In this case, by acquiring latency information Lt of the sound collection device 200 by the digital camera 100, it is possible to synchronize the audio data A10a, A10b from multiple systems and to synchronize the audio data with the video data of the imaging results, taking into account the communication delay of the sound collection device 200.

[0131] The above description has been given of an example of operation in which two systems of audio data A10a, A10b are simultaneously generated in the imaging system 10. The system 10 is not particularly limited to two systems, and may be configured to generate three or more systems of audio data A10a, A10b. In the shooting environment of the digital camera 100, there may be cases where sound is simultaneously collected by multiple systems of sound collection means, such as multiple external microphones.

[0132] For example, an ambient microphone may be placed at a distance from the subject to capture environmental sounds, or a shotgun microphone may be pointed at the subject to capture both environmental sounds and the subject's voice. Alternatively, a boom microphone may be pointed above the subject, or a pin microphone may be placed at the subject. The system 10 may perform floating recording of each of these multiple sound collection means, for example, using the digital camera 100.

[0133] For example, in the present system 10, the digital camera 100 may be provided with three or more floating recording processors 175a-175b, or may be provided with a plurality of second floating recording processors 175b corresponding to the plurality of sound collection devices 200. In such a case, the digital camera 100 of this embodiment can obtain latency information Lt for each sound collection device 200 and synchronize the audio data and video data in the same manner as described above, for example, according to the longest delay period.

[0134] As described above, in this embodiment, digital camera 100 further includes video generation unit 136 that generates a video file by associating image data with first and second audio data A10a, A10b. Audio processing engine 170 generates first audio data A10a and second audio data A10b in synchronization with each other based on latency information from sound collection device 200. This allows video shooting using floating recording sound collection means inside and outside digital camera 100 simultaneously, making it easier to use floating recording when shooting video.

[0135] (Other embodiments) As described above, embodiments 1 and 2 have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made as appropriate. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments. Therefore, other embodiments will be described below as examples.

[0136] In the above-described first embodiment, an operational example in which the digital camera 100 receives gain information and the like from the sound collection device 200 has been described, but this embodiment is not limited to this. In this embodiment, the gain information and the like may be acquired not only from the sound collection device 200 but also through a user operation. Such a modified example will be described with reference to FIG. 9.

[0137] 9 shows an example of a display on the display monitor 130 of a modified digital camera 100. For example, the digital camera 100 of this embodiment displays an operation screen on the display monitor 130 that allows the gain Gc of the H-level signal processing unit 220 and the gain Gd of the L-level signal processing unit 230 of the sound collection device 200 to be changed, and accepts user operations on the operation screen at the operation unit 150. Furthermore, in the digital camera 100 of this embodiment, such an operation screen may allow the input of latency information for delay correction of the sound collection device 200.

[0138] 9, the gains Gc, Gd and delay amounts are displayed so that they can be changed numerically. The digital camera 100 may display options for the gains Gc, Gd or delay amounts for each model of the sound collection device 200, for example. Alternatively, the digital camera 100 may display the model of the sound collection device 200 as an option and accept a user operation for selection. The digital camera 100 of this embodiment may acquire gain information in accordance with the input of various user operations such as those described above.

[0139] The example in Fig. 9 shows an operation example in which two sound collection devices 200 are used to perform respective float recordings. In this case, the delay amount may be input for each sound collection device 200, as illustrated in Fig. 9. Alternatively, the delay amount between the two sound collection devices 200 may be input. For example, the digital camera 100 may separately acquire the delay period of one sound collection device 200 and perform delay correction for the other sound collection device 200 from the delay amount input by the user.

[0140] Furthermore, in the digital camera 100 of this embodiment, in the delay correction as described above, the amount of delay may be adjusted based on various factors other than communication with the sound collection device 200. Furthermore, the operation screen of such a digital camera 100 is not limited to two sound collection devices 200 in particular, and may accept user input of gain information and latency information for one sound collection device 200, or may be for three or more sound collection devices 200.

[0141] In the above-described first embodiment, an example of operation in which multiple systems of float recording inside and outside the digital camera 100 are switched between is described, and in the second embodiment, an example of operation in which multiple systems of float recording are performed simultaneously in parallel is described. The digital camera 100 of this embodiment may be configured to allow a user to select between the operation of switching between multiple systems of float recording as in the first embodiment, and the operation of performing multiple systems of float recording simultaneously in parallel as in the second embodiment. The digital camera 100 of this embodiment may prompt the user to make the above-described selection in, for example, a settings menu, and accept such a user operation at the operation unit 150.

[0142] In each of the above embodiments, an example has been described in which the sound collection device 200 and the digital camera 100 perform BLE communication to achieve floating recording. In this embodiment, the sound collection device 200 and the digital camera 100 may perform floating recording using wireless communication or wired communication other than BLE communication. For example, the sound collection device 200 of this embodiment may perform USB-standard wired communication with the digital camera 100 to transmit data of the audio signals A12 and A13.

[0143] In the above embodiments, the sound collection device 200 has been described as having two signal processing units 220, 230 for one channel of input sound. The sound collection device 200 of the present embodiment may also have three or more signal processing units for one channel of input sound. In the sound collection device 200 of the present embodiment, the gains of the three or more signal processing units may be set so that the dynamic range is shared among them. The digital camera 100 of the present embodiment may generate float format audio data based on the audio signals resulting from the sound collection by each of these three or more signal processing units so as to use audio that has been accurately collected in each audio signal. Furthermore, the digital camera 100 of the present embodiment may also have three or more signal processing units 191-192 for one channel of input sound.

[0144] In the above-described embodiments, examples have been described in which the sound collection device 200 does not perform floating recording processing. In this embodiment, the sound collection device 200 may perform floating recording processing and may further include a configuration such as an arithmetic circuit that realizes such processing. Alternatively, the sound collection device 200 may further include a recording function other than floating recording. Even in such a case, for example, by transmitting the audio signals A12 and A13 from the sound collection device 200 to the digital camera 100 as in the first embodiment, the floating recording processing can also be performed in the digital camera 100, thereby reducing the computational load of the sound collection device 200, for example. As in the above-described embodiments, the sound collection device 200 of this embodiment also makes it easy to obtain audio data indicating the sound collection results in floating format using the sound collection device 200 and the digital camera 100.

[0145] In the above-described embodiments, an example has been described in which the sound collection device 200 transmits data of the audio signals A12 and A13 to the digital camera 100, and the digital camera 100 performs floating recording processing. In the present embodiment, the sound collection device 200 may transmit data to an audio processing device such as various electronic devices other than an imaging device such as the digital camera 100. In the present embodiment, such an audio processing device may perform floating recording processing, as with the digital camera 100 of the first embodiment, or may include signal processing units 191-192 for floating recording. The audio processing device of the present embodiment may be an audio recorder or a microphone device.

[0146] That is, the audio processing device of this embodiment includes an audio input unit that inputs a first input audio, a first signal processing unit that performs a first amplification conversion on the first input audio to generate a first audio signal, a second signal processing unit that performs a second amplification conversion on the first input audio that is different from the first amplification conversion to generate a second audio signal, an audio processing unit that combines the first and second audio signals to generate first audio data in a predetermined data format that indicates the sound collection result of the first input audio, and a receiving unit that is communicatively connected to an external audio collecting device and receives third and fourth audio signals from the audio collecting device. The third audio signal indicates the result of the third amplification conversion performed on the second input audio in the audio collecting device. The fourth audio signal indicates the result of the fourth amplification conversion performed on the second input audio in the audio collecting device, which is different from the third amplification conversion. The audio processing unit combines the third and fourth audio signals received from the receiving unit to generate second audio data in a predetermined data format that indicates the sound collection result of the second input audio. As a result, in this embodiment, it is possible to easily obtain audio data indicating the results of sound collection in a predetermined format such as a float format using a sound collection device and a sound processing device.

[0147] In the above embodiments, the float format is used as an example of the predetermined data format. In this embodiment, the predetermined data format is not necessarily limited to the float format, and may be, for example, any of various data formats that can ensure the resolution of each voice whose volume differs significantly beyond the range of voice resolution.

[0148] In addition, in the above-described embodiments, the memory card 142 is exemplified as the recording medium, and the card slot 140 is exemplified as the recording unit of the digital camera 100, but the recording unit is not limited to this. In the present embodiment, the recording medium is not limited to a memory card, and may be, for example, an external storage device such as an SSD drive. Furthermore, the digital camera 100 of the present embodiment may upload video files and the like to a cloud server or the like via the communication module 160, for example.

[0149] Furthermore, in each of the above embodiments, the digital camera 100 is illustrated as including the optical system 110 and the drive unit 112. The imaging device of this embodiment does not need to include the optical system 110 and the drive unit 112, and may be, for example, an interchangeable lens camera.

[0150] In addition, although a digital camera has been described as an example of an imaging device in each of the above embodiments, the imaging device is not limited to this. The imaging device of the present disclosure may be any electronic device having an image capturing function (for example, a video camera, a smartphone, a tablet terminal, etc.).

[0151] (Summary of aspects) Various aspects of the present disclosure are described below.

[0152] A first aspect of the present disclosure includes an imaging unit that captures an image of a subject and generates image data, an audio input unit that inputs a first input audio, a first signal processing unit that performs a first amplification conversion on the first input audio to generate a first audio signal, a second signal processing unit that performs a second amplification conversion on the first input audio that is different from the first amplification conversion to generate a second audio signal, an audio processing unit that combines the first and second audio signals to generate first audio data in a predetermined data format that indicates the collection result of the first input audio, and a receiving unit that is communicatively connected to an external audio collecting device and receives third and fourth audio signals from the audio collecting device. The third audio signal indicates the result of the third amplification conversion performed on the second input audio in the audio collecting device. The fourth audio signal indicates the result of the fourth amplification conversion performed on the second input audio in the audio collecting device, different from the third amplification conversion. The audio processing unit combines the third and fourth audio signals received from the receiving unit to generate second audio data in a predetermined data format that indicates the collection result of the second input audio.

[0153] In a second aspect, the imaging device according to the first aspect further includes a video generation unit that generates a video file by associating image data with first or second audio data, and an audio processing unit that selectively generates one of the first audio data and the second audio data.

[0154] In a third aspect, the imaging device according to the first or second aspect further includes a video generation unit that generates a video file by associating image data with the first and second audio data, and the audio processing unit that generates the first audio data and the second audio data in synchronization with each other based on latency information of the sound collection device.

[0155] In a fourth aspect, the imaging device according to any one of the first to third aspects further includes a control unit that detects a communication connection between a sound collection device and a receiving unit and controls an audio processing unit. When the sound collection device connected to the receiving unit is capable of transmitting the third and fourth audio signals, the control unit controls the audio processing unit to generate second audio data based on the third and fourth audio signals.

[0156] In a fifth aspect, in the imaging device described in the fourth aspect, when a sound collection device is not connected to the receiving unit, the control unit controls the audio processing unit to generate first audio data based on the first and second audio signals.

[0157] In a sixth aspect, in the imaging device described in the fourth or fifth aspect, when the sound collection device connected to the receiving unit is not capable of transmitting the third and fourth sound signals, the control unit controls the sound processing unit to generate third sound data indicating the sound collection result of the second input sound in a format different from the specified data format based on the fifth sound signal received at the receiving unit from the sound collection device.

[0158] In a seventh aspect, in the imaging device according to any one of the first to sixth aspects, the first signal processing unit includes a first amplifier that amplifies a first input sound at a first gain and a first A / D converter that performs A / D conversion on the amplification result of the first amplifier to generate a first audio signal, and the second signal processing unit includes a second amplifier that amplifies the first input sound at a second gain smaller than the first gain and a second A / D converter that performs A / D conversion on the amplification result of the second amplifier to generate a second audio signal.

[0159] In an eighth aspect, in the imaging device according to any one of the first to seventh aspects, the third amplification conversion generates a third audio signal by amplifying the second input audio in a third amplifier set to a third gain and performing A / D conversion on the second input audio, and the fourth amplification conversion generates a fourth audio signal by amplifying the second input audio in a second amplifier set to a fourth gain smaller than the third gain and performing A / D conversion on the second input audio.

[0160] In a ninth aspect, in an imaging device described in any of the first to eighth aspects, the audio processing unit acquires gain information set in the third and fourth amplifiers in the sound collection device, and uses the gain information to generate second audio data from the third and fourth audio signals.

[0161] In a tenth aspect, in the imaging device according to any one of the first to ninth aspects, the predetermined data format is a float format having a mantissa part and an exponent part. The audio processing unit generates the first audio data such that the exponent part increases as the volume of the first input audio increases. The audio processing unit may generate the second audio data such that the exponent part increases as the volume of the second input audio increases.

[0162] As described above, the embodiments have been described as examples of the technology in the present disclosure, and for that purpose, the accompanying drawings and detailed description have been provided.

[0163] Therefore, the components shown in the accompanying drawings and detailed description may include not only essential components for solving the problem, but also components that are not essential for solving the problem in order to illustrate the above technology. Therefore, the fact that these non-essential components are shown in the accompanying drawings or detailed description should not be interpreted as immediately indicating that these non-essential components are essential.

[0164] Furthermore, since the above-described embodiments are intended to illustrate the technology of the present disclosure, various modifications, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents. [Industrial Applicability]

[0165] The present disclosure is applicable to an imaging device that receives an audio signal from a sound collection device, an audio processing device, and a system including these. [Explanation of symbols]

[0166] 10. Imaging System 100 digital cameras 115 Image Sensor 135 Control Unit 136 Video Generation Unit 160 Communication Module 170 Audio Processing Engine 180 Mike 191,192 Signal processing section 193,195 amps 194,196 A / D converters 200 Sound collection device 210 Audio input section 220,230 Signal processing section 240 Control Unit 260 Communications Department

Claims

1. an imaging unit that captures an image of a subject and generates image data; a voice input unit for inputting a first input voice; a first signal processing unit that performs a first amplification conversion on the first input audio to generate a first audio signal; a second signal processing unit that performs a second amplification conversion different from the first amplification conversion on the first input audio to generate a second audio signal; an audio processing unit that combines the first and second audio signals to generate first audio data in a predetermined data format that indicates a pickup result of the first input audio; a receiving unit that is communicatively connected to an external sound collecting device and receives the third and fourth audio signals from the sound collecting device; the third audio signal indicates a result of a third amplification conversion performed on the second input audio in the sound collection device; the fourth audio signal indicates a result of a fourth amplification conversion performed on the second input audio in the sound collection device, the fourth amplification conversion being different from the third amplification conversion; The audio processing unit combines the third and fourth audio signals received from the receiving unit to generate second audio data in the predetermined data format that indicates a pickup result of the second input audio. Imaging device.

2. a moving image generating unit that generates a moving image file by associating the image data with the first or second audio data; The audio processing unit selectively generates one of the first audio data and the second audio data. The imaging device according to claim 1 .

3. a moving image generating unit that generates a moving image file by associating the image data with the first and second audio data; The audio processing unit generates the first audio data and the second audio data in synchronization with each other based on latency information of the audio pickup device. The imaging device according to claim 1 .

4. a control unit that detects a communication connection between the sound collection device and the receiving unit and controls the sound processing unit; The control unit controls the audio processing unit to generate the second audio data based on the third and fourth audio signals when a sound collection device connected to the receiving unit is capable of transmitting the third and fourth audio signals. The imaging device according to claim 1 .

5. The control unit controls the audio processing unit to generate the first audio data based on the first and second audio signals when the audio pickup device is not connected to the receiving unit. The imaging device according to claim 4 .

6. When a sound collection device connected to the receiving unit is not capable of transmitting the third and fourth sound signals, the control unit controls the sound processing unit to generate third sound data indicating a collection result of the second input sound in a format different from the predetermined data format, based on a fifth sound signal received by the receiving unit from the sound collection device. The imaging device according to claim 4 .

7. the first signal processing unit includes a first amplifier that amplifies the first input audio signal at a first gain, and a first A / D converter that performs A / D conversion on a result of amplification by the first amplifier to generate the first audio signal; The second signal processing unit includes a second amplifier that amplifies the first input audio at a second gain that is smaller than the first gain, and a second A / D converter that performs A / D conversion on the amplification result of the second amplifier to generate the second audio signal. The imaging device according to claim 1 .

8. the third amplification and conversion includes amplifying the second input audio signal in a third amplifier having a third gain set thereto, and performing A / D conversion to generate the third audio signal; The fourth amplification conversion amplifies the second input audio in a fourth amplifier to which a fourth gain smaller than the third gain is set, and generates the fourth audio signal by A / D converting the amplified audio. The imaging device according to claim 1 .

9. The audio processing unit Acquire gain information set in the third and fourth amplifiers in the sound collection device, generating the second audio data from the third and fourth audio signals using the gain information; The imaging device according to claim 8 .

10. the predetermined data format is a float format having a mantissa and an exponent, The audio processing unit generates the first audio data so that the exponent part increases as the volume of the first input audio increases. The imaging device according to claim 1 .

Images